Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6679 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6674 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17654 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7504 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6679 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8699 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8944 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2949 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29262 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5150 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30039 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4675 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12967 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9239 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4699 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8035 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5189 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5531 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3907 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins17137404639140711262.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-09 21:44:16 + trial_dir_prefix=trial- + rm -rf trial-2364 trial-2364-bin.tgz trial-2364-run.tgz + trial_dir=trial-2365 + mkdir -p trial-2365 + mv open5gs.build-8.tgz osmo-bsc.build-17654.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6679.tgz osmo-hlr.build-8699.tgz osmo-hnbgw.build-2949.tgz osmo-mgw.build-8944.tgz osmo-msc.build-29262.tgz osmo-nitb.build-12967.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30039.tgz osmo-stp.build-9239.tgz osmo-trx.build-4675.tgz osmocom-bb.build-4699.tgz srslte.build-19.tgz trial-2365 + cat open5gs.build-8.md5 osmo-bsc.build-17654.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6679.md5 osmo-hlr.build-8699.md5 osmo-hnbgw.build-2949.md5 osmo-mgw.build-8944.md5 osmo-msc.build-29262.md5 osmo-nitb.build-12967.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30039.md5 osmo-stp.build-9239.md5 osmo-trx.build-4675.md5 osmocom-bb.build-4699.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17654.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6679.md5 osmo-hlr.build-8699.md5 osmo-hnbgw.build-2949.md5 osmo-mgw.build-8944.md5 osmo-msc.build-29262.md5 osmo-nitb.build-12967.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30039.md5 osmo-stp.build-9239.md5 osmo-trx.build-4675.md5 osmocom-bb.build-4699.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2365 combinations: None trial: 'trial-2365' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2365 -------------------------------------------------------------------------------------------- 21:44:27.846778 tst trial-2365: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/log --------------------------------------------------------------------- trial-2365 nitb_sms:sysmo --------------------------------------------------------------------- 21:46:35.980236 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:46:35.983978 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 21:46:36.005241 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 21:46:36.012156 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 21:46:36.067263 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 21:46:36.088447 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 21:46:36.095365 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 21:46:36.633828 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 21:46:36.639675 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 21:46:36.650759 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 21:46:37.029356 tst mo_mt_sms.py: using LAC 23869 21:46:37.273290 tst mo_mt_sms.py: using RAC 154 21:46:37.396358 tst mo_mt_sms.py: using CellId 23869 21:46:37.520348 tst mo_mt_sms.py: using BVCI 23870 21:46:37.626417 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 21:46:37.804260 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 21:46:37.918624 tst mo_mt_sms.py:9: start nitb and bts... 21:46:38.115735 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:46:40.323271 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19341): Launched 21:46:40.617895 run osmo-nitb_10.42.42.2(pid=19342): Launched 21:46:40.778305 run osmo-nitb_10.42.42.2(pid=19342): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19342)] 21:46:40.899920 run osmo-nitb_10.42.42.2(pid=19342): stdout: | (launched: 2022-12-09_21:46:40.563700) 21:46:41.022988 run osmo-nitb_10.42.42.2(pid=19342): stderr: | (launched: 2022-12-09_21:46:40.607635) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:46:41.146285 run osmo-nitb_10.42.42.2(pid=19342): stdout: | (launched: 2022-12-09_21:46:40.563700) 21:46:41.263267 run osmo-nitb_10.42.42.2(pid=19342): stderr: | (launched: 2022-12-09_21:46:40.607635) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:46:41.404231 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=19342): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19342) [trial-2365↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19342)] [trial-2365↪nitb_sms:sysmo↪mo_mt_sms.py:11] 21:46:41.412413 tst mo_mt_sms.py:11: Test FAILED (4.8 sec) 21:46:41.418842 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19341): Terminating (SIGTERM) 21:46:41.627576 --- ParallelTerminationStrategy: PID 19341 died... 21:46:41.648152 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19341): Terminated: ok {rc=0} 21:46:41.732357 bus /sierra_3: Setting Powered False 21:46:42.830892 bus /sierra_3: Setting Powered False 21:46:43.948245 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 sms:sysmo --------------------------------------------------------------------- 21:46:45.133068 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:46:45.137281 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 21:46:45.158562 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 21:46:45.185890 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 21:46:45.238486 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 21:46:45.259519 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 21:46:45.286288 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 21:46:45.842206 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 sms:sysmo mo_mt_sms.py ---------------------------------------------- 21:46:45.853047 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:45.864083 tst sms:sysmo: Using 1 x bts (candidates: 1) 21:46:45.912606 tst mo_mt_sms.py: using LAC 23870 21:46:46.053349 tst mo_mt_sms.py: using RAC 155 21:46:46.192545 tst mo_mt_sms.py: using CellId 23870 21:46:46.340458 tst mo_mt_sms.py: using BVCI 23871 21:46:46.450980 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:46.462476 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:46.473848 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:46.486222 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:46.498680 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:46.510898 tst sms:sysmo: Using 1 x modem (candidates: 2) 21:46:46.630133 tst sms:sysmo: Using 1 x modem (candidates: 2) 21:46:46.755223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:46:48.475669 run create_hlr_db(pid=19346): Launched 21:46:48.607256 bus /sierra_2: Setting Powered False 21:46:49.670043 run create_hlr_db(pid=19346): Terminated: ok {rc=0} 21:46:50.097153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19348): Launched 21:46:50.394583 run osmo-hlr_10.42.42.2(pid=19349): Launched 21:46:50.507341 run osmo-stp_10.42.42.5: Starting osmo-stp 21:46:52.947560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19351): Launched 21:46:53.243349 run osmo-stp_10.42.42.5(pid=19352): Launched 21:46:53.355854 run osmo-msc_10.42.42.6: Starting osmo-msc 21:46:58.533249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19354): Launched 21:46:58.827219 run osmo-msc_10.42.42.6(pid=19355): Launched 21:46:58.992551 run osmo-stp_10.42.42.5(pid=19352): ERR: Terminated: ERROR {rc=1} [trial-2365↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19352)] 21:46:59.118597 run osmo-stp_10.42.42.5(pid=19352): stdout: | (launched: 2022-12-09_21:46:53.188765) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:46:59.244839 run osmo-stp_10.42.42.5(pid=19352): stderr: | 20221209214653359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214653359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214653359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214653360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214653362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214653362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214653362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:46:59.368118 run osmo-stp_10.42.42.5(pid=19352): stdout: | (launched: 2022-12-09_21:46:53.188765) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:46:59.485818 run osmo-stp_10.42.42.5(pid=19352): stderr: | 20221209214653359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214653359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214653359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214653360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214653362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214653362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214653362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:46:59.626319 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=19352): Process ended prematurely: osmo-stp_10.42.42.5(pid=19352) [trial-2365↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19352)] [trial-2365↪sms:sysmo↪mo_mt_sms.py:16] 21:46:59.634455 tst mo_mt_sms.py:16: Test FAILED (13.8 sec) 21:46:59.660495 run osmo-hlr_10.42.42.2(pid=19349): ERR: Terminated: ERROR {rc=237} [trial-2365↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19349)] 21:46:59.708510 run osmo-hlr_10.42.42.2(pid=19349): stdout: | (launched: 2022-12-09_21:46:50.340099) 21:46:59.757908 run osmo-hlr_10.42.42.2(pid=19349): stderr: | 20221209214650516 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214650516 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214650516 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214650516 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214650516 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214650516 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214650529 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214650538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214650538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214650538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:46:59.826610 run osmo-msc_10.42.42.6(pid=19355): ERR: Terminated: ERROR {rc=2} [trial-2365↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19355)] 21:46:59.874162 run osmo-msc_10.42.42.6(pid=19355): stdout: | (launched: 2022-12-09_21:46:58.773349) 21:46:59.923365 run osmo-msc_10.42.42.6(pid=19355): stderr: | 20221209214659044 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214659045 DLGLOBAL DEBUG validating counter group 0x7f38bc838c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214659045 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214659045 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214659045 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214659045 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214659047 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214659047 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214659048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214659048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:46:59.973437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19348): Terminating (SIGTERM) 21:47:00.012915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19351): Terminating (SIGTERM) 21:47:00.052676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19354): Terminating (SIGTERM) 21:47:00.092809 --- ParallelTerminationStrategy: PID 19348 died... 21:47:00.111817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19348): Terminated: ok {rc=0} 21:47:00.156227 --- ParallelTerminationStrategy: PID 19351 died... 21:47:00.174898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19351): Terminated: ok {rc=0} 21:47:00.218986 --- ParallelTerminationStrategy: PID 19354 died... 21:47:00.237752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19354): Terminated: ok {rc=0} 21:47:00.322505 bus /sierra_3: Setting Powered False 21:47:01.429478 bus /sierra_3: Setting Powered False 21:47:02.586661 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_ussd:sysmo --------------------------------------------------------------------- 21:47:03.800729 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:47:03.804280 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 21:47:03.824739 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 21:47:03.832250 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 21:47:03.867947 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 21:47:03.889502 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 21:47:03.896480 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 21:47:04.416438 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2365 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 21:47:04.422626 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 21:47:04.435689 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 21:47:04.470093 tst assert_extension.py: using LAC 23871 21:47:04.589091 tst assert_extension.py: using RAC 156 21:47:04.704696 tst assert_extension.py: using CellId 23871 21:47:04.818128 tst assert_extension.py: using BVCI 23872 21:47:04.924356 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 21:47:05.040425 tst assert_extension.py:10: start nitb and bts... 21:47:05.256282 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:47:05.904391 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19361): Launched 21:47:06.220811 run osmo-nitb_10.42.42.2(pid=19362): Launched 21:47:06.396245 run osmo-nitb_10.42.42.2(pid=19362): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19362)] 21:47:06.538482 run osmo-nitb_10.42.42.2(pid=19362): stdout: | (launched: 2022-12-09_21:47:06.163041) 21:47:06.682535 run osmo-nitb_10.42.42.2(pid=19362): stderr: | (launched: 2022-12-09_21:47:06.210191) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:47:06.825977 run osmo-nitb_10.42.42.2(pid=19362): stdout: | (launched: 2022-12-09_21:47:06.163041) 21:47:06.963401 run osmo-nitb_10.42.42.2(pid=19362): stderr: | (launched: 2022-12-09_21:47:06.210191) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19362): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19362) [trial-2365↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19362)] 21:47:07.340442 tst osmo-nitb_10.42.42.2(pid=19362): stdout: | (launched: 2022-12-09_21:47:06.163041) 21:47:07.495282 tst osmo-nitb_10.42.42.2(pid=19362): stderr: | (launched: 2022-12-09_21:47:06.210191) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:47:07.682783 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=19362): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19362) [trial-2365↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19362)] [trial-2365↪nitb_ussd:sysmo↪assert_extension.py:12] 21:47:07.694841 tst assert_extension.py:12: Test FAILED (3.3 sec) 21:47:07.703945 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19361): Terminating (SIGTERM) 21:47:07.915928 --- ParallelTerminationStrategy: PID 19361 died... 21:47:07.938415 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19361): Terminated: ok {rc=0} 21:47:08.026406 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 ussd:sysmo --------------------------------------------------------------------- 21:47:09.204776 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:47:09.209684 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 21:47:09.231457 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 21:47:09.258546 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 21:47:09.296997 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 21:47:09.319128 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 21:47:09.346310 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 21:47:09.872369 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2365 ussd:sysmo assert_extension.py ---------------------------------------------- 21:47:09.878380 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:09.889228 tst ussd:sysmo: Using 1 x bts (candidates: 1) 21:47:09.927042 tst assert_extension.py: using LAC 23872 21:47:10.054315 tst assert_extension.py: using RAC 157 21:47:10.176225 tst assert_extension.py: using CellId 23872 21:47:10.298358 tst assert_extension.py: using BVCI 23873 21:47:10.413892 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:10.424701 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:10.435618 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:10.446379 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:10.457285 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:10.468006 tst ussd:sysmo: Using 1 x modem (candidates: 1) 21:47:10.580376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:11.040886 run create_hlr_db(pid=19367): Launched 21:47:11.154374 bus /sierra_2: Setting Powered False 21:47:12.213286 run create_hlr_db(pid=19367): Terminated: ok {rc=0} 21:47:12.628908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19369): Launched 21:47:12.925030 run osmo-hlr_10.42.42.2(pid=19370): Launched 21:47:13.038125 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:13.546794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19372): Launched 21:47:13.842872 run osmo-stp_10.42.42.5(pid=19373): Launched 21:47:13.955309 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:14.486797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19375): Launched 21:47:14.782786 run osmo-msc_10.42.42.6(pid=19376): Launched 21:47:14.947874 run osmo-stp_10.42.42.5(pid=19373): ERR: Terminated: ERROR {rc=1} [trial-2365↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19373)] 21:47:15.073619 run osmo-stp_10.42.42.5(pid=19373): stdout: | (launched: 2022-12-09_21:47:13.787514) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:15.200063 run osmo-stp_10.42.42.5(pid=19373): stderr: | 20221209214713954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214713954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214713955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214713955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214713957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214713957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214713957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:15.324185 run osmo-stp_10.42.42.5(pid=19373): stdout: | (launched: 2022-12-09_21:47:13.787514) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:15.442422 run osmo-stp_10.42.42.5(pid=19373): stderr: | 20221209214713954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214713954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214713955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214713955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214713957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214713957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214713957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:15.583939 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=19373): Process ended prematurely: osmo-stp_10.42.42.5(pid=19373) [trial-2365↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19373)] [trial-2365↪ussd:sysmo↪assert_extension.py:17] 21:47:15.592353 tst assert_extension.py:17: Test FAILED (5.7 sec) 21:47:15.618875 run osmo-hlr_10.42.42.2(pid=19370): ERR: Terminated: ERROR {rc=237} [trial-2365↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19370)] 21:47:15.667147 run osmo-hlr_10.42.42.2(pid=19370): stdout: | (launched: 2022-12-09_21:47:12.870395) 21:47:15.716858 run osmo-hlr_10.42.42.2(pid=19370): stderr: | 20221209214713044 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214713044 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214713044 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214713044 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214713044 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214713044 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214713085 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214713095 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214713095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214713095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:15.786088 run osmo-msc_10.42.42.6(pid=19376): ERR: Terminated: ERROR {rc=2} [trial-2365↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19376)] 21:47:15.838642 run osmo-msc_10.42.42.6(pid=19376): stdout: | (launched: 2022-12-09_21:47:14.728102) 21:47:15.896763 run osmo-msc_10.42.42.6(pid=19376): stderr: | 20221209214715001 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214715001 DLGLOBAL DEBUG validating counter group 0x7f35d5f18c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214715001 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214715001 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214715001 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214715001 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214715003 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214715003 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214715004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214715004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:15.948077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19369): Terminating (SIGTERM) 21:47:15.989180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19372): Terminating (SIGTERM) 21:47:16.030136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19375): Terminating (SIGTERM) 21:47:16.071500 --- ParallelTerminationStrategy: PID 19369 died... 21:47:16.090928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19369): Terminated: ok {rc=0} 21:47:16.137189 --- ParallelTerminationStrategy: PID 19372 died... 21:47:16.156673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19372): Terminated: ok {rc=0} 21:47:16.202899 --- ParallelTerminationStrategy: PID 19375 died... 21:47:16.222140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19375): Terminated: ok {rc=0} 21:47:16.311432 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 21:47:17.513426 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:47:17.519737 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 21:47:17.540250 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 21:47:17.567754 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 21:47:17.618945 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 21:47:17.640812 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 21:47:17.671056 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 21:47:18.218691 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 21:47:18.269569 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:18.280493 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:47:18.335034 tst mo_mt_call.py: using LAC 23873 21:47:18.454703 tst mo_mt_call.py: using RAC 158 21:47:18.570594 tst mo_mt_call.py: using CellId 23873 21:47:18.686727 tst mo_mt_call.py: using BVCI 23874 21:47:18.797704 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:18.808762 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:18.819703 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:18.830854 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:18.841857 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:18.853262 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:47:18.973960 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:47:19.093903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:19.595306 run create_hlr_db(pid=19381): Launched 21:47:19.712401 bus /sierra_2: Setting Powered False 21:47:20.772543 run create_hlr_db(pid=19381): Terminated: ok {rc=0} 21:47:21.192638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19383): Launched 21:47:21.494435 run osmo-hlr_10.42.42.2(pid=19384): Launched 21:47:21.609975 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:22.131354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19386): Launched 21:47:22.433703 run osmo-stp_10.42.42.5(pid=19387): Launched 21:47:22.548829 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:23.093390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19389): Launched 21:47:23.397657 run osmo-msc_10.42.42.6(pid=19390): Launched 21:47:23.566386 run osmo-stp_10.42.42.5(pid=19387): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19387)] 21:47:23.695013 run osmo-stp_10.42.42.5(pid=19387): stdout: | (launched: 2022-12-09_21:47:22.378413) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:23.823555 run osmo-stp_10.42.42.5(pid=19387): stderr: | 20221209214722548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214722548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214722548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214722549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214722549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214722549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214722549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:23.950330 run osmo-stp_10.42.42.5(pid=19387): stdout: | (launched: 2022-12-09_21:47:22.378413) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:24.070738 run osmo-stp_10.42.42.5(pid=19387): stderr: | 20221209214722548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214722548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214722548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214722549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214722549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214722549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214722549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:24.214645 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19387): Process ended prematurely: osmo-stp_10.42.42.5(pid=19387) [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19387)] [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 21:47:24.223486 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 21:47:24.250383 run osmo-hlr_10.42.42.2(pid=19384): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19384)] 21:47:24.298483 run osmo-hlr_10.42.42.2(pid=19384): stdout: | (launched: 2022-12-09_21:47:21.439158) 21:47:24.348067 run osmo-hlr_10.42.42.2(pid=19384): stderr: | 20221209214721616 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214721616 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214721616 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214721616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214721616 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214721616 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214721630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214721639 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214721639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214721639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:24.416929 run osmo-msc_10.42.42.6(pid=19390): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19390)] 21:47:24.464789 run osmo-msc_10.42.42.6(pid=19390): stdout: | (launched: 2022-12-09_21:47:23.342066) 21:47:24.514262 run osmo-msc_10.42.42.6(pid=19390): stderr: | 20221209214723614 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214723614 DLGLOBAL DEBUG validating counter group 0x7fd53faadc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214723614 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214723614 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214723614 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214723615 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214723617 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214723617 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214723618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214723618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:24.564138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19383): Terminating (SIGTERM) 21:47:24.604246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19386): Terminating (SIGTERM) 21:47:24.644255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19389): Terminating (SIGTERM) 21:47:24.684592 --- ParallelTerminationStrategy: PID 19383 died... 21:47:24.703727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19383): Terminated: ok {rc=0} 21:47:24.748058 --- ParallelTerminationStrategy: PID 19386 died... 21:47:24.766795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19386): Terminated: ok {rc=0} 21:47:24.811399 --- ParallelTerminationStrategy: PID 19389 died... 21:47:24.830184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19389): Terminated: ok {rc=0} 21:47:24.916555 bus /sierra_3: Setting Powered False 21:47:26.016770 bus /sierra_3: Setting Powered False 21:47:27.133902 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 21:47:28.281617 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:28.293162 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:47:28.349429 tst mo_mt_call_osmux.py: using LAC 23874 21:47:28.469756 tst mo_mt_call_osmux.py: using RAC 159 21:47:28.597662 tst mo_mt_call_osmux.py: using CellId 23874 21:47:28.726865 tst mo_mt_call_osmux.py: using BVCI 23875 21:47:28.846119 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:28.857681 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:28.868935 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:28.880154 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:28.891426 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:28.902682 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:47:29.019146 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:47:29.139325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:29.641906 run create_hlr_db(pid=19392): Launched 21:47:29.774063 bus /sierra_2: Setting Powered False 21:47:30.842487 run create_hlr_db(pid=19392): Terminated: ok {rc=0} 21:47:31.291218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19394): Launched 21:47:31.653663 run osmo-hlr_10.42.42.2(pid=19395): Launched 21:47:31.902915 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:32.551187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19397): Launched 21:47:32.854666 run osmo-stp_10.42.42.5(pid=19398): Launched 21:47:32.969487 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:33.513983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19400): Launched 21:47:33.815478 run osmo-msc_10.42.42.6(pid=19401): Launched 21:47:33.983319 run osmo-stp_10.42.42.5(pid=19398): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19398)] 21:47:34.111036 run osmo-stp_10.42.42.5(pid=19398): stdout: | (launched: 2022-12-09_21:47:32.798712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:34.239297 run osmo-stp_10.42.42.5(pid=19398): stderr: | 20221209214732967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214732967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214732967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214732968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214732970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214732970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214732970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:34.365727 run osmo-stp_10.42.42.5(pid=19398): stdout: | (launched: 2022-12-09_21:47:32.798712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:34.485839 run osmo-stp_10.42.42.5(pid=19398): stderr: | 20221209214732967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214732967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214732967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214732968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214732970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214732970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214732970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:34.629443 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19398): Process ended prematurely: osmo-stp_10.42.42.5(pid=19398) [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19398)] [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 21:47:34.638122 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 21:47:34.664662 run osmo-hlr_10.42.42.2(pid=19395): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19395)] 21:47:34.712855 run osmo-hlr_10.42.42.2(pid=19395): stdout: | (launched: 2022-12-09_21:47:31.584533) 21:47:34.762662 run osmo-hlr_10.42.42.2(pid=19395): stderr: | 20221209214731896 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214731896 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214731896 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214731896 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214731896 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214731896 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214731916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214731930 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214731930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214731930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:34.831394 run osmo-msc_10.42.42.6(pid=19401): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19401)] 21:47:34.878990 run osmo-msc_10.42.42.6(pid=19401): stdout: | (launched: 2022-12-09_21:47:33.760132) 21:47:34.928485 run osmo-msc_10.42.42.6(pid=19401): stderr: | 20221209214734031 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214734032 DLGLOBAL DEBUG validating counter group 0x7f1d68182c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214734032 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214734032 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214734033 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214734033 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214734035 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214734036 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214734036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214734036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:34.978073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19394): Terminating (SIGTERM) 21:47:35.017792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19397): Terminating (SIGTERM) 21:47:35.057594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19400): Terminating (SIGTERM) 21:47:35.097455 --- ParallelTerminationStrategy: PID 19394 died... 21:47:35.116529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19394): Terminated: ok {rc=0} 21:47:35.161245 --- ParallelTerminationStrategy: PID 19397 died... 21:47:35.179635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19397): Terminated: ok {rc=0} 21:47:35.223957 --- ParallelTerminationStrategy: PID 19400 died... 21:47:35.242497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19400): Terminated: ok {rc=0} 21:47:35.328267 bus /sierra_3: Setting Powered False 21:47:36.428701 bus /sierra_3: Setting Powered False 21:47:37.544112 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 21:47:38.783096 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:47:38.790116 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 21:47:38.811618 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 21:47:38.838701 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 21:47:38.890918 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 21:47:38.911983 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 21:47:38.938860 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 21:47:39.494928 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 21:47:39.545978 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:39.557293 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:47:39.614060 tst mo_mt_call.py: using LAC 23875 21:47:39.741049 tst mo_mt_call.py: using RAC 160 21:47:39.869448 tst mo_mt_call.py: using CellId 23875 21:47:39.995552 tst mo_mt_call.py: using BVCI 23876 21:47:40.112523 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:40.123983 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:40.135091 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:40.146247 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:40.157503 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:40.168645 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:47:40.283909 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:47:40.400190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:40.869542 run create_hlr_db(pid=19406): Launched 21:47:40.987297 bus /sierra_2: Setting Powered False 21:47:42.048327 run create_hlr_db(pid=19406): Terminated: ok {rc=0} 21:47:42.470567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19408): Launched 21:47:42.771788 run osmo-hlr_10.42.42.2(pid=19409): Launched 21:47:42.887568 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:43.409988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19411): Launched 21:47:43.711547 run osmo-stp_10.42.42.5(pid=19412): Launched 21:47:43.827064 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:44.372478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19414): Launched 21:47:44.675316 run osmo-msc_10.42.42.6(pid=19415): Launched 21:47:44.844200 run osmo-stp_10.42.42.5(pid=19412): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19412)] 21:47:44.972307 run osmo-stp_10.42.42.5(pid=19412): stdout: | (launched: 2022-12-09_21:47:43.656292) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:45.100711 run osmo-stp_10.42.42.5(pid=19412): stderr: | 20221209214743828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214743828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214743828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214743828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214743829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214743829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214743829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:45.226438 run osmo-stp_10.42.42.5(pid=19412): stdout: | (launched: 2022-12-09_21:47:43.656292) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:45.346680 run osmo-stp_10.42.42.5(pid=19412): stderr: | 20221209214743828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214743828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214743828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214743828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214743829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214743829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214743829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:45.490977 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19412): Process ended prematurely: osmo-stp_10.42.42.5(pid=19412) [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19412)] [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 21:47:45.499601 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 21:47:45.526489 run osmo-hlr_10.42.42.2(pid=19409): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19409)] 21:47:45.574477 run osmo-hlr_10.42.42.2(pid=19409): stdout: | (launched: 2022-12-09_21:47:42.716308) 21:47:45.624049 run osmo-hlr_10.42.42.2(pid=19409): stderr: | 20221209214742893 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214742893 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214742893 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214742893 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214742893 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214742893 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214742905 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214742913 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214742914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214742914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:45.692788 run osmo-msc_10.42.42.6(pid=19415): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19415)] 21:47:45.740495 run osmo-msc_10.42.42.6(pid=19415): stdout: | (launched: 2022-12-09_21:47:44.619718) 21:47:45.789953 run osmo-msc_10.42.42.6(pid=19415): stderr: | 20221209214744890 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214744890 DLGLOBAL DEBUG validating counter group 0x7f79c81f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214744890 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214744890 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214744891 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214744891 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214744892 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214744893 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214744893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214744893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:45.840243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19408): Terminating (SIGTERM) 21:47:45.889321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19411): Terminating (SIGTERM) 21:47:45.940139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19414): Terminating (SIGTERM) 21:47:45.982084 --- ParallelTerminationStrategy: PID 19408 died... 21:47:46.001635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19408): Terminated: ok {rc=0} 21:47:46.048590 --- ParallelTerminationStrategy: PID 19411 died... 21:47:46.068007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19411): Terminated: ok {rc=0} 21:47:46.115529 --- ParallelTerminationStrategy: PID 19414 died... 21:47:46.135079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19414): Terminated: ok {rc=0} 21:47:46.222908 bus /sierra_3: Setting Powered False 21:47:47.318816 bus /sierra_3: Setting Powered False 21:47:48.431963 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 21:47:49.581538 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:49.593475 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:47:49.651507 tst mo_mt_call_osmux.py: using LAC 23876 21:47:49.777735 tst mo_mt_call_osmux.py: using RAC 161 21:47:49.905713 tst mo_mt_call_osmux.py: using CellId 23876 21:47:50.032107 tst mo_mt_call_osmux.py: using BVCI 23877 21:47:50.151750 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:50.163223 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:50.174409 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:50.185599 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:50.196732 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:50.207995 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:47:50.324586 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:47:50.440531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:50.912349 run create_hlr_db(pid=19417): Launched 21:47:51.028672 bus /sierra_2: Setting Powered False 21:47:52.089861 run create_hlr_db(pid=19417): Terminated: ok {rc=0} 21:47:52.533334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19419): Launched 21:47:52.857494 run osmo-hlr_10.42.42.2(pid=19420): Launched 21:47:52.982273 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:53.545386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19422): Launched 21:47:53.872359 run osmo-stp_10.42.42.5(pid=19423): Launched 21:47:53.995243 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:54.580922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19425): Launched 21:47:54.904060 run osmo-msc_10.42.42.6(pid=19426): Launched 21:47:55.084261 run osmo-stp_10.42.42.5(pid=19423): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19423)] 21:47:55.221290 run osmo-stp_10.42.42.5(pid=19423): stdout: | (launched: 2022-12-09_21:47:53.812506) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:55.359306 run osmo-stp_10.42.42.5(pid=19423): stderr: | 20221209214754005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214754005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214754005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214754006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214754006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214754006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214754006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:55.495523 run osmo-stp_10.42.42.5(pid=19423): stdout: | (launched: 2022-12-09_21:47:53.812506) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:55.624496 run osmo-stp_10.42.42.5(pid=19423): stderr: | 20221209214754005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214754005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214754005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214754006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214754006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214754006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214754006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:55.778634 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19423): Process ended prematurely: osmo-stp_10.42.42.5(pid=19423) [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19423)] [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 21:47:55.787878 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 21:47:55.815371 run osmo-hlr_10.42.42.2(pid=19420): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19420)] 21:47:55.865310 run osmo-hlr_10.42.42.2(pid=19420): stdout: | (launched: 2022-12-09_21:47:52.798635) 21:47:55.917303 run osmo-hlr_10.42.42.2(pid=19420): stderr: | 20221209214752997 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214752997 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214752997 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214752997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214752997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214752997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214753010 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214753018 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214753018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214753018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:55.989596 run osmo-msc_10.42.42.6(pid=19426): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19426)] 21:47:56.039782 run osmo-msc_10.42.42.6(pid=19426): stdout: | (launched: 2022-12-09_21:47:54.845092) 21:47:56.091963 run osmo-msc_10.42.42.6(pid=19426): stderr: | 20221209214755169 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214755169 DLGLOBAL DEBUG validating counter group 0x7f602decfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214755169 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214755170 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214755170 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214755170 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214755172 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214755172 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214755172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214755172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:56.144192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19419): Terminating (SIGTERM) 21:47:56.186059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19422): Terminating (SIGTERM) 21:47:56.227809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19425): Terminating (SIGTERM) 21:47:56.269660 --- ParallelTerminationStrategy: PID 19419 died... 21:47:56.289553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19419): Terminated: ok {rc=0} 21:47:56.335677 --- ParallelTerminationStrategy: PID 19422 died... 21:47:56.355500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19422): Terminated: ok {rc=0} 21:47:56.401476 --- ParallelTerminationStrategy: PID 19425 died... 21:47:56.421158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19425): Terminated: ok {rc=0} 21:47:56.508358 bus /sierra_3: Setting Powered False 21:47:57.607875 bus /sierra_3: Setting Powered False 21:47:58.723156 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 21:47:59.952047 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:47:59.958336 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 21:47:59.979375 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 21:48:00.005856 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 21:48:00.057709 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 21:48:00.078603 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 21:48:00.105145 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 21:48:00.653602 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 21:48:00.708263 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:00.719754 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:48:00.777705 tst mo_mt_call.py: using LAC 23877 21:48:00.925004 tst mo_mt_call.py: using RAC 162 21:48:01.051260 tst mo_mt_call.py: using CellId 23877 21:48:01.212546 tst mo_mt_call.py: using BVCI 23878 21:48:01.360760 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:01.373322 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:01.385413 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:01.397750 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:01.409934 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:01.421911 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:48:01.542844 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:48:01.670069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:02.194447 run create_hlr_db(pid=19431): Launched 21:48:02.343914 bus /sierra_2: Setting Powered False 21:48:03.404690 run create_hlr_db(pid=19431): Terminated: ok {rc=0} 21:48:03.826825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19433): Launched 21:48:04.129313 run osmo-hlr_10.42.42.2(pid=19434): Launched 21:48:04.244157 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:04.777059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19436): Launched 21:48:05.079947 run osmo-stp_10.42.42.5(pid=19437): Launched 21:48:05.195813 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:05.743084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19439): Launched 21:48:06.046618 run osmo-msc_10.42.42.6(pid=19440): Launched 21:48:06.228700 run osmo-stp_10.42.42.5(pid=19437): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19437)] 21:48:06.367234 run osmo-stp_10.42.42.5(pid=19437): stdout: | (launched: 2022-12-09_21:48:05.024366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:06.506082 run osmo-stp_10.42.42.5(pid=19437): stderr: | 20221209214805195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214805195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214805196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214805196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214805196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214805196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214805197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:06.642736 run osmo-stp_10.42.42.5(pid=19437): stdout: | (launched: 2022-12-09_21:48:05.024366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:06.771805 run osmo-stp_10.42.42.5(pid=19437): stderr: | 20221209214805195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214805195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214805196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214805196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214805196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214805196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214805197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:06.926348 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19437): Process ended prematurely: osmo-stp_10.42.42.5(pid=19437) [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19437)] [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 21:48:06.935753 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:48:06.963466 run osmo-hlr_10.42.42.2(pid=19434): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19434)] 21:48:07.013636 run osmo-hlr_10.42.42.2(pid=19434): stdout: | (launched: 2022-12-09_21:48:04.073970) 21:48:07.065557 run osmo-hlr_10.42.42.2(pid=19434): stderr: | 20221209214804251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214804251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214804251 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214804251 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214804251 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214804251 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214804262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214804271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214804271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214804271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:07.137310 run osmo-msc_10.42.42.6(pid=19440): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19440)] 21:48:07.187112 run osmo-msc_10.42.42.6(pid=19440): stdout: | (launched: 2022-12-09_21:48:05.989960) 21:48:07.238717 run osmo-msc_10.42.42.6(pid=19440): stderr: | 20221209214806308 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214806308 DLGLOBAL DEBUG validating counter group 0x7f6b78478c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214806308 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214806308 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214806309 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214806309 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214806310 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214806311 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214806311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214806311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:07.290460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19433): Terminating (SIGTERM) 21:48:07.332002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19436): Terminating (SIGTERM) 21:48:07.374362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19439): Terminating (SIGTERM) 21:48:07.416521 --- ParallelTerminationStrategy: PID 19433 died... 21:48:07.436503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19433): Terminated: ok {rc=0} 21:48:07.482977 --- ParallelTerminationStrategy: PID 19436 died... 21:48:07.502567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19436): Terminated: ok {rc=0} 21:48:07.548671 --- ParallelTerminationStrategy: PID 19439 died... 21:48:07.568309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19439): Terminated: ok {rc=0} 21:48:07.656652 bus /sierra_3: Setting Powered False 21:48:08.755303 bus /sierra_3: Setting Powered False 21:48:09.871668 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 21:48:11.018479 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:11.029997 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:48:11.085730 tst mo_mt_call_osmux.py: using LAC 23878 21:48:11.204454 tst mo_mt_call_osmux.py: using RAC 163 21:48:11.324846 tst mo_mt_call_osmux.py: using CellId 23878 21:48:11.453896 tst mo_mt_call_osmux.py: using BVCI 23879 21:48:11.564684 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:11.575732 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:11.586749 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:11.597979 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:11.609095 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:11.620086 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:48:11.736136 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:48:11.855448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:12.325951 run create_hlr_db(pid=19442): Launched 21:48:12.441092 bus /sierra_2: Setting Powered False 21:48:13.501730 run create_hlr_db(pid=19442): Terminated: ok {rc=0} 21:48:13.944668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19444): Launched 21:48:14.269397 run osmo-hlr_10.42.42.2(pid=19445): Launched 21:48:14.395443 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:14.956402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19447): Launched 21:48:15.280105 run osmo-stp_10.42.42.5(pid=19448): Launched 21:48:15.403538 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:16.018908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19450): Launched 21:48:16.345856 run osmo-msc_10.42.42.6(pid=19451): Launched 21:48:16.686102 run osmo-stp_10.42.42.5(pid=19448): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19448)] 21:48:16.981677 run osmo-stp_10.42.42.5(pid=19448): stdout: | (launched: 2022-12-09_21:48:15.221214) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:17.265616 run osmo-stp_10.42.42.5(pid=19448): stderr: | 20221209214815413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214815413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214815413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214815414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214815414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214815414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214815414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:17.404062 run osmo-stp_10.42.42.5(pid=19448): stdout: | (launched: 2022-12-09_21:48:15.221214) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:17.533204 run osmo-stp_10.42.42.5(pid=19448): stderr: | 20221209214815413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214815413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214815413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214815414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214815414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214815414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214815414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:17.687445 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19448): Process ended prematurely: osmo-stp_10.42.42.5(pid=19448) [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19448)] [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 21:48:17.697068 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 21:48:17.724683 run osmo-hlr_10.42.42.2(pid=19445): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19445)] 21:48:17.774807 run osmo-hlr_10.42.42.2(pid=19445): stdout: | (launched: 2022-12-09_21:48:14.209730) 21:48:17.826513 run osmo-hlr_10.42.42.2(pid=19445): stderr: | 20221209214814409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214814409 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214814409 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214814410 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214814410 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214814410 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214814421 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214814429 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214814429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214814429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:17.898657 run osmo-msc_10.42.42.6(pid=19451): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19451)] 21:48:17.948729 run osmo-msc_10.42.42.6(pid=19451): stdout: | (launched: 2022-12-09_21:48:16.279875) 21:48:18.000704 run osmo-msc_10.42.42.6(pid=19451): stderr: | 20221209214816789 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214816789 DLGLOBAL DEBUG validating counter group 0x7f97dd651c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214816789 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214816789 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214816789 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214816790 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214816791 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214816792 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214816792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214816792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:18.052720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19444): Terminating (SIGTERM) 21:48:18.095075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19447): Terminating (SIGTERM) 21:48:18.136742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19450): Terminating (SIGTERM) 21:48:18.178590 --- ParallelTerminationStrategy: PID 19444 died... 21:48:18.198643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19444): Terminated: ok {rc=0} 21:48:18.245009 --- ParallelTerminationStrategy: PID 19447 died... 21:48:18.265003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19447): Terminated: ok {rc=0} 21:48:18.311528 --- ParallelTerminationStrategy: PID 19450 died... 21:48:18.331311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19450): Terminated: ok {rc=0} 21:48:18.419512 bus /sierra_3: Setting Powered False 21:48:19.519552 bus /sierra_3: Setting Powered False 21:48:20.632607 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 21:48:21.869857 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:48:21.875958 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 21:48:21.896718 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 21:48:21.923917 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 21:48:21.974753 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 21:48:21.995029 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 21:48:22.021476 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 21:48:22.575424 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 21:48:22.629184 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:22.640375 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:48:22.701120 tst mo_mt_call.py: using LAC 23879 21:48:22.827892 tst mo_mt_call.py: using RAC 164 21:48:22.953184 tst mo_mt_call.py: using CellId 23879 21:48:23.078229 tst mo_mt_call.py: using BVCI 23880 21:48:23.196594 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:23.207989 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:23.219145 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:23.230839 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:23.242473 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:23.254122 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:48:23.371572 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:48:23.491277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:23.993470 run create_hlr_db(pid=19456): Launched 21:48:24.126449 bus /sierra_2: Setting Powered False 21:48:25.190452 run create_hlr_db(pid=19456): Terminated: ok {rc=0} 21:48:25.624471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19458): Launched 21:48:25.927360 run osmo-hlr_10.42.42.2(pid=19459): Launched 21:48:26.043466 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:26.567939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19461): Launched 21:48:26.870421 run osmo-stp_10.42.42.5(pid=19462): Launched 21:48:26.985547 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:27.531265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19464): Launched 21:48:27.833431 run osmo-msc_10.42.42.6(pid=19465): Launched 21:48:28.004254 run osmo-stp_10.42.42.5(pid=19462): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19462)] 21:48:28.134684 run osmo-stp_10.42.42.5(pid=19462): stdout: | (launched: 2022-12-09_21:48:26.814921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:28.264922 run osmo-stp_10.42.42.5(pid=19462): stderr: | 20221209214826986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214826986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214826987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214826987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214826987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214826988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214826988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:28.392617 run osmo-stp_10.42.42.5(pid=19462): stdout: | (launched: 2022-12-09_21:48:26.814921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:28.514224 run osmo-stp_10.42.42.5(pid=19462): stderr: | 20221209214826986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214826986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214826987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214826987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214826987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214826988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214826988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:28.659468 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19462): Process ended prematurely: osmo-stp_10.42.42.5(pid=19462) [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19462)] [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 21:48:28.668334 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 21:48:28.694810 run osmo-hlr_10.42.42.2(pid=19459): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19459)] 21:48:28.742827 run osmo-hlr_10.42.42.2(pid=19459): stdout: | (launched: 2022-12-09_21:48:25.871834) 21:48:28.792216 run osmo-hlr_10.42.42.2(pid=19459): stderr: | 20221209214826048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214826048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214826048 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214826048 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214826048 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214826048 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214826060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214826068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214826068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214826069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:28.861066 run osmo-msc_10.42.42.6(pid=19465): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19465)] 21:48:28.908798 run osmo-msc_10.42.42.6(pid=19465): stdout: | (launched: 2022-12-09_21:48:27.777665) 21:48:28.958148 run osmo-msc_10.42.42.6(pid=19465): stderr: | 20221209214828052 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214828052 DLGLOBAL DEBUG validating counter group 0x7f52bb243c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214828052 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214828052 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214828052 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214828052 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214828054 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214828055 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214828055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214828055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:29.008037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19458): Terminating (SIGTERM) 21:48:29.047779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19461): Terminating (SIGTERM) 21:48:29.087720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19464): Terminating (SIGTERM) 21:48:29.127922 --- ParallelTerminationStrategy: PID 19458 died... 21:48:29.146892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19458): Terminated: ok {rc=0} 21:48:29.191419 --- ParallelTerminationStrategy: PID 19461 died... 21:48:29.209997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19461): Terminated: ok {rc=0} 21:48:29.254142 --- ParallelTerminationStrategy: PID 19464 died... 21:48:29.272617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19464): Terminated: ok {rc=0} 21:48:29.356721 bus /sierra_3: Setting Powered False 21:48:30.454420 bus /sierra_3: Setting Powered False 21:48:31.573723 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 21:48:32.726563 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:32.738050 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:48:32.794287 tst mo_mt_call_osmux.py: using LAC 23880 21:48:32.911571 tst mo_mt_call_osmux.py: using RAC 165 21:48:33.034682 tst mo_mt_call_osmux.py: using CellId 23880 21:48:33.173076 tst mo_mt_call_osmux.py: using BVCI 23881 21:48:33.292612 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:33.304138 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:33.315703 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:33.327060 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:33.338573 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:33.349835 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:48:33.465329 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:48:33.581349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:34.051328 run create_hlr_db(pid=19467): Launched 21:48:34.184364 bus /sierra_2: Setting Powered False 21:48:35.248911 run create_hlr_db(pid=19467): Terminated: ok {rc=0} 21:48:35.699234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19469): Launched 21:48:36.023440 run osmo-hlr_10.42.42.2(pid=19470): Launched 21:48:36.146349 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:36.707047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19472): Launched 21:48:37.031261 run osmo-stp_10.42.42.5(pid=19473): Launched 21:48:37.154755 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:37.739410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19475): Launched 21:48:38.063860 run osmo-msc_10.42.42.6(pid=19476): Launched 21:48:38.244521 run osmo-stp_10.42.42.5(pid=19473): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19473)] 21:48:38.380420 run osmo-stp_10.42.42.5(pid=19473): stdout: | (launched: 2022-12-09_21:48:36.972150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:38.517104 run osmo-stp_10.42.42.5(pid=19473): stderr: | 20221209214837165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214837165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214837165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214837166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214837166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214837166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214837166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:38.653149 run osmo-stp_10.42.42.5(pid=19473): stdout: | (launched: 2022-12-09_21:48:36.972150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:38.781470 run osmo-stp_10.42.42.5(pid=19473): stderr: | 20221209214837165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214837165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214837165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214837166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214837166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214837166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214837166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:38.935493 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19473): Process ended prematurely: osmo-stp_10.42.42.5(pid=19473) [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19473)] [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 21:48:38.945144 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:48:38.972898 run osmo-hlr_10.42.42.2(pid=19470): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19470)] 21:48:39.022960 run osmo-hlr_10.42.42.2(pid=19470): stdout: | (launched: 2022-12-09_21:48:35.964524) 21:48:39.074950 run osmo-hlr_10.42.42.2(pid=19470): stderr: | 20221209214836164 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214836164 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214836164 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214836164 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214836164 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214836164 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214836177 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214836186 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214836186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214836186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:39.147167 run osmo-msc_10.42.42.6(pid=19476): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19476)] 21:48:39.197742 run osmo-msc_10.42.42.6(pid=19476): stdout: | (launched: 2022-12-09_21:48:38.004701) 21:48:39.249715 run osmo-msc_10.42.42.6(pid=19476): stderr: | 20221209214838327 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214838327 DLGLOBAL DEBUG validating counter group 0x7ff6576e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214838327 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214838327 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214838327 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214838327 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214838329 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214838329 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214838330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214838330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:39.301792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19469): Terminating (SIGTERM) 21:48:39.343463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19472): Terminating (SIGTERM) 21:48:39.385643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19475): Terminating (SIGTERM) 21:48:39.427468 --- ParallelTerminationStrategy: PID 19469 died... 21:48:39.447165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19469): Terminated: ok {rc=0} 21:48:39.493437 --- ParallelTerminationStrategy: PID 19472 died... 21:48:39.513068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19472): Terminated: ok {rc=0} 21:48:39.558973 --- ParallelTerminationStrategy: PID 19475 died... 21:48:39.578547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19475): Terminated: ok {rc=0} 21:48:39.665261 bus /sierra_3: Setting Powered False 21:48:40.764932 bus /sierra_3: Setting Powered False 21:48:41.880600 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 21:48:43.116254 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:48:43.123095 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 21:48:43.144390 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 21:48:43.171407 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 21:48:43.223896 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 21:48:43.244899 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 21:48:43.272190 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 21:48:43.824006 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 21:48:43.875328 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:43.886853 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:48:43.944627 tst mo_mt_call.py: using LAC 23881 21:48:44.073602 tst mo_mt_call.py: using RAC 166 21:48:44.199703 tst mo_mt_call.py: using CellId 23881 21:48:44.330096 tst mo_mt_call.py: using BVCI 23882 21:48:44.449479 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:44.460858 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:44.472032 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:44.483204 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:44.494520 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:44.505758 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:48:44.620025 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:48:44.740169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:45.242699 run create_hlr_db(pid=19481): Launched 21:48:45.373992 bus /sierra_2: Setting Powered False 21:48:46.437718 run create_hlr_db(pid=19481): Terminated: ok {rc=0} 21:48:46.895744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19483): Launched 21:48:47.233778 run osmo-hlr_10.42.42.2(pid=19484): Launched 21:48:47.358052 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:47.919099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19486): Launched 21:48:48.243193 run osmo-stp_10.42.42.5(pid=19487): Launched 21:48:48.366792 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:48.952537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19489): Launched 21:48:49.276339 run osmo-msc_10.42.42.6(pid=19490): Launched 21:48:49.456410 run osmo-stp_10.42.42.5(pid=19487): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19487)] 21:48:49.592531 run osmo-stp_10.42.42.5(pid=19487): stdout: | (launched: 2022-12-09_21:48:48.184177) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:49.729207 run osmo-stp_10.42.42.5(pid=19487): stderr: | 20221209214848376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214848376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214848376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214848377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214848379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214848379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214848379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:49.865509 run osmo-stp_10.42.42.5(pid=19487): stdout: | (launched: 2022-12-09_21:48:48.184177) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:49.994159 run osmo-stp_10.42.42.5(pid=19487): stderr: | 20221209214848376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214848376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214848376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214848377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214848379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214848379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214848379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:50.148469 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19487): Process ended prematurely: osmo-stp_10.42.42.5(pid=19487) [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19487)] [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 21:48:50.157887 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:48:50.185478 run osmo-hlr_10.42.42.2(pid=19484): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19484)] 21:48:50.235777 run osmo-hlr_10.42.42.2(pid=19484): stdout: | (launched: 2022-12-09_21:48:47.174406) 21:48:50.287559 run osmo-hlr_10.42.42.2(pid=19484): stderr: | 20221209214847373 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214847373 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214847373 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214847373 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214847373 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214847373 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214847385 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214847394 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214847394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214847394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:50.359843 run osmo-msc_10.42.42.6(pid=19490): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19490)] 21:48:50.410170 run osmo-msc_10.42.42.6(pid=19490): stdout: | (launched: 2022-12-09_21:48:49.217349) 21:48:50.462050 run osmo-msc_10.42.42.6(pid=19490): stderr: | 20221209214849542 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214849542 DLGLOBAL DEBUG validating counter group 0x7fc835fc2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214849542 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214849542 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214849542 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214849543 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214849544 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214849545 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214849545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214849545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:50.514191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19483): Terminating (SIGTERM) 21:48:50.555797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19486): Terminating (SIGTERM) 21:48:50.597520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19489): Terminating (SIGTERM) 21:48:50.639370 --- ParallelTerminationStrategy: PID 19483 died... 21:48:50.659235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19483): Terminated: ok {rc=0} 21:48:50.705465 --- ParallelTerminationStrategy: PID 19486 died... 21:48:50.724787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19486): Terminated: ok {rc=0} 21:48:50.771038 --- ParallelTerminationStrategy: PID 19489 died... 21:48:50.790995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19489): Terminated: ok {rc=0} 21:48:50.878959 bus /sierra_3: Setting Powered False 21:48:51.979423 bus /sierra_3: Setting Powered False 21:48:53.095694 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 21:48:54.244892 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:54.256928 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:48:54.314982 tst mo_mt_call_osmux.py: using LAC 23882 21:48:54.445096 tst mo_mt_call_osmux.py: using RAC 167 21:48:54.572415 tst mo_mt_call_osmux.py: using CellId 23882 21:48:54.699659 tst mo_mt_call_osmux.py: using BVCI 23883 21:48:54.816925 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:54.828423 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:54.839624 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:54.850854 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:54.862113 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:54.873398 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:48:54.988503 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:48:55.112575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:55.614029 run create_hlr_db(pid=19492): Launched 21:48:55.745183 bus /sierra_2: Setting Powered False 21:48:56.809607 run create_hlr_db(pid=19492): Terminated: ok {rc=0} 21:48:57.240613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19494): Launched 21:48:57.543436 run osmo-hlr_10.42.42.2(pid=19495): Launched 21:48:57.659549 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:58.179798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19497): Launched 21:48:58.483556 run osmo-stp_10.42.42.5(pid=19498): Launched 21:48:58.600262 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:59.146566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19500): Launched 21:48:59.449138 run osmo-msc_10.42.42.6(pid=19501): Launched 21:48:59.632371 run osmo-stp_10.42.42.5(pid=19498): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19498)] 21:48:59.770515 run osmo-stp_10.42.42.5(pid=19498): stdout: | (launched: 2022-12-09_21:48:58.428372) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:59.910047 run osmo-stp_10.42.42.5(pid=19498): stderr: | 20221209214858597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214858597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214858598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214858598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214858598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214858598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214858599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:00.045763 run osmo-stp_10.42.42.5(pid=19498): stdout: | (launched: 2022-12-09_21:48:58.428372) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:00.174997 run osmo-stp_10.42.42.5(pid=19498): stderr: | 20221209214858597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214858597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214858598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214858598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214858598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214858598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214858599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:00.329290 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19498): Process ended prematurely: osmo-stp_10.42.42.5(pid=19498) [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19498)] [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 21:49:00.339147 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 21:49:00.366759 run osmo-hlr_10.42.42.2(pid=19495): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19495)] 21:49:00.417768 run osmo-hlr_10.42.42.2(pid=19495): stdout: | (launched: 2022-12-09_21:48:57.487983) 21:49:00.469703 run osmo-hlr_10.42.42.2(pid=19495): stderr: | 20221209214857667 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214857667 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214857667 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214857667 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214857667 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214857668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214857680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214857688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214857689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214857689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:00.541650 run osmo-msc_10.42.42.6(pid=19501): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19501)] 21:49:00.591580 run osmo-msc_10.42.42.6(pid=19501): stdout: | (launched: 2022-12-09_21:48:59.393346) 21:49:00.643306 run osmo-msc_10.42.42.6(pid=19501): stderr: | 20221209214859708 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214859708 DLGLOBAL DEBUG validating counter group 0x7fe306f95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214859708 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214859708 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214859709 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214859709 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214859710 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214859711 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214859711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214859711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:00.695276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19494): Terminating (SIGTERM) 21:49:00.736766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19497): Terminating (SIGTERM) 21:49:00.778557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19500): Terminating (SIGTERM) 21:49:00.820525 --- ParallelTerminationStrategy: PID 19494 died... 21:49:00.840474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19494): Terminated: ok {rc=0} 21:49:00.895369 --- ParallelTerminationStrategy: PID 19497 died... 21:49:00.915828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19497): Terminated: ok {rc=0} 21:49:00.962937 --- ParallelTerminationStrategy: PID 19500 died... 21:49:00.982949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19500): Terminated: ok {rc=0} 21:49:01.078790 bus /sierra_3: Setting Powered False 21:49:02.182034 bus /sierra_3: Setting Powered False 21:49:03.295450 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:49:04.531696 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:49:04.539242 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:49:04.560640 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 21:49:04.587291 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:49:04.636247 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:49:04.656784 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 21:49:04.683158 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:49:05.236032 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 21:49:05.284732 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:05.295671 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:49:05.350183 tst mo_mt_call.py: using LAC 23883 21:49:05.469114 tst mo_mt_call.py: using RAC 168 21:49:05.587618 tst mo_mt_call.py: using CellId 23883 21:49:05.703872 tst mo_mt_call.py: using BVCI 23884 21:49:05.813416 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:05.824209 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:05.834917 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:05.845969 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:05.856857 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:05.867957 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:49:05.987139 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:49:06.103633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:06.609127 run create_hlr_db(pid=19506): Launched 21:49:06.742198 bus /sierra_2: Setting Powered False 21:49:07.806987 run create_hlr_db(pid=19506): Terminated: ok {rc=0} 21:49:08.242475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19508): Launched 21:49:08.547240 run osmo-hlr_10.42.42.2(pid=19509): Launched 21:49:08.663255 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:09.188908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19511): Launched 21:49:09.492935 run osmo-stp_10.42.42.5(pid=19512): Launched 21:49:09.609588 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:10.156751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19514): Launched 21:49:10.484104 run osmo-msc_10.42.42.6(pid=19515): Launched 21:49:10.666020 run osmo-stp_10.42.42.5(pid=19512): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19512)] 21:49:10.802544 run osmo-stp_10.42.42.5(pid=19512): stdout: | (launched: 2022-12-09_21:49:09.437243) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:10.939588 run osmo-stp_10.42.42.5(pid=19512): stderr: | 20221209214909606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214909606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214909606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214909607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214909609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214909609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214909609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:11.076118 run osmo-stp_10.42.42.5(pid=19512): stdout: | (launched: 2022-12-09_21:49:09.437243) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:11.205095 run osmo-stp_10.42.42.5(pid=19512): stderr: | 20221209214909606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214909606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214909606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214909607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214909609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214909609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214909609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:11.359582 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19512): Process ended prematurely: osmo-stp_10.42.42.5(pid=19512) [trial-2365↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19512)] [trial-2365↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 21:49:11.369193 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 21:49:11.397191 run osmo-hlr_10.42.42.2(pid=19509): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19509)] 21:49:11.447358 run osmo-hlr_10.42.42.2(pid=19509): stdout: | (launched: 2022-12-09_21:49:08.491732) 21:49:11.499381 run osmo-hlr_10.42.42.2(pid=19509): stderr: | 20221209214908667 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214908668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214908668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214908668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214908668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214908668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214908679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214908688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214908689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214908689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:11.571458 run osmo-msc_10.42.42.6(pid=19515): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19515)] 21:49:11.621339 run osmo-msc_10.42.42.6(pid=19515): stdout: | (launched: 2022-12-09_21:49:10.424706) 21:49:11.673125 run osmo-msc_10.42.42.6(pid=19515): stderr: | 20221209214910749 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214910750 DLGLOBAL DEBUG validating counter group 0x7fd9aa10ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214910750 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214910750 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214910750 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214910750 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214910752 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214910752 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214910752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214910752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:11.724649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19508): Terminating (SIGTERM) 21:49:11.766591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19511): Terminating (SIGTERM) 21:49:11.808245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19514): Terminating (SIGTERM) 21:49:11.850266 --- ParallelTerminationStrategy: PID 19508 died... 21:49:11.870127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19508): Terminated: ok {rc=0} 21:49:11.919345 --- ParallelTerminationStrategy: PID 19511 died... 21:49:11.939503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19511): Terminated: ok {rc=0} 21:49:11.986543 --- ParallelTerminationStrategy: PID 19514 died... 21:49:12.006045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19514): Terminated: ok {rc=0} 21:49:12.093799 bus /sierra_3: Setting Powered False 21:49:13.191964 bus /sierra_3: Setting Powered False 21:49:14.307567 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 21:49:15.456231 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:15.468361 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:49:15.526707 tst mo_mt_call_osmux.py: using LAC 23884 21:49:15.647893 tst mo_mt_call_osmux.py: using RAC 169 21:49:15.770271 tst mo_mt_call_osmux.py: using CellId 23884 21:49:15.905165 tst mo_mt_call_osmux.py: using BVCI 23885 21:49:16.026003 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:16.038068 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:16.052123 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:16.063979 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:16.077132 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:16.090011 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:49:16.223106 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:49:16.341181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:16.828674 run create_hlr_db(pid=19517): Launched 21:49:16.979554 bus /sierra_2: Setting Powered False 21:49:18.039276 run create_hlr_db(pid=19517): Terminated: ok {rc=0} 21:49:18.462350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19519): Launched 21:49:18.765579 run osmo-hlr_10.42.42.2(pid=19520): Launched 21:49:18.882992 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:19.414613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19522): Launched 21:49:19.717075 run osmo-stp_10.42.42.5(pid=19523): Launched 21:49:19.833109 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:20.378979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19525): Launched 21:49:20.682574 run osmo-msc_10.42.42.6(pid=19526): Launched 21:49:20.851340 run osmo-stp_10.42.42.5(pid=19523): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19523)] 21:49:20.979416 run osmo-stp_10.42.42.5(pid=19523): stdout: | (launched: 2022-12-09_21:49:19.661672) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:21.108169 run osmo-stp_10.42.42.5(pid=19523): stderr: | 20221209214919828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214919828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214919829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214919829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214919831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214919831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214919831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:21.234739 run osmo-stp_10.42.42.5(pid=19523): stdout: | (launched: 2022-12-09_21:49:19.661672) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:21.354886 run osmo-stp_10.42.42.5(pid=19523): stderr: | 20221209214919828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214919828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214919829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214919829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214919831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214919831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214919831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:21.498680 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19523): Process ended prematurely: osmo-stp_10.42.42.5(pid=19523) [trial-2365↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19523)] [trial-2365↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:49:21.507334 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 21:49:21.533931 run osmo-hlr_10.42.42.2(pid=19520): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19520)] 21:49:21.581932 run osmo-hlr_10.42.42.2(pid=19520): stdout: | (launched: 2022-12-09_21:49:18.709921) 21:49:21.631272 run osmo-hlr_10.42.42.2(pid=19520): stderr: | 20221209214918885 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214918886 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214918886 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214918886 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214918886 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214918886 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214918897 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214918906 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214918906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214918906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:21.699929 run osmo-msc_10.42.42.6(pid=19526): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19526)] 21:49:21.747336 run osmo-msc_10.42.42.6(pid=19526): stdout: | (launched: 2022-12-09_21:49:20.627176) 21:49:21.797067 run osmo-msc_10.42.42.6(pid=19526): stderr: | 20221209214920900 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214920900 DLGLOBAL DEBUG validating counter group 0x7f620ca2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214920900 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214920900 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214920901 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214920901 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214920903 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214920903 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214920904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214920904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:21.846669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19519): Terminating (SIGTERM) 21:49:21.885879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19522): Terminating (SIGTERM) 21:49:21.925448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19525): Terminating (SIGTERM) 21:49:21.965159 --- ParallelTerminationStrategy: PID 19519 died... 21:49:21.983995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19519): Terminated: ok {rc=0} 21:49:22.028201 --- ParallelTerminationStrategy: PID 19522 died... 21:49:22.046575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19522): Terminated: ok {rc=0} 21:49:22.091056 --- ParallelTerminationStrategy: PID 19525 died... 21:49:22.109327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19525): Terminated: ok {rc=0} 21:49:22.192395 bus /sierra_3: Setting Powered False 21:49:23.291354 bus /sierra_3: Setting Powered False 21:49:24.406591 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:49:25.634407 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:49:25.639779 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:49:25.660793 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 21:49:25.687674 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 21:49:25.740372 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:49:25.761532 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 21:49:25.787828 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 21:49:26.334007 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 21:49:26.382496 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:26.393169 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:49:26.449733 tst mo_mt_call.py: using LAC 23885 21:49:26.569383 tst mo_mt_call.py: using RAC 170 21:49:26.690631 tst mo_mt_call.py: using CellId 23885 21:49:26.808784 tst mo_mt_call.py: using BVCI 23886 21:49:26.918049 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:26.928805 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:26.939285 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:26.950056 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:26.960830 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:26.971677 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:49:27.090827 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:49:27.208154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:27.677248 run create_hlr_db(pid=19531): Launched 21:49:27.792326 bus /sierra_2: Setting Powered False 21:49:28.852775 run create_hlr_db(pid=19531): Terminated: ok {rc=0} 21:49:29.296176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19533): Launched 21:49:29.621209 run osmo-hlr_10.42.42.2(pid=19534): Launched 21:49:29.744528 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:30.301322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19536): Launched 21:49:30.626437 run osmo-stp_10.42.42.5(pid=19537): Launched 21:49:30.750226 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:31.413814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19539): Launched 21:49:31.733305 run osmo-msc_10.42.42.6(pid=19540): Launched 21:49:32.073218 run osmo-stp_10.42.42.5(pid=19537): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19537)] 21:49:32.365380 run osmo-stp_10.42.42.5(pid=19537): stdout: | (launched: 2022-12-09_21:49:30.567268) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:32.520151 run osmo-stp_10.42.42.5(pid=19537): stderr: | 20221209214930760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214930760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214930760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214930761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214930761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214930761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214930761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:32.656523 run osmo-stp_10.42.42.5(pid=19537): stdout: | (launched: 2022-12-09_21:49:30.567268) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:32.786431 run osmo-stp_10.42.42.5(pid=19537): stderr: | 20221209214930760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214930760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214930760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214930761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214930761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214930761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214930761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:32.941510 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19537): Process ended prematurely: osmo-stp_10.42.42.5(pid=19537) [trial-2365↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19537)] [trial-2365↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 21:49:32.951109 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 21:49:32.978877 run osmo-hlr_10.42.42.2(pid=19534): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19534)] 21:49:33.029414 run osmo-hlr_10.42.42.2(pid=19534): stdout: | (launched: 2022-12-09_21:49:29.561891) 21:49:33.081567 run osmo-hlr_10.42.42.2(pid=19534): stderr: | 20221209214929761 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214929761 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214929761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214929761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214929761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214929761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214929772 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214929781 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214929781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214929781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:33.154115 run osmo-msc_10.42.42.6(pid=19540): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19540)] 21:49:33.204196 run osmo-msc_10.42.42.6(pid=19540): stdout: | (launched: 2022-12-09_21:49:31.674938) 21:49:33.256089 run osmo-msc_10.42.42.6(pid=19540): stderr: | 20221209214932222 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214932222 DLGLOBAL DEBUG validating counter group 0x7ff0b3153c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214932222 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214932222 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214932223 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214932223 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214932224 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214932226 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214932226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214932226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:33.307959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19533): Terminating (SIGTERM) 21:49:33.349689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19536): Terminating (SIGTERM) 21:49:33.391513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19539): Terminating (SIGTERM) 21:49:33.434035 --- ParallelTerminationStrategy: PID 19533 died... 21:49:33.454236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19533): Terminated: ok {rc=0} 21:49:33.500652 --- ParallelTerminationStrategy: PID 19536 died... 21:49:33.520283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19536): Terminated: ok {rc=0} 21:49:33.566424 --- ParallelTerminationStrategy: PID 19539 died... 21:49:33.586086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19539): Terminated: ok {rc=0} 21:49:33.673344 bus /sierra_3: Setting Powered False 21:49:34.772671 bus /sierra_3: Setting Powered False 21:49:35.889124 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 21:49:37.037220 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:37.049095 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:49:37.107779 tst mo_mt_call_osmux.py: using LAC 23886 21:49:37.233407 tst mo_mt_call_osmux.py: using RAC 171 21:49:37.360803 tst mo_mt_call_osmux.py: using CellId 23886 21:49:37.491503 tst mo_mt_call_osmux.py: using BVCI 23887 21:49:37.610022 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:37.621327 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:37.632265 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:37.643284 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:37.654308 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:37.665439 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:49:37.785567 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:49:37.901038 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:38.369194 run create_hlr_db(pid=19542): Launched 21:49:38.484762 bus /sierra_2: Setting Powered False 21:49:39.545229 run create_hlr_db(pid=19542): Terminated: ok {rc=0} 21:49:39.987770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19544): Launched 21:49:40.311472 run osmo-hlr_10.42.42.2(pid=19545): Launched 21:49:40.435495 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:40.992213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19547): Launched 21:49:41.315823 run osmo-stp_10.42.42.5(pid=19548): Launched 21:49:41.439435 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:42.024379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19550): Launched 21:49:42.346688 run osmo-msc_10.42.42.6(pid=19551): Launched 21:49:42.527272 run osmo-stp_10.42.42.5(pid=19548): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19548)] 21:49:42.663498 run osmo-stp_10.42.42.5(pid=19548): stdout: | (launched: 2022-12-09_21:49:41.256575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:42.801144 run osmo-stp_10.42.42.5(pid=19548): stderr: | 20221209214941453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214941453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214941453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214941453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214941454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214941454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214941454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:42.936513 run osmo-stp_10.42.42.5(pid=19548): stdout: | (launched: 2022-12-09_21:49:41.256575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:43.064734 run osmo-stp_10.42.42.5(pid=19548): stderr: | 20221209214941453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214941453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214941453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214941453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214941454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214941454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214941454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:43.218413 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19548): Process ended prematurely: osmo-stp_10.42.42.5(pid=19548) [trial-2365↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19548)] [trial-2365↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 21:49:43.227710 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 21:49:43.255071 run osmo-hlr_10.42.42.2(pid=19545): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19545)] 21:49:43.305477 run osmo-hlr_10.42.42.2(pid=19545): stdout: | (launched: 2022-12-09_21:49:40.252345) 21:49:43.357815 run osmo-hlr_10.42.42.2(pid=19545): stderr: | 20221209214940452 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214940452 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214940452 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214940452 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214940452 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214940452 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214940493 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214940502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214940503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214940503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:43.430177 run osmo-msc_10.42.42.6(pid=19551): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19551)] 21:49:43.480183 run osmo-msc_10.42.42.6(pid=19551): stdout: | (launched: 2022-12-09_21:49:42.287582) 21:49:43.531652 run osmo-msc_10.42.42.6(pid=19551): stderr: | 20221209214942611 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214942611 DLGLOBAL DEBUG validating counter group 0x7fc8cbd93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214942611 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214942611 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214942611 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214942611 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214942613 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214942613 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214942614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214942614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:43.583590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19544): Terminating (SIGTERM) 21:49:43.624991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19547): Terminating (SIGTERM) 21:49:43.666278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19550): Terminating (SIGTERM) 21:49:43.707881 --- ParallelTerminationStrategy: PID 19544 died... 21:49:43.727690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19544): Terminated: ok {rc=0} 21:49:43.773589 --- ParallelTerminationStrategy: PID 19547 died... 21:49:43.792816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19547): Terminated: ok {rc=0} 21:49:43.838572 --- ParallelTerminationStrategy: PID 19550 died... 21:49:43.857941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19550): Terminated: ok {rc=0} 21:49:43.945608 bus /sierra_3: Setting Powered False 21:49:45.044251 bus /sierra_3: Setting Powered False 21:49:46.167370 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 emergency:sysmo --------------------------------------------------------------------- 21:49:47.416940 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:49:47.421405 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 21:49:47.442871 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 21:49:47.470076 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 21:49:47.555749 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 21:49:47.576880 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 21:49:47.603874 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 21:49:48.185594 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2365 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 21:49:48.190808 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:48.201744 tst emergency:sysmo: Using 1 x bts (candidates: 1) 21:49:48.238680 tst emergency_mo_mt_call.py: using LAC 23887 21:49:48.357363 tst emergency_mo_mt_call.py: using RAC 172 21:49:48.474817 tst emergency_mo_mt_call.py: using CellId 23887 21:49:48.593602 tst emergency_mo_mt_call.py: using BVCI 23888 21:49:48.711470 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:48.722388 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:48.733390 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:48.744237 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:48.755205 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:48.766190 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:49:48.880500 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:49:48.998559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:49.494689 run create_hlr_db(pid=19557): Launched 21:49:49.623459 bus /sierra_2: Setting Powered False 21:49:50.686860 run create_hlr_db(pid=19557): Terminated: ok {rc=0} 21:49:51.132130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19559): Launched 21:49:51.451954 run osmo-hlr_10.42.42.2(pid=19560): Launched 21:49:51.574195 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:52.122106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19562): Launched 21:49:52.441304 run osmo-stp_10.42.42.5(pid=19563): Launched 21:49:52.571090 tst emergency_mo_mt_call.py: using MSISDN 7397 21:49:52.735808 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:53.312760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19565): Launched 21:49:53.630830 run osmo-msc_10.42.42.6(pid=19566): Launched 21:49:53.808119 run osmo-stp_10.42.42.5(pid=19563): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19563)] 21:49:53.942274 run osmo-stp_10.42.42.5(pid=19563): stdout: | (launched: 2022-12-09_21:49:52.382633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:54.077233 run osmo-stp_10.42.42.5(pid=19563): stderr: | 20221209214952577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214952577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214952577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214952578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214952578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214952579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214952579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:54.211306 run osmo-stp_10.42.42.5(pid=19563): stdout: | (launched: 2022-12-09_21:49:52.382633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:54.338269 run osmo-stp_10.42.42.5(pid=19563): stderr: | 20221209214952577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209214952577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209214952577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209214952578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209214952578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209214952579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209214952579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:54.490199 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=19563): Process ended prematurely: osmo-stp_10.42.42.5(pid=19563) [trial-2365↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19563)] [trial-2365↪emergency:sysmo↪emergency_mo_mt_call.py:19] 21:49:54.499224 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 21:49:54.526558 run osmo-hlr_10.42.42.2(pid=19560): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19560)] 21:49:54.576814 run osmo-hlr_10.42.42.2(pid=19560): stdout: | (launched: 2022-12-09_21:49:51.392639) 21:49:54.628664 run osmo-hlr_10.42.42.2(pid=19560): stderr: | 20221209214951593 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209214951593 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209214951593 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209214951593 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209214951593 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209214951593 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209214951608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209214951618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209214951618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209214951618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:54.700769 run osmo-msc_10.42.42.6(pid=19566): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19566)] 21:49:54.750592 run osmo-msc_10.42.42.6(pid=19566): stdout: | (launched: 2022-12-09_21:49:53.572574) 21:49:54.802152 run osmo-msc_10.42.42.6(pid=19566): stderr: | 20221209214953895 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209214953895 DLGLOBAL DEBUG validating counter group 0x7fd6ba7ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209214953895 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209214953895 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209214953895 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209214953896 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209214953897 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209214953898 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209214953898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209214953898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:54.854577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19559): Terminating (SIGTERM) 21:49:54.896300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19562): Terminating (SIGTERM) 21:49:54.938192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19565): Terminating (SIGTERM) 21:49:54.980132 --- ParallelTerminationStrategy: PID 19559 died... 21:49:55.000245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19559): Terminated: ok {rc=0} 21:49:55.046649 --- ParallelTerminationStrategy: PID 19562 died... 21:49:55.066683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19562): Terminated: ok {rc=0} 21:49:55.113137 --- ParallelTerminationStrategy: PID 19565 died... 21:49:55.132655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19565): Terminated: ok {rc=0} 21:49:55.220675 bus /sierra_3: Setting Powered False 21:49:56.320289 bus /sierra_3: Setting Powered False 21:49:57.436645 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 21:49:58.523979 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:58.536094 tst emergency:sysmo: Using 1 x bts (candidates: 1) 21:49:58.574205 tst emergency_preemptive_call.py: using LAC 23888 21:49:58.694120 tst emergency_preemptive_call.py: using RAC 173 21:49:58.812061 tst emergency_preemptive_call.py: using CellId 23888 21:49:58.928777 tst emergency_preemptive_call.py: using BVCI 23889 21:49:59.036612 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:59.047353 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:59.057998 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:59.069256 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:59.080224 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:59.091198 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:49:59.211476 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:49:59.329222 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:49:59.446200 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:49:59.562989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:00.025329 run create_hlr_db(pid=19568): Launched 21:50:00.138909 bus /sierra_2: Setting Powered False 21:50:01.198119 run create_hlr_db(pid=19568): Terminated: ok {rc=0} 21:50:01.651540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19573): Launched 21:50:02.001449 run osmo-hlr_10.42.42.2(pid=19574): Launched 21:50:02.187478 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:02.768487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19576): Launched 21:50:03.088294 run osmo-stp_10.42.42.5(pid=19577): Launched 21:50:03.218842 tst emergency_preemptive_call.py: using MSISDN 7398 21:50:03.382563 run osmo-msc_10.42.42.6: Starting osmo-msc 21:50:03.954933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19579): Launched 21:50:04.273839 run osmo-msc_10.42.42.6(pid=19580): Launched 21:50:04.457930 run osmo-stp_10.42.42.5(pid=19577): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19577)] 21:50:04.591581 run osmo-stp_10.42.42.5(pid=19577): stdout: | (launched: 2022-12-09_21:50:03.029972) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:04.726022 run osmo-stp_10.42.42.5(pid=19577): stderr: | 20221209215003222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215003222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215003222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215003223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215003223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215003223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215003223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:04.860194 run osmo-stp_10.42.42.5(pid=19577): stdout: | (launched: 2022-12-09_21:50:03.029972) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:04.987609 run osmo-stp_10.42.42.5(pid=19577): stderr: | 20221209215003222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215003222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215003222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215003223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215003223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215003223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215003223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:05.139436 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=19577): Process ended prematurely: osmo-stp_10.42.42.5(pid=19577) [trial-2365↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19577)] [trial-2365↪emergency:sysmo↪emergency_preemptive_call.py:32] 21:50:05.148282 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 21:50:05.175588 run osmo-hlr_10.42.42.2(pid=19574): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19574)] 21:50:05.225655 run osmo-hlr_10.42.42.2(pid=19574): stdout: | (launched: 2022-12-09_21:50:01.937222) 21:50:05.277363 run osmo-hlr_10.42.42.2(pid=19574): stderr: | 20221209215002265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215002265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215002265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215002265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215002265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215002265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215002278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215002286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215002286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215002286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:05.349174 run osmo-msc_10.42.42.6(pid=19580): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19580)] 21:50:05.398703 run osmo-msc_10.42.42.6(pid=19580): stdout: | (launched: 2022-12-09_21:50:04.215570) 21:50:05.451095 run osmo-msc_10.42.42.6(pid=19580): stderr: | 20221209215004538 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215004538 DLGLOBAL DEBUG validating counter group 0x7f7c731fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215004538 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215004538 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215004538 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215004538 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215004540 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215004540 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215004541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215004541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:50:05.503108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19573): Terminating (SIGTERM) 21:50:05.544585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19576): Terminating (SIGTERM) 21:50:05.586207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19579): Terminating (SIGTERM) 21:50:05.628022 --- ParallelTerminationStrategy: PID 19573 died... 21:50:05.648080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19573): Terminated: ok {rc=0} 21:50:05.694732 --- ParallelTerminationStrategy: PID 19576 died... 21:50:05.714473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19576): Terminated: ok {rc=0} 21:50:05.760488 --- ParallelTerminationStrategy: PID 19579 died... 21:50:05.779914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19579): Terminated: ok {rc=0} 21:50:05.868574 bus /sierra_9: Setting Powered False 21:50:06.969464 bus /sierra_9: Setting Powered False 21:50:08.085698 bus /sierra_8: Setting Powered False 21:50:09.184471 bus /sierra_8: Setting Powered False 21:50:10.301877 bus /sierra_3: Setting Powered False 21:50:11.400385 bus /sierra_3: Setting Powered False 21:50:12.516482 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:sysmo --------------------------------------------------------------------- 21:50:13.773953 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:50:13.778417 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 21:50:13.799477 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 21:50:13.838507 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 21:50:13.926767 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 21:50:13.949380 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 21:50:13.988660 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 21:50:14.572141 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 21:50:14.624209 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:14.634681 tst gprs:sysmo: Using 1 x bts (candidates: 1) 21:50:14.669958 tst cs_paging_gprs_active.py: using LAC 23889 21:50:14.788735 tst cs_paging_gprs_active.py: using RAC 174 21:50:14.910624 tst cs_paging_gprs_active.py: using CellId 23889 21:50:15.029561 tst cs_paging_gprs_active.py: using BVCI 23890 21:50:15.138998 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:15.149412 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:15.159673 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:15.170258 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:15.180619 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:15.191162 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:15.201743 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:15.212293 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:15.223097 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:15.337832 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:15.452694 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:50:15.656752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:16.015039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19586): Launched 21:50:16.318034 run iperf3-srv_10.42.42.10(pid=19587): Launched 21:50:16.454035 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:50:16.680089 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:17.090668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19588): Launched 21:50:17.383517 run iperf3-srv_10.42.42.10(pid=19589): Launched 21:50:17.505676 tst cs_paging_gprs_active.py:38: start network... 21:50:17.724309 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:18.227544 run create_hlr_db(pid=19590): Launched 21:50:18.360563 bus /sierra_2: Setting Powered False 21:50:19.424806 run create_hlr_db(pid=19590): Terminated: ok {rc=0} 21:50:19.877994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19592): Launched 21:50:20.203370 run osmo-hlr_10.42.42.2(pid=19593): Launched 21:50:20.327143 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:20.885174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19595): Launched 21:50:21.210092 run osmo-stp_10.42.42.5(pid=19596): Launched 21:50:21.333390 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:50:22.890286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19598): Launched 21:50:23.015199 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:50:23.291174 run patchelf(pid=19599): Launched 21:50:23.474837 run osmo-stp_10.42.42.5(pid=19596): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19596)] 21:50:23.613292 run osmo-stp_10.42.42.5(pid=19596): stdout: | (launched: 2022-12-09_21:50:21.150776) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:23.752112 run osmo-stp_10.42.42.5(pid=19596): stderr: | 20221209215021344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215021344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215021345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215021345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215021346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215021346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215021346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:23.891452 run osmo-stp_10.42.42.5(pid=19596): stdout: | (launched: 2022-12-09_21:50:21.150776) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:24.024870 run osmo-stp_10.42.42.5(pid=19596): stderr: | 20221209215021344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215021344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215021345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215021345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215021346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215021346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215021346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:24.182868 run patchelf(pid=19599): Terminating (SIGINT) 21:50:24.366470 run patchelf(pid=19599): Terminated: ok {rc=0} 21:50:24.499358 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19596): Process ended prematurely: osmo-stp_10.42.42.5(pid=19596) [trial-2365↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19596)] [trial-2365↪gprs:sysmo↪cs_paging_gprs_active.py:38] 21:50:24.509227 tst cs_paging_gprs_active.py:38: Test FAILED (9.9 sec) 21:50:24.537348 run osmo-hlr_10.42.42.2(pid=19593): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19593)] 21:50:24.586902 run osmo-hlr_10.42.42.2(pid=19593): stdout: | (launched: 2022-12-09_21:50:20.144063) 21:50:24.638467 run osmo-hlr_10.42.42.2(pid=19593): stderr: | 20221209215020345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215020345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215020345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215020345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215020345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215020345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215020358 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215020366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215020366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215020366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:24.690625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19586): Terminating (SIGTERM) 21:50:24.732349 run iperf3-srv_10.42.42.10(pid=19587): Terminating (SIGTERM) 21:50:24.774172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19588): Terminating (SIGTERM) 21:50:24.815994 run iperf3-srv_10.42.42.10(pid=19589): Terminating (SIGTERM) 21:50:24.857661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19592): Terminating (SIGTERM) 21:50:24.899487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19595): Terminating (SIGTERM) 21:50:24.941195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19598): Terminating (SIGTERM) 21:50:24.983020 --- ParallelTerminationStrategy: PID 19586 died... 21:50:25.003063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19586): Terminated: ok {rc=0} 21:50:25.049244 --- ParallelTerminationStrategy: PID 19587 died... 21:50:25.068937 run iperf3-srv_10.42.42.10(pid=19587): Terminated {rc=256} 21:50:25.115326 --- ParallelTerminationStrategy: PID 19588 died... 21:50:25.135033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19588): Terminated: ok {rc=0} 21:50:25.181733 --- ParallelTerminationStrategy: PID 19589 died... 21:50:25.201552 run iperf3-srv_10.42.42.10(pid=19589): Terminated {rc=256} 21:50:25.247945 --- ParallelTerminationStrategy: PID 19592 died... 21:50:25.267541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19592): Terminated: ok {rc=0} 21:50:25.313381 --- ParallelTerminationStrategy: PID 19595 died... 21:50:25.333038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19595): Terminated: ok {rc=0} 21:50:25.379906 --- ParallelTerminationStrategy: PID 19598 died... 21:50:25.399601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19598): Terminated: ok {rc=0} 21:50:25.487009 bus /gobi_0: Setting Powered False 21:50:26.587185 bus /gobi_0: Setting Powered False 21:50:27.705940 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:sysmo iperf3.py ---------------------------------------------- 21:50:28.858521 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:28.870171 tst gprs:sysmo: Using 1 x bts (candidates: 1) 21:50:28.907237 tst iperf3.py: using LAC 23890 21:50:29.038520 tst iperf3.py: using RAC 175 21:50:29.169459 tst iperf3.py: using CellId 23890 21:50:29.299963 tst iperf3.py: using BVCI 23891 21:50:29.418553 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:29.429472 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:29.440547 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:29.451449 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:29.462268 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:29.472890 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:29.483830 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:29.494552 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:29.505385 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:29.621140 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:50:29.826538 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:30.131500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19600): Launched 21:50:30.395451 run iperf3-srv_10.42.42.10(pid=19601): Launched 21:50:30.509630 tst iperf3.py:8: start network... 21:50:30.712295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:31.267854 run create_hlr_db(pid=19602): Launched 21:50:31.426943 bus /gobi_6: Setting Powered False 21:50:32.491516 run create_hlr_db(pid=19602): Terminated: ok {rc=0} 21:50:32.928709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19604): Launched 21:50:33.232880 run osmo-hlr_10.42.42.2(pid=19605): Launched 21:50:33.348224 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:33.882294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19607): Launched 21:50:34.184429 run osmo-stp_10.42.42.5(pid=19608): Launched 21:50:34.300026 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:50:34.822471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19610): Launched 21:50:34.938605 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:50:35.196113 run patchelf(pid=19611): Launched 21:50:35.365180 run osmo-stp_10.42.42.5(pid=19608): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19608)] 21:50:35.494201 run osmo-stp_10.42.42.5(pid=19608): stdout: | (launched: 2022-12-09_21:50:34.128795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:35.624532 run osmo-stp_10.42.42.5(pid=19608): stderr: | 20221209215034302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215034302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215034303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215034303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215034304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215034304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215034304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:35.754993 run osmo-stp_10.42.42.5(pid=19608): stdout: | (launched: 2022-12-09_21:50:34.128795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:35.879005 run osmo-stp_10.42.42.5(pid=19608): stderr: | 20221209215034302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215034302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215034303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215034303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215034304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215034304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215034304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:36.026231 run patchelf(pid=19611): Terminating (SIGINT) 21:50:36.198684 run patchelf(pid=19611): Terminated: ok {rc=0} 21:50:36.322555 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19608): Process ended prematurely: osmo-stp_10.42.42.5(pid=19608) [trial-2365↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19608)] [trial-2365↪gprs:sysmo↪iperf3.py:8] 21:50:36.331930 tst iperf3.py:8: Test FAILED (7.5 sec) 21:50:36.358998 run osmo-hlr_10.42.42.2(pid=19605): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19605)] 21:50:36.406704 run osmo-hlr_10.42.42.2(pid=19605): stdout: | (launched: 2022-12-09_21:50:33.177132) 21:50:36.456189 run osmo-hlr_10.42.42.2(pid=19605): stderr: | 20221209215033356 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215033356 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215033356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215033356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215033356 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215033356 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215033368 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215033378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215033378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215033378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:36.505912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19600): Terminating (SIGTERM) 21:50:36.545693 run iperf3-srv_10.42.42.10(pid=19601): Terminating (SIGTERM) 21:50:36.585523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19604): Terminating (SIGTERM) 21:50:36.625409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19607): Terminating (SIGTERM) 21:50:36.665052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19610): Terminating (SIGTERM) 21:50:36.705055 --- ParallelTerminationStrategy: PID 19600 died... 21:50:36.724018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19600): Terminated: ok {rc=0} 21:50:36.768600 --- ParallelTerminationStrategy: PID 19601 died... 21:50:36.787270 run iperf3-srv_10.42.42.10(pid=19601): Terminated {rc=256} 21:50:36.831567 --- ParallelTerminationStrategy: PID 19604 died... 21:50:36.850170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19604): Terminated: ok {rc=0} 21:50:36.894295 --- ParallelTerminationStrategy: PID 19607 died... 21:50:36.912816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19607): Terminated: ok {rc=0} 21:50:36.957395 --- ParallelTerminationStrategy: PID 19610 died... 21:50:36.976103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19610): Terminated: ok {rc=0} 21:50:37.063265 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:sysmo iperf3m4.py ---------------------------------------------- 21:50:38.211872 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:38.223071 tst gprs:sysmo: Using 1 x bts (candidates: 1) 21:50:38.259377 tst iperf3m4.py: using LAC 23891 21:50:38.380141 tst iperf3m4.py: using RAC 176 21:50:38.498881 tst iperf3m4.py: using CellId 23891 21:50:38.619047 tst iperf3m4.py: using BVCI 23892 21:50:38.730454 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:38.741005 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:38.751395 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:38.762067 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:38.772371 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:38.782888 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:38.793667 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:38.804097 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:38.814708 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:38.931442 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:39.055098 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:39.176304 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:39.294442 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:50:39.499395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:39.804816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19612): Launched 21:50:40.073554 run iperf3-srv_10.42.42.10(pid=19613): Launched 21:50:40.189356 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:50:40.395095 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:40.703137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19614): Launched 21:50:40.968011 run iperf3-srv_10.42.42.10(pid=19615): Launched 21:50:41.081822 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:50:41.285607 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:41.590529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19617): Launched 21:50:41.854738 run iperf3-srv_10.42.42.10(pid=19618): Launched 21:50:41.968303 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:50:42.170800 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:42.475768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19619): Launched 21:50:42.757345 run iperf3-srv_10.42.42.10(pid=19620): Launched 21:50:42.880272 tst iperf3m4.py:8: start network... 21:50:43.100509 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:43.605397 run create_hlr_db(pid=19621): Launched 21:50:43.738973 bus /gobi_6: Setting Powered False 21:50:44.803027 run create_hlr_db(pid=19621): Terminated: ok {rc=0} 21:50:45.255433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19623): Launched 21:50:45.581648 run osmo-hlr_10.42.42.2(pid=19624): Launched 21:50:45.703910 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:46.418673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19626): Launched 21:50:46.740782 run osmo-stp_10.42.42.5(pid=19627): Launched 21:50:47.038405 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:50:47.709351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19629): Launched 21:50:47.833839 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:50:48.110617 run patchelf(pid=19630): Launched 21:50:48.291466 run osmo-stp_10.42.42.5(pid=19627): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19627)] 21:50:48.429985 run osmo-stp_10.42.42.5(pid=19627): stdout: | (launched: 2022-12-09_21:50:46.675794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:48.569864 run osmo-stp_10.42.42.5(pid=19627): stderr: | 20221209215046942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215046942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215046943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215046943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215046944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215046944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215046944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:48.709408 run osmo-stp_10.42.42.5(pid=19627): stdout: | (launched: 2022-12-09_21:50:46.675794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:48.842160 run osmo-stp_10.42.42.5(pid=19627): stderr: | 20221209215046942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215046942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215046943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215046943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215046944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215046944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215046944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:48.999858 run patchelf(pid=19630): Terminating (SIGINT) 21:50:49.184046 run patchelf(pid=19630): Terminated: ok {rc=0} 21:50:49.316813 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19627): Process ended prematurely: osmo-stp_10.42.42.5(pid=19627) [trial-2365↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19627)] [trial-2365↪gprs:sysmo↪iperf3m4.py:8] 21:50:49.327015 tst iperf3m4.py:8: Test FAILED (11.2 sec) 21:50:49.355731 run osmo-hlr_10.42.42.2(pid=19624): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19624)] 21:50:49.406010 run osmo-hlr_10.42.42.2(pid=19624): stdout: | (launched: 2022-12-09_21:50:45.522006) 21:50:49.458402 run osmo-hlr_10.42.42.2(pid=19624): stderr: | 20221209215045723 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215045723 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215045723 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215045724 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215045724 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215045724 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215045737 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215045745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215045745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215045745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:49.510958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19612): Terminating (SIGTERM) 21:50:49.553078 run iperf3-srv_10.42.42.10(pid=19613): Terminating (SIGTERM) 21:50:49.595077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19614): Terminating (SIGTERM) 21:50:49.637778 run iperf3-srv_10.42.42.10(pid=19615): Terminating (SIGTERM) 21:50:49.680077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19617): Terminating (SIGTERM) 21:50:49.722236 run iperf3-srv_10.42.42.10(pid=19618): Terminating (SIGTERM) 21:50:49.764183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19619): Terminating (SIGTERM) 21:50:49.806396 run iperf3-srv_10.42.42.10(pid=19620): Terminating (SIGTERM) 21:50:49.848190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19623): Terminating (SIGTERM) 21:50:49.890464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19626): Terminating (SIGTERM) 21:50:49.932428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19629): Terminating (SIGTERM) 21:50:49.974674 --- ParallelTerminationStrategy: PID 19612 died... 21:50:49.994760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19612): Terminated: ok {rc=0} 21:50:50.041432 --- ParallelTerminationStrategy: PID 19613 died... 21:50:50.060888 run iperf3-srv_10.42.42.10(pid=19613): Terminated {rc=256} 21:50:50.107404 --- ParallelTerminationStrategy: PID 19614 died... 21:50:50.126977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19614): Terminated: ok {rc=0} 21:50:50.173338 --- ParallelTerminationStrategy: PID 19615 died... 21:50:50.192936 run iperf3-srv_10.42.42.10(pid=19615): Terminated {rc=256} 21:50:50.239588 --- ParallelTerminationStrategy: PID 19617 died... 21:50:50.259292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19617): Terminated: ok {rc=0} 21:50:50.305804 --- ParallelTerminationStrategy: PID 19618 died... 21:50:50.325539 run iperf3-srv_10.42.42.10(pid=19618): Terminated {rc=256} 21:50:50.371759 --- ParallelTerminationStrategy: PID 19619 died... 21:50:50.391377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19619): Terminated: ok {rc=0} 21:50:50.437818 --- ParallelTerminationStrategy: PID 19620 died... 21:50:50.457746 run iperf3-srv_10.42.42.10(pid=19620): Terminated {rc=256} 21:50:50.504133 --- ParallelTerminationStrategy: PID 19623 died... 21:50:50.523840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19623): Terminated: ok {rc=0} 21:50:50.570165 --- ParallelTerminationStrategy: PID 19626 died... 21:50:50.589862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19626): Terminated: ok {rc=0} 21:50:50.636300 --- ParallelTerminationStrategy: PID 19629 died... 21:50:50.656100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19629): Terminated: ok {rc=0} 21:50:50.745206 bus /gobi_4: Setting Powered False 21:50:51.845354 bus /gobi_4: Setting Powered False 21:50:52.961068 bus /gobi_1: Setting Powered False 21:50:54.062626 bus /gobi_1: Setting Powered False 21:50:55.178412 bus /gobi_0: Setting Powered False 21:50:56.278145 bus /gobi_0: Setting Powered False 21:50:57.397705 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:sysmo ping.py ---------------------------------------------- 21:50:58.498897 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:58.510135 tst gprs:sysmo: Using 1 x bts (candidates: 1) 21:50:58.546882 tst ping.py: using LAC 23892 21:50:58.666171 tst ping.py: using RAC 177 21:50:58.785116 tst ping.py: using CellId 23892 21:50:58.903853 tst ping.py: using BVCI 23893 21:50:59.011566 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:59.022081 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:59.032491 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:59.043110 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:59.053620 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:59.063974 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:59.074598 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:59.085623 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:59.204707 tst ping.py:19: start network... 21:50:59.411086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:59.877175 run create_hlr_db(pid=19631): Launched 21:50:59.997179 bus /gobi_6: Setting Powered False 21:51:01.072424 run create_hlr_db(pid=19631): Terminated: ok {rc=0} 21:51:01.565686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19633): Launched 21:51:01.907028 run osmo-hlr_10.42.42.2(pid=19634): Launched 21:51:02.125275 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:02.653788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19636): Launched 21:51:02.953401 run osmo-stp_10.42.42.5(pid=19637): Launched 21:51:03.065751 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:03.578673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19639): Launched 21:51:03.692196 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:03.943352 run patchelf(pid=19640): Launched 21:51:04.109640 run osmo-stp_10.42.42.5(pid=19637): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19637)] 21:51:04.236238 run osmo-stp_10.42.42.5(pid=19637): stdout: | (launched: 2022-12-09_21:51:02.898102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:04.364272 run osmo-stp_10.42.42.5(pid=19637): stderr: | 20221209215103071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215103071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215103071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215103071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215103072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215103072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215103072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:04.492576 run osmo-stp_10.42.42.5(pid=19637): stdout: | (launched: 2022-12-09_21:51:02.898102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:04.614320 run osmo-stp_10.42.42.5(pid=19637): stderr: | 20221209215103071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215103071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215103071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215103071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215103072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215103072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215103072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:04.758525 run patchelf(pid=19640): Terminating (SIGINT) 21:51:04.927520 run patchelf(pid=19640): Terminated: ok {rc=0} 21:51:05.048611 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19637): Process ended prematurely: osmo-stp_10.42.42.5(pid=19637) [trial-2365↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19637)] [trial-2365↪gprs:sysmo↪ping.py:22] 21:51:05.057452 tst ping.py:22: Test FAILED (6.6 sec) 21:51:05.084257 run osmo-hlr_10.42.42.2(pid=19634): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19634)] 21:51:05.132290 run osmo-hlr_10.42.42.2(pid=19634): stdout: | (launched: 2022-12-09_21:51:01.843211) 21:51:05.181988 run osmo-hlr_10.42.42.2(pid=19634): stderr: | 20221209215102096 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215102096 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215102096 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215102096 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215102097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215102097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215102113 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215102133 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215102133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215102133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:05.231993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19633): Terminating (SIGTERM) 21:51:05.271991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19636): Terminating (SIGTERM) 21:51:05.311987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19639): Terminating (SIGTERM) 21:51:05.352331 --- ParallelTerminationStrategy: PID 19633 died... 21:51:05.371637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19633): Terminated: ok {rc=0} 21:51:05.416670 --- ParallelTerminationStrategy: PID 19636 died... 21:51:05.435504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19636): Terminated: ok {rc=0} 21:51:05.480128 --- ParallelTerminationStrategy: PID 19639 died... 21:51:05.498833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19639): Terminated: ok {rc=0} 21:51:05.584791 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 21:51:06.674078 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:06.685637 tst gprs:sysmo: Using 1 x bts (candidates: 1) 21:51:06.722278 tst ping_idle_ping.py: using LAC 23893 21:51:06.841086 tst ping_idle_ping.py: using RAC 178 21:51:06.962097 tst ping_idle_ping.py: using CellId 23893 21:51:07.078719 tst ping_idle_ping.py: using BVCI 23894 21:51:07.188248 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:07.198698 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:07.209046 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:07.219481 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:07.230002 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:07.240328 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:07.250955 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:07.261656 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:51:07.389845 tst ping_idle_ping.py:24: start network... 21:51:07.607917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:08.101307 run create_hlr_db(pid=19641): Launched 21:51:08.231028 bus /gobi_6: Setting Powered False 21:51:09.294338 run create_hlr_db(pid=19641): Terminated: ok {rc=0} 21:51:09.722912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19643): Launched 21:51:10.020561 run osmo-hlr_10.42.42.2(pid=19644): Launched 21:51:10.134525 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:10.646762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19646): Launched 21:51:10.943611 run osmo-stp_10.42.42.5(pid=19647): Launched 21:51:11.056903 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:11.571580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19649): Launched 21:51:11.687009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:11.939418 run patchelf(pid=19650): Launched 21:51:12.105158 run osmo-stp_10.42.42.5(pid=19647): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19647)] 21:51:12.231737 run osmo-stp_10.42.42.5(pid=19647): stdout: | (launched: 2022-12-09_21:51:10.888872) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:12.360830 run osmo-stp_10.42.42.5(pid=19647): stderr: | 20221209215111062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215111062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215111063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215111063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215111063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215111064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215111064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:12.489795 run osmo-stp_10.42.42.5(pid=19647): stdout: | (launched: 2022-12-09_21:51:10.888872) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:12.611791 run osmo-stp_10.42.42.5(pid=19647): stderr: | 20221209215111062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215111062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215111063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215111063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215111063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215111064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215111064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:12.756444 run patchelf(pid=19650): Terminating (SIGINT) 21:51:12.925685 run patchelf(pid=19650): Terminated: ok {rc=0} 21:51:13.047624 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19647): Process ended prematurely: osmo-stp_10.42.42.5(pid=19647) [trial-2365↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19647)] [trial-2365↪gprs:sysmo↪ping_idle_ping.py:27] 21:51:13.056281 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 21:51:13.083487 run osmo-hlr_10.42.42.2(pid=19644): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19644)] 21:51:13.130871 run osmo-hlr_10.42.42.2(pid=19644): stdout: | (launched: 2022-12-09_21:51:09.965589) 21:51:13.179857 run osmo-hlr_10.42.42.2(pid=19644): stderr: | 20221209215110142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215110142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215110142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215110143 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215110143 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215110143 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215110183 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215110193 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215110194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215110194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:13.229422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19643): Terminating (SIGTERM) 21:51:13.269045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19646): Terminating (SIGTERM) 21:51:13.308417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19649): Terminating (SIGTERM) 21:51:13.348072 --- ParallelTerminationStrategy: PID 19643 died... 21:51:13.367037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19643): Terminated: ok {rc=0} 21:51:13.411227 --- ParallelTerminationStrategy: PID 19646 died... 21:51:13.429702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19646): Terminated: ok {rc=0} 21:51:13.474191 --- ParallelTerminationStrategy: PID 19649 died... 21:51:13.492538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19649): Terminated: ok {rc=0} 21:51:13.575721 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 21:51:14.857356 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:51:14.862455 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:51:14.883311 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:51:14.921967 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:51:15.007486 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:51:15.027820 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:51:15.065993 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:51:15.658039 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:51:15.713591 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:15.724822 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:51:15.765391 tst cs_paging_gprs_active.py: using LAC 23894 21:51:15.921073 tst cs_paging_gprs_active.py: using RAC 179 21:51:16.052886 tst cs_paging_gprs_active.py: using CellId 23894 21:51:16.213127 tst cs_paging_gprs_active.py: using BVCI 23895 21:51:16.348638 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:16.360510 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:16.372093 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:16.384364 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:16.396322 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:16.408435 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:16.420706 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:16.432806 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:16.445391 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:16.572415 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:16.721760 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:51:16.950362 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:17.289280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19656): Launched 21:51:17.555550 run iperf3-srv_10.42.42.10(pid=19657): Launched 21:51:17.669888 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:51:17.874009 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:18.179162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19658): Launched 21:51:18.444727 run iperf3-srv_10.42.42.10(pid=19659): Launched 21:51:18.559281 tst cs_paging_gprs_active.py:38: start network... 21:51:18.763830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:19.236359 run create_hlr_db(pid=19660): Launched 21:51:19.353456 bus /gobi_6: Setting Powered False 21:51:20.414239 run create_hlr_db(pid=19660): Terminated: ok {rc=0} 21:51:20.838433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19662): Launched 21:51:21.143209 run osmo-hlr_10.42.42.2(pid=19663): Launched 21:51:21.259593 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:21.781948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19665): Launched 21:51:22.086715 run osmo-stp_10.42.42.5(pid=19666): Launched 21:51:22.203201 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:22.728232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19668): Launched 21:51:22.854932 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:23.131099 run patchelf(pid=19669): Launched 21:51:23.313626 run osmo-stp_10.42.42.5(pid=19666): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19666)] 21:51:23.452641 run osmo-stp_10.42.42.5(pid=19666): stdout: | (launched: 2022-12-09_21:51:22.030599) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:23.594124 run osmo-stp_10.42.42.5(pid=19666): stderr: | 20221209215122201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215122201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215122202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215122202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215122202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215122202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215122203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:23.734591 run osmo-stp_10.42.42.5(pid=19666): stdout: | (launched: 2022-12-09_21:51:22.030599) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:23.869153 run osmo-stp_10.42.42.5(pid=19666): stderr: | 20221209215122201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215122201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215122202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215122202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215122202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215122202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215122203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:24.028549 run patchelf(pid=19669): Terminating (SIGINT) 21:51:24.213975 run patchelf(pid=19669): Terminated: ok {rc=0} 21:51:24.347682 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19666): Process ended prematurely: osmo-stp_10.42.42.5(pid=19666) [trial-2365↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19666)] [trial-2365↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:51:24.357827 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 21:51:24.386059 run osmo-hlr_10.42.42.2(pid=19663): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19663)] 21:51:24.436680 run osmo-hlr_10.42.42.2(pid=19663): stdout: | (launched: 2022-12-09_21:51:21.087114) 21:51:24.489305 run osmo-hlr_10.42.42.2(pid=19663): stderr: | 20221209215121264 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215121264 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215121264 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215121264 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215121264 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215121264 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215121301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215121311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215121311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215121311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:24.541699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19656): Terminating (SIGTERM) 21:51:24.583581 run iperf3-srv_10.42.42.10(pid=19657): Terminating (SIGTERM) 21:51:24.625439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19658): Terminating (SIGTERM) 21:51:24.667475 run iperf3-srv_10.42.42.10(pid=19659): Terminating (SIGTERM) 21:51:24.709399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19662): Terminating (SIGTERM) 21:51:24.751372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19665): Terminating (SIGTERM) 21:51:24.793364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19668): Terminating (SIGTERM) 21:51:24.835284 --- ParallelTerminationStrategy: PID 19656 died... 21:51:24.855373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19656): Terminated: ok {rc=0} 21:51:24.901769 --- ParallelTerminationStrategy: PID 19657 died... 21:51:24.921660 run iperf3-srv_10.42.42.10(pid=19657): Terminated {rc=256} 21:51:24.967844 --- ParallelTerminationStrategy: PID 19658 died... 21:51:24.987590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19658): Terminated: ok {rc=0} 21:51:25.033752 --- ParallelTerminationStrategy: PID 19659 died... 21:51:25.053313 run iperf3-srv_10.42.42.10(pid=19659): Terminated {rc=256} 21:51:25.099335 --- ParallelTerminationStrategy: PID 19662 died... 21:51:25.118730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19662): Terminated: ok {rc=0} 21:51:25.164521 --- ParallelTerminationStrategy: PID 19665 died... 21:51:25.183960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19665): Terminated: ok {rc=0} 21:51:25.230031 --- ParallelTerminationStrategy: PID 19668 died... 21:51:25.249631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19668): Terminated: ok {rc=0} 21:51:25.337922 bus /gobi_0: Setting Powered False 21:51:26.438456 bus /gobi_0: Setting Powered False 21:51:27.554011 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:51:28.700532 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:28.711854 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:51:28.749290 tst iperf3.py: using LAC 23895 21:51:28.868872 tst iperf3.py: using RAC 180 21:51:28.987349 tst iperf3.py: using CellId 23895 21:51:29.107400 tst iperf3.py: using BVCI 23896 21:51:29.217491 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:29.228092 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:29.238696 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:29.249530 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:29.260178 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:29.270892 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:29.281796 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:29.292475 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:29.303386 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:29.421559 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:51:29.626914 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:29.931720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19670): Launched 21:51:30.196560 run iperf3-srv_10.42.42.10(pid=19671): Launched 21:51:30.310192 tst iperf3.py:8: start network... 21:51:30.512933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:30.997782 run create_hlr_db(pid=19672): Launched 21:51:31.147177 bus /gobi_6: Setting Powered False 21:51:32.206663 run create_hlr_db(pid=19672): Terminated: ok {rc=0} 21:51:32.633280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19674): Launched 21:51:32.936329 run osmo-hlr_10.42.42.2(pid=19675): Launched 21:51:33.052027 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:33.577035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19677): Launched 21:51:33.880083 run osmo-stp_10.42.42.5(pid=19678): Launched 21:51:33.995865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:34.519066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19680): Launched 21:51:34.635220 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:34.892520 run patchelf(pid=19681): Launched 21:51:35.061967 run osmo-stp_10.42.42.5(pid=19678): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19678)] 21:51:35.191261 run osmo-stp_10.42.42.5(pid=19678): stdout: | (launched: 2022-12-09_21:51:33.824314) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:35.321627 run osmo-stp_10.42.42.5(pid=19678): stderr: | 20221209215133996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215133996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215133996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215133996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215133997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215133997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215133997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:35.451660 run osmo-stp_10.42.42.5(pid=19678): stdout: | (launched: 2022-12-09_21:51:33.824314) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:35.576206 run osmo-stp_10.42.42.5(pid=19678): stderr: | 20221209215133996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215133996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215133996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215133996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215133997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215133997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215133997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:35.723411 run patchelf(pid=19681): Terminating (SIGINT) 21:51:35.895756 run patchelf(pid=19681): Terminated: ok {rc=0} 21:51:36.019291 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19678): Process ended prematurely: osmo-stp_10.42.42.5(pid=19678) [trial-2365↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19678)] [trial-2365↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 21:51:36.028610 tst iperf3.py:8: Test FAILED (7.4 sec) 21:51:36.056020 run osmo-hlr_10.42.42.2(pid=19675): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19675)] 21:51:36.103910 run osmo-hlr_10.42.42.2(pid=19675): stdout: | (launched: 2022-12-09_21:51:32.880609) 21:51:36.153400 run osmo-hlr_10.42.42.2(pid=19675): stderr: | 20221209215133060 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215133060 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215133060 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215133060 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215133060 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215133060 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215133073 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215133082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215133082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215133082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:36.203066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19670): Terminating (SIGTERM) 21:51:36.242607 run iperf3-srv_10.42.42.10(pid=19671): Terminating (SIGTERM) 21:51:36.282060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19674): Terminating (SIGTERM) 21:51:36.321742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19677): Terminating (SIGTERM) 21:51:36.361119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19680): Terminating (SIGTERM) 21:51:36.400697 --- ParallelTerminationStrategy: PID 19670 died... 21:51:36.419893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19670): Terminated: ok {rc=0} 21:51:36.464181 --- ParallelTerminationStrategy: PID 19671 died... 21:51:36.482628 run iperf3-srv_10.42.42.10(pid=19671): Terminated {rc=256} 21:51:36.526466 --- ParallelTerminationStrategy: PID 19674 died... 21:51:36.544875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19674): Terminated: ok {rc=0} 21:51:36.589042 --- ParallelTerminationStrategy: PID 19677 died... 21:51:36.607458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19677): Terminated: ok {rc=0} 21:51:36.651328 --- ParallelTerminationStrategy: PID 19680 died... 21:51:36.669890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19680): Terminated: ok {rc=0} 21:51:36.755724 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:51:37.904308 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:37.915541 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:51:37.956535 tst iperf3m4.py: using LAC 23896 21:51:38.074401 tst iperf3m4.py: using RAC 181 21:51:38.192936 tst iperf3m4.py: using CellId 23896 21:51:38.309369 tst iperf3m4.py: using BVCI 23897 21:51:38.418870 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:38.429618 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:38.440151 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:38.450888 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:38.461654 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:38.472293 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:38.483158 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:38.493950 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:38.504710 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:38.625806 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:38.746235 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:38.867041 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:38.983769 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:51:39.188910 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:39.496256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19682): Launched 21:51:39.762351 run iperf3-srv_10.42.42.10(pid=19683): Launched 21:51:39.876373 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:51:40.080794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:40.386438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19684): Launched 21:51:40.651921 run iperf3-srv_10.42.42.10(pid=19685): Launched 21:51:40.766305 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:51:40.970003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:41.275722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19686): Launched 21:51:41.541460 run iperf3-srv_10.42.42.10(pid=19687): Launched 21:51:41.656540 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:51:41.862881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:42.171206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19688): Launched 21:51:42.435525 run iperf3-srv_10.42.42.10(pid=19689): Launched 21:51:42.549713 tst iperf3m4.py:8: start network... 21:51:42.752588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:43.222257 run create_hlr_db(pid=19690): Launched 21:51:43.337365 bus /gobi_6: Setting Powered False 21:51:44.397900 run create_hlr_db(pid=19690): Terminated: ok {rc=0} 21:51:44.842100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19692): Launched 21:51:45.166340 run osmo-hlr_10.42.42.2(pid=19693): Launched 21:51:45.289808 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:45.867735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19695): Launched 21:51:46.225688 run osmo-stp_10.42.42.5(pid=19696): Launched 21:51:46.354753 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:47.073675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19698): Launched 21:51:47.202222 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:47.465446 run patchelf(pid=19699): Launched 21:51:47.636021 run osmo-stp_10.42.42.5(pid=19696): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19696)] 21:51:47.767594 run osmo-stp_10.42.42.5(pid=19696): stdout: | (launched: 2022-12-09_21:51:46.154104) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:47.898974 run osmo-stp_10.42.42.5(pid=19696): stderr: | 20221209215146496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215146496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215146496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215146505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215146507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215146507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215146507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:48.030640 run osmo-stp_10.42.42.5(pid=19696): stdout: | (launched: 2022-12-09_21:51:46.154104) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:48.155905 run osmo-stp_10.42.42.5(pid=19696): stderr: | 20221209215146496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215146496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215146496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215146505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215146507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215146507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215146507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:48.304023 run patchelf(pid=19699): Terminating (SIGINT) 21:51:48.477697 run patchelf(pid=19699): Terminated: ok {rc=0} 21:51:48.602432 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19696): Process ended prematurely: osmo-stp_10.42.42.5(pid=19696) [trial-2365↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19696)] [trial-2365↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 21:51:48.611713 tst iperf3m4.py:8: Test FAILED (10.7 sec) 21:51:48.639460 run osmo-hlr_10.42.42.2(pid=19693): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19693)] 21:51:48.687112 run osmo-hlr_10.42.42.2(pid=19693): stdout: | (launched: 2022-12-09_21:51:45.107241) 21:51:48.736489 run osmo-hlr_10.42.42.2(pid=19693): stderr: | 20221209215145308 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215145308 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215145308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215145308 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215145308 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215145308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215145320 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215145329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215145329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215145329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:48.786436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19682): Terminating (SIGTERM) 21:51:48.826016 run iperf3-srv_10.42.42.10(pid=19683): Terminating (SIGTERM) 21:51:48.865901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19684): Terminating (SIGTERM) 21:51:48.905853 run iperf3-srv_10.42.42.10(pid=19685): Terminating (SIGTERM) 21:51:48.945547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19686): Terminating (SIGTERM) 21:51:48.985348 run iperf3-srv_10.42.42.10(pid=19687): Terminating (SIGTERM) 21:51:49.025172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19688): Terminating (SIGTERM) 21:51:49.064894 run iperf3-srv_10.42.42.10(pid=19689): Terminating (SIGTERM) 21:51:49.104448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19692): Terminating (SIGTERM) 21:51:49.144865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19695): Terminating (SIGTERM) 21:51:49.184769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19698): Terminating (SIGTERM) 21:51:49.224627 --- ParallelTerminationStrategy: PID 19682 died... 21:51:49.243161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19682): Terminated: ok {rc=0} 21:51:49.287565 --- ParallelTerminationStrategy: PID 19683 died... 21:51:49.306182 run iperf3-srv_10.42.42.10(pid=19683): Terminated {rc=256} 21:51:49.350079 --- ParallelTerminationStrategy: PID 19684 died... 21:51:49.368530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19684): Terminated: ok {rc=0} 21:51:49.412598 --- ParallelTerminationStrategy: PID 19685 died... 21:51:49.431118 run iperf3-srv_10.42.42.10(pid=19685): Terminated {rc=256} 21:51:49.475050 --- ParallelTerminationStrategy: PID 19686 died... 21:51:49.493952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19686): Terminated: ok {rc=0} 21:51:49.538357 --- ParallelTerminationStrategy: PID 19687 died... 21:51:49.556755 run iperf3-srv_10.42.42.10(pid=19687): Terminated {rc=256} 21:51:49.600679 --- ParallelTerminationStrategy: PID 19688 died... 21:51:49.619241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19688): Terminated: ok {rc=0} 21:51:49.663882 --- ParallelTerminationStrategy: PID 19689 died... 21:51:49.682422 run iperf3-srv_10.42.42.10(pid=19689): Terminated {rc=256} 21:51:49.726396 --- ParallelTerminationStrategy: PID 19692 died... 21:51:49.745094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19692): Terminated: ok {rc=0} 21:51:49.789130 --- ParallelTerminationStrategy: PID 19695 died... 21:51:49.807639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19695): Terminated: ok {rc=0} 21:51:49.851844 --- ParallelTerminationStrategy: PID 19698 died... 21:51:49.870394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19698): Terminated: ok {rc=0} 21:51:49.956394 bus /gobi_4: Setting Powered False 21:51:51.057064 bus /gobi_4: Setting Powered False 21:51:52.173297 bus /gobi_1: Setting Powered False 21:51:53.273552 bus /gobi_1: Setting Powered False 21:51:54.388611 bus /gobi_0: Setting Powered False 21:51:55.488885 bus /gobi_0: Setting Powered False 21:51:56.602186 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 21:51:57.704622 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:57.716523 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:51:57.754917 tst ping.py: using LAC 23897 21:51:57.882549 tst ping.py: using RAC 182 21:51:58.008785 tst ping.py: using CellId 23897 21:51:58.134873 tst ping.py: using BVCI 23898 21:51:58.251113 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:58.262308 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:58.273446 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:58.284376 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:58.295291 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:58.306257 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:58.317449 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:58.328489 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:58.449916 tst ping.py:19: start network... 21:51:58.666796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:59.161690 run create_hlr_db(pid=19700): Launched 21:51:59.292013 bus /gobi_6: Setting Powered False 21:52:00.356333 run create_hlr_db(pid=19700): Terminated: ok {rc=0} 21:52:00.785465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19702): Launched 21:52:01.136532 run osmo-hlr_10.42.42.2(pid=19703): Launched 21:52:01.379095 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:02.005996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19705): Launched 21:52:02.320414 run osmo-stp_10.42.42.5(pid=19706): Launched 21:52:02.435251 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:52:02.954331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19708): Launched 21:52:03.068365 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:52:03.319939 run patchelf(pid=19709): Launched 21:52:03.485973 run osmo-stp_10.42.42.5(pid=19706): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19706)] 21:52:03.612737 run osmo-stp_10.42.42.5(pid=19706): stdout: | (launched: 2022-12-09_21:52:02.255883) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:03.741530 run osmo-stp_10.42.42.5(pid=19706): stderr: | 20221209215202432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215202432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215202433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215202433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215202433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215202434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215202434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:03.870764 run osmo-stp_10.42.42.5(pid=19706): stdout: | (launched: 2022-12-09_21:52:02.255883) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:03.992584 run osmo-stp_10.42.42.5(pid=19706): stderr: | 20221209215202432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215202432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215202433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215202433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215202433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215202434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215202434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:04.137304 run patchelf(pid=19709): Terminating (SIGINT) 21:52:04.306358 run patchelf(pid=19709): Terminated: ok {rc=0} 21:52:04.427664 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19706): Process ended prematurely: osmo-stp_10.42.42.5(pid=19706) [trial-2365↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19706)] [trial-2365↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 21:52:04.436466 tst ping.py:22: Test FAILED (6.7 sec) 21:52:04.463562 run osmo-hlr_10.42.42.2(pid=19703): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19703)] 21:52:04.511069 run osmo-hlr_10.42.42.2(pid=19703): stdout: | (launched: 2022-12-09_21:52:01.072777) 21:52:04.560197 run osmo-hlr_10.42.42.2(pid=19703): stderr: | 20221209215201316 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215201316 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215201316 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215201316 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215201316 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215201316 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215201330 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215201350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215201350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215201350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:04.609709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19702): Terminating (SIGTERM) 21:52:04.649371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19705): Terminating (SIGTERM) 21:52:04.689036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19708): Terminating (SIGTERM) 21:52:04.728794 --- ParallelTerminationStrategy: PID 19702 died... 21:52:04.748090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19702): Terminated: ok {rc=0} 21:52:04.793422 --- ParallelTerminationStrategy: PID 19705 died... 21:52:04.812034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19705): Terminated: ok {rc=0} 21:52:04.857077 --- ParallelTerminationStrategy: PID 19708 died... 21:52:04.875651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19708): Terminated: ok {rc=0} 21:52:04.962378 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:52:06.050136 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:06.061414 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:52:06.099691 tst ping_idle_ping.py: using LAC 23898 21:52:06.216796 tst ping_idle_ping.py: using RAC 183 21:52:06.333393 tst ping_idle_ping.py: using CellId 23898 21:52:06.452260 tst ping_idle_ping.py: using BVCI 23899 21:52:06.560506 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:06.571244 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:06.581853 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:06.592616 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:06.603424 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:06.614117 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:06.625017 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:06.635770 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:52:06.761265 tst ping_idle_ping.py:24: start network... 21:52:06.978344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:07.473735 run create_hlr_db(pid=19710): Launched 21:52:07.604297 bus /gobi_6: Setting Powered False 21:52:08.668385 run create_hlr_db(pid=19710): Terminated: ok {rc=0} 21:52:09.115494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19712): Launched 21:52:09.435628 run osmo-hlr_10.42.42.2(pid=19713): Launched 21:52:09.558189 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:10.114432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19715): Launched 21:52:10.434039 run osmo-stp_10.42.42.5(pid=19716): Launched 21:52:10.555831 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:52:11.107740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19718): Launched 21:52:11.230384 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:52:11.501467 run patchelf(pid=19719): Launched 21:52:11.680801 run osmo-stp_10.42.42.5(pid=19716): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19716)] 21:52:11.817785 run osmo-stp_10.42.42.5(pid=19716): stdout: | (launched: 2022-12-09_21:52:10.375842) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:11.956215 run osmo-stp_10.42.42.5(pid=19716): stderr: | 20221209215210567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215210567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215210567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215210567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215210570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215210570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215210570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:12.094694 run osmo-stp_10.42.42.5(pid=19716): stdout: | (launched: 2022-12-09_21:52:10.375842) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:12.226073 run osmo-stp_10.42.42.5(pid=19716): stderr: | 20221209215210567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215210567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215210567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215210567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215210570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215210570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215210570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:12.382136 run patchelf(pid=19719): Terminating (SIGINT) 21:52:12.564730 run patchelf(pid=19719): Terminated: ok {rc=0} 21:52:12.695841 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19716): Process ended prematurely: osmo-stp_10.42.42.5(pid=19716) [trial-2365↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19716)] [trial-2365↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 21:52:12.705404 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 21:52:12.732933 run osmo-hlr_10.42.42.2(pid=19713): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19713)] 21:52:12.782673 run osmo-hlr_10.42.42.2(pid=19713): stdout: | (launched: 2022-12-09_21:52:09.377384) 21:52:12.834208 run osmo-hlr_10.42.42.2(pid=19713): stderr: | 20221209215209579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215209579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215209579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215209579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215209579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215209579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215209591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215209600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215209600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215209600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:12.886117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19712): Terminating (SIGTERM) 21:52:12.927809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19715): Terminating (SIGTERM) 21:52:12.969635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19718): Terminating (SIGTERM) 21:52:13.011580 --- ParallelTerminationStrategy: PID 19712 died... 21:52:13.031633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19712): Terminated: ok {rc=0} 21:52:13.077844 --- ParallelTerminationStrategy: PID 19715 died... 21:52:13.097579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19715): Terminated: ok {rc=0} 21:52:13.143329 --- ParallelTerminationStrategy: PID 19718 died... 21:52:13.162753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19718): Terminated: ok {rc=0} 21:52:13.250174 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 21:52:14.537519 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:52:14.543835 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 21:52:14.565468 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 21:52:14.604020 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 21:52:14.690354 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 21:52:14.710922 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 21:52:14.749281 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 21:52:15.342439 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 21:52:15.391672 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:15.402571 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:52:15.457298 tst cs_paging_gprs_active.py: using LAC 23899 21:52:15.576659 tst cs_paging_gprs_active.py: using RAC 184 21:52:15.695036 tst cs_paging_gprs_active.py: using CellId 23899 21:52:15.817649 tst cs_paging_gprs_active.py: using BVCI 23900 21:52:15.939374 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:15.950985 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:15.962149 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:15.973746 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:15.985119 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:15.996392 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:16.008102 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:16.019500 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:16.031170 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:16.173360 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:16.330429 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:52:16.563285 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:16.887757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19723): Launched 21:52:17.174515 run iperf3-srv_10.42.42.10(pid=19724): Launched 21:52:17.290855 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:52:17.496619 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:17.804393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19725): Launched 21:52:18.072068 run iperf3-srv_10.42.42.10(pid=19726): Launched 21:52:18.186382 tst cs_paging_gprs_active.py:38: start network... 21:52:18.390402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:18.861532 run create_hlr_db(pid=19727): Launched 21:52:18.978304 bus /gobi_6: Setting Powered False 21:52:20.038648 run create_hlr_db(pid=19727): Terminated: ok {rc=0} 21:52:20.484444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19729): Launched 21:52:20.811096 run osmo-hlr_10.42.42.2(pid=19730): Launched 21:52:20.935454 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:21.498642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19732): Launched 21:52:21.824791 run osmo-stp_10.42.42.5(pid=19733): Launched 21:52:21.948534 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:52:22.510026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19741): Launched 21:52:22.635075 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:52:22.910741 run patchelf(pid=19742): Launched 21:52:23.092551 run osmo-stp_10.42.42.5(pid=19733): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19733)] 21:52:23.230768 run osmo-stp_10.42.42.5(pid=19733): stdout: | (launched: 2022-12-09_21:52:21.765395) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:23.371023 run osmo-stp_10.42.42.5(pid=19733): stderr: | 20221209215221961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215221961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215221961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215221962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215221962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215221962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215221962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:23.511043 run osmo-stp_10.42.42.5(pid=19733): stdout: | (launched: 2022-12-09_21:52:21.765395) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:23.644718 run osmo-stp_10.42.42.5(pid=19733): stderr: | 20221209215221961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215221961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215221961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215221962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215221962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215221962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215221962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:23.802724 run patchelf(pid=19742): Terminating (SIGINT) 21:52:23.986824 run patchelf(pid=19742): Terminated: ok {rc=0} 21:52:24.119990 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19733): Process ended prematurely: osmo-stp_10.42.42.5(pid=19733) [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19733)] [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 21:52:24.130229 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 21:52:24.158840 run osmo-hlr_10.42.42.2(pid=19730): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19730)] 21:52:24.208725 run osmo-hlr_10.42.42.2(pid=19730): stdout: | (launched: 2022-12-09_21:52:20.751646) 21:52:24.260440 run osmo-hlr_10.42.42.2(pid=19730): stderr: | 20221209215220950 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215220950 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215220950 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215220950 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215220950 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215220950 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215220963 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215220971 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215220971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215220971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:24.312573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19723): Terminating (SIGTERM) 21:52:24.354334 run iperf3-srv_10.42.42.10(pid=19724): Terminating (SIGTERM) 21:52:24.395779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19725): Terminating (SIGTERM) 21:52:24.437543 run iperf3-srv_10.42.42.10(pid=19726): Terminating (SIGTERM) 21:52:24.479266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19729): Terminating (SIGTERM) 21:52:24.521577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19732): Terminating (SIGTERM) 21:52:24.563369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19741): Terminating (SIGTERM) 21:52:24.605434 --- ParallelTerminationStrategy: PID 19723 died... 21:52:24.625382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19723): Terminated: ok {rc=0} 21:52:24.672060 --- ParallelTerminationStrategy: PID 19724 died... 21:52:24.691569 run iperf3-srv_10.42.42.10(pid=19724): Terminated {rc=256} 21:52:24.737327 --- ParallelTerminationStrategy: PID 19725 died... 21:52:24.756823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19725): Terminated: ok {rc=0} 21:52:24.802787 --- ParallelTerminationStrategy: PID 19726 died... 21:52:24.822290 run iperf3-srv_10.42.42.10(pid=19726): Terminated {rc=256} 21:52:24.867960 --- ParallelTerminationStrategy: PID 19729 died... 21:52:24.887675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19729): Terminated: ok {rc=0} 21:52:24.933592 --- ParallelTerminationStrategy: PID 19732 died... 21:52:24.953251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19732): Terminated: ok {rc=0} 21:52:24.999104 --- ParallelTerminationStrategy: PID 19741 died... 21:52:25.018735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19741): Terminated: ok {rc=0} 21:52:25.106491 bus /gobi_0: Setting Powered False 21:52:26.204259 bus /gobi_0: Setting Powered False 21:52:27.319300 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 21:52:28.466569 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:28.478081 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:52:28.537194 tst iperf3.py: using LAC 23900 21:52:28.657882 tst iperf3.py: using RAC 185 21:52:28.778122 tst iperf3.py: using CellId 23900 21:52:28.907722 tst iperf3.py: using BVCI 23901 21:52:29.025702 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:29.037181 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:29.048372 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:29.059645 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:29.070672 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:29.081774 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:29.092891 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:29.103832 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:29.114971 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:29.230417 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:52:29.435297 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:29.740479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19743): Launched 21:52:30.005961 run iperf3-srv_10.42.42.10(pid=19744): Launched 21:52:30.120376 tst iperf3.py:8: start network... 21:52:30.325052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:30.794488 run create_hlr_db(pid=19745): Launched 21:52:30.912716 bus /gobi_6: Setting Powered False 21:52:31.972254 run create_hlr_db(pid=19745): Terminated: ok {rc=0} 21:52:32.406794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19747): Launched 21:52:32.710477 run osmo-hlr_10.42.42.2(pid=19748): Launched 21:52:32.825457 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:33.363357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19750): Launched 21:52:33.665891 run osmo-stp_10.42.42.5(pid=19751): Launched 21:52:33.780437 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:52:34.302814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19753): Launched 21:52:34.418863 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:52:34.676215 run patchelf(pid=19754): Launched 21:52:34.845348 run osmo-stp_10.42.42.5(pid=19751): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19751)] 21:52:34.974813 run osmo-stp_10.42.42.5(pid=19751): stdout: | (launched: 2022-12-09_21:52:33.610091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:35.105382 run osmo-stp_10.42.42.5(pid=19751): stderr: | 20221209215233780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215233780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215233780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215233781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215233783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215233783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215233783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:35.236220 run osmo-stp_10.42.42.5(pid=19751): stdout: | (launched: 2022-12-09_21:52:33.610091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:35.360322 run osmo-stp_10.42.42.5(pid=19751): stderr: | 20221209215233780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215233780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215233780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215233781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215233783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215233783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215233783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:35.507437 run patchelf(pid=19754): Terminating (SIGINT) 21:52:35.679773 run patchelf(pid=19754): Terminated: ok {rc=0} 21:52:35.803153 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19751): Process ended prematurely: osmo-stp_10.42.42.5(pid=19751) [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19751)] [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 21:52:35.812384 tst iperf3.py:8: Test FAILED (7.4 sec) 21:52:35.839858 run osmo-hlr_10.42.42.2(pid=19748): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19748)] 21:52:35.892401 run osmo-hlr_10.42.42.2(pid=19748): stdout: | (launched: 2022-12-09_21:52:32.654612) 21:52:35.944020 run osmo-hlr_10.42.42.2(pid=19748): stderr: | 20221209215232831 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215232831 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215232831 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215232831 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215232831 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215232831 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215232843 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215232852 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215232852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215232852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:35.995673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19743): Terminating (SIGTERM) 21:52:36.037170 run iperf3-srv_10.42.42.10(pid=19744): Terminating (SIGTERM) 21:52:36.079272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19747): Terminating (SIGTERM) 21:52:36.121288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19750): Terminating (SIGTERM) 21:52:36.162955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19753): Terminating (SIGTERM) 21:52:36.204699 --- ParallelTerminationStrategy: PID 19743 died... 21:52:36.224764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19743): Terminated: ok {rc=0} 21:52:36.270895 --- ParallelTerminationStrategy: PID 19744 died... 21:52:36.290487 run iperf3-srv_10.42.42.10(pid=19744): Terminated {rc=256} 21:52:36.336213 --- ParallelTerminationStrategy: PID 19747 died... 21:52:36.355703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19747): Terminated: ok {rc=0} 21:52:36.401717 --- ParallelTerminationStrategy: PID 19750 died... 21:52:36.421327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19750): Terminated: ok {rc=0} 21:52:36.467369 --- ParallelTerminationStrategy: PID 19753 died... 21:52:36.486889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19753): Terminated: ok {rc=0} 21:52:36.575309 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 21:52:37.724863 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:37.736609 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:52:37.797015 tst iperf3m4.py: using LAC 23901 21:52:37.925698 tst iperf3m4.py: using RAC 186 21:52:38.055138 tst iperf3m4.py: using CellId 23901 21:52:38.184373 tst iperf3m4.py: using BVCI 23902 21:52:38.305169 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:38.316439 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:38.327812 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:38.339278 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:38.350731 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:38.362238 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:38.373949 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:38.385347 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:38.396921 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:38.513943 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:38.639393 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:38.762306 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:38.881101 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:52:39.086842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:39.393844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19757): Launched 21:52:39.659790 run iperf3-srv_10.42.42.10(pid=19758): Launched 21:52:39.774623 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:52:39.978561 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:40.284879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19759): Launched 21:52:40.550470 run iperf3-srv_10.42.42.10(pid=19760): Launched 21:52:40.664522 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:52:40.867975 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:41.173481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19761): Launched 21:52:41.440743 run iperf3-srv_10.42.42.10(pid=19762): Launched 21:52:41.554789 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:52:41.758651 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:42.065222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19763): Launched 21:52:42.331668 run iperf3-srv_10.42.42.10(pid=19764): Launched 21:52:42.445785 tst iperf3m4.py:8: start network... 21:52:42.649230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:43.119013 run create_hlr_db(pid=19765): Launched 21:52:43.235960 bus /gobi_6: Setting Powered False 21:52:44.295988 run create_hlr_db(pid=19765): Terminated: ok {rc=0} 21:52:44.720280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19767): Launched 21:52:45.024359 run osmo-hlr_10.42.42.2(pid=19768): Launched 21:52:45.140271 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:45.677711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19770): Launched 21:52:45.999465 run osmo-stp_10.42.42.5(pid=19771): Launched 21:52:46.234666 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:52:46.909774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19773): Launched 21:52:47.029682 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:52:47.291853 run patchelf(pid=19776): Launched 21:52:47.461268 run osmo-stp_10.42.42.5(pid=19771): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19771)] 21:52:47.590671 run osmo-stp_10.42.42.5(pid=19771): stdout: | (launched: 2022-12-09_21:52:45.926508) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:47.720928 run osmo-stp_10.42.42.5(pid=19771): stderr: | 20221209215246259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215246259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215246260 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215246260 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215246260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215246261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215246261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:47.851364 run osmo-stp_10.42.42.5(pid=19771): stdout: | (launched: 2022-12-09_21:52:45.926508) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:47.975367 run osmo-stp_10.42.42.5(pid=19771): stderr: | 20221209215246259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215246259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215246260 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215246260 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215246260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215246261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215246261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:48.122771 run patchelf(pid=19776): Terminating (SIGINT) 21:52:48.295684 run patchelf(pid=19776): Terminated: ok {rc=0} 21:52:48.419191 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19771): Process ended prematurely: osmo-stp_10.42.42.5(pid=19771) [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19771)] [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 21:52:48.428865 tst iperf3m4.py:8: Test FAILED (10.7 sec) 21:52:48.456306 run osmo-hlr_10.42.42.2(pid=19768): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19768)] 21:52:48.504321 run osmo-hlr_10.42.42.2(pid=19768): stdout: | (launched: 2022-12-09_21:52:44.968317) 21:52:48.553454 run osmo-hlr_10.42.42.2(pid=19768): stderr: | 20221209215245147 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215245147 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215245147 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215245147 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215245147 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215245147 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215245158 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215245167 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215245167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215245167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:48.602942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19757): Terminating (SIGTERM) 21:52:48.642573 run iperf3-srv_10.42.42.10(pid=19758): Terminating (SIGTERM) 21:52:48.682584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19759): Terminating (SIGTERM) 21:52:48.722810 run iperf3-srv_10.42.42.10(pid=19760): Terminating (SIGTERM) 21:52:48.762748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19761): Terminating (SIGTERM) 21:52:48.802763 run iperf3-srv_10.42.42.10(pid=19762): Terminating (SIGTERM) 21:52:48.842690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19763): Terminating (SIGTERM) 21:52:48.882565 run iperf3-srv_10.42.42.10(pid=19764): Terminating (SIGTERM) 21:52:48.922401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19767): Terminating (SIGTERM) 21:52:48.962320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19770): Terminating (SIGTERM) 21:52:49.002205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19773): Terminating (SIGTERM) 21:52:49.042410 --- ParallelTerminationStrategy: PID 19757 died... 21:52:49.061620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19757): Terminated: ok {rc=0} 21:52:49.106304 --- ParallelTerminationStrategy: PID 19758 died... 21:52:49.124802 run iperf3-srv_10.42.42.10(pid=19758): Terminated {rc=256} 21:52:49.169341 --- ParallelTerminationStrategy: PID 19759 died... 21:52:49.188184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19759): Terminated: ok {rc=0} 21:52:49.232553 --- ParallelTerminationStrategy: PID 19760 died... 21:52:49.251159 run iperf3-srv_10.42.42.10(pid=19760): Terminated {rc=256} 21:52:49.295968 --- ParallelTerminationStrategy: PID 19761 died... 21:52:49.314635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19761): Terminated: ok {rc=0} 21:52:49.359005 --- ParallelTerminationStrategy: PID 19762 died... 21:52:49.377629 run iperf3-srv_10.42.42.10(pid=19762): Terminated {rc=256} 21:52:49.421868 --- ParallelTerminationStrategy: PID 19763 died... 21:52:49.440319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19763): Terminated: ok {rc=0} 21:52:49.484755 --- ParallelTerminationStrategy: PID 19764 died... 21:52:49.503601 run iperf3-srv_10.42.42.10(pid=19764): Terminated {rc=256} 21:52:49.547646 --- ParallelTerminationStrategy: PID 19767 died... 21:52:49.566461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19767): Terminated: ok {rc=0} 21:52:49.611328 --- ParallelTerminationStrategy: PID 19770 died... 21:52:49.630018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19770): Terminated: ok {rc=0} 21:52:49.674427 --- ParallelTerminationStrategy: PID 19773 died... 21:52:49.693160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19773): Terminated: ok {rc=0} 21:52:49.779268 bus /gobi_4: Setting Powered False 21:52:50.879615 bus /gobi_4: Setting Powered False 21:52:51.996028 bus /gobi_1: Setting Powered False 21:52:53.095582 bus /gobi_1: Setting Powered False 21:52:54.209486 bus /gobi_0: Setting Powered False 21:52:55.308535 bus /gobi_0: Setting Powered False 21:52:56.426189 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 21:52:57.530288 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:57.541976 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:52:57.600514 tst ping.py: using LAC 23902 21:52:57.729091 tst ping.py: using RAC 187 21:52:57.853630 tst ping.py: using CellId 23902 21:52:57.979304 tst ping.py: using BVCI 23903 21:52:58.095329 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:58.106587 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:58.117651 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:58.128664 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:58.139691 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:58.150694 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:58.161887 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:58.172800 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:58.287914 tst ping.py:19: start network... 21:52:58.489515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:58.952175 run create_hlr_db(pid=19777): Launched 21:52:59.066795 bus /gobi_6: Setting Powered False 21:53:00.126911 run create_hlr_db(pid=19777): Terminated: ok {rc=0} 21:53:00.546646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19779): Launched 21:53:00.849661 run osmo-hlr_10.42.42.2(pid=19780): Launched 21:53:01.122095 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:01.709944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19782): Launched 21:53:02.035386 run osmo-stp_10.42.42.5(pid=19786): Launched 21:53:02.319907 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:53:02.981656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19796): Launched 21:53:03.110536 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:53:03.389693 run patchelf(pid=19797): Launched 21:53:03.572401 run osmo-stp_10.42.42.5(pid=19786): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19786)] 21:53:03.704443 run osmo-stp_10.42.42.5(pid=19786): stdout: | (launched: 2022-12-09_21:53:01.967762) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:03.836863 run osmo-stp_10.42.42.5(pid=19786): stderr: | 20221209215302233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215302234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215302234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215302234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215302235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215302235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215302235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:03.969609 run osmo-stp_10.42.42.5(pid=19786): stdout: | (launched: 2022-12-09_21:53:01.967762) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:04.095653 run osmo-stp_10.42.42.5(pid=19786): stderr: | 20221209215302233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215302234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215302234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215302234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215302235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215302235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215302235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:04.244667 run patchelf(pid=19797): Terminating (SIGINT) 21:53:04.420590 run patchelf(pid=19797): Terminated: ok {rc=0} 21:53:04.547889 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19786): Process ended prematurely: osmo-stp_10.42.42.5(pid=19786) [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19786)] [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 21:53:04.557905 tst ping.py:22: Test FAILED (7.0 sec) 21:53:04.588770 run osmo-hlr_10.42.42.2(pid=19780): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19780)] 21:53:04.639732 run osmo-hlr_10.42.42.2(pid=19780): stdout: | (launched: 2022-12-09_21:53:00.791153) 21:53:04.693151 run osmo-hlr_10.42.42.2(pid=19780): stderr: | 20221209215301023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215301023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215301023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215301023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215301023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215301023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215301044 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215301053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215301053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215301053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:04.745841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19779): Terminating (SIGTERM) 21:53:04.788385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19782): Terminating (SIGTERM) 21:53:04.832034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19796): Terminating (SIGTERM) 21:53:04.877906 --- ParallelTerminationStrategy: PID 19779 died... 21:53:04.897805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19779): Terminated: ok {rc=0} 21:53:04.947525 --- ParallelTerminationStrategy: PID 19782 died... 21:53:04.967638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19782): Terminated: ok {rc=0} 21:53:05.015212 --- ParallelTerminationStrategy: PID 19796 died... 21:53:05.034888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19796): Terminated: ok {rc=0} 21:53:05.124893 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 21:53:06.214197 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:06.226496 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:53:06.289304 tst ping_idle_ping.py: using LAC 23903 21:53:06.410711 tst ping_idle_ping.py: using RAC 188 21:53:06.533202 tst ping_idle_ping.py: using CellId 23903 21:53:06.653096 tst ping_idle_ping.py: using BVCI 23904 21:53:06.765581 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:06.777305 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:06.788887 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:06.801524 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:06.815045 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:06.826540 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:06.838900 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:06.851450 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:53:06.973798 tst ping_idle_ping.py:24: start network... 21:53:07.182344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:07.667030 run create_hlr_db(pid=19800): Launched 21:53:07.824458 bus /gobi_6: Setting Powered False 21:53:08.886723 run create_hlr_db(pid=19800): Terminated: ok {rc=0} 21:53:09.396248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19835): Launched 21:53:09.833676 run osmo-hlr_10.42.42.2(pid=19856): Launched 21:53:10.108665 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:10.897331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19998): Launched 21:53:11.315174 run osmo-stp_10.42.42.5(pid=20056): Launched 21:53:11.622973 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:53:12.197462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20066): Launched 21:53:12.333637 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:53:12.618509 run patchelf(pid=20067): Launched 21:53:12.813532 run osmo-stp_10.42.42.5(pid=20056): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20056)] 21:53:12.953904 run osmo-stp_10.42.42.5(pid=20056): stdout: | (launched: 2022-12-09_21:53:11.241641) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:13.096573 run osmo-stp_10.42.42.5(pid=20056): stderr: | 20221209215311519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215311519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215311519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215311520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215311520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215311520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215311520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:13.238473 run osmo-stp_10.42.42.5(pid=20056): stdout: | (launched: 2022-12-09_21:53:11.241641) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:13.374638 run osmo-stp_10.42.42.5(pid=20056): stderr: | 20221209215311519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215311519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215311519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215311520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215311520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215311520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215311520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:13.535925 run patchelf(pid=20067): Terminating (SIGINT) 21:53:13.722945 run patchelf(pid=20067): Terminated: ok {rc=0} 21:53:13.858206 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20056): Process ended prematurely: osmo-stp_10.42.42.5(pid=20056) [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20056)] [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 21:53:13.868767 tst ping_idle_ping.py:27: Test FAILED (7.6 sec) 21:53:13.898957 run osmo-hlr_10.42.42.2(pid=19856): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19856)] 21:53:13.951817 run osmo-hlr_10.42.42.2(pid=19856): stdout: | (launched: 2022-12-09_21:53:09.755478) 21:53:14.006055 run osmo-hlr_10.42.42.2(pid=19856): stderr: | 20221209215310094 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215310094 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215310094 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215310094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215310094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215310094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215310126 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215310138 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215310138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215310138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:14.061095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19835): Terminating (SIGTERM) 21:53:14.106116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19998): Terminating (SIGTERM) 21:53:14.152429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20066): Terminating (SIGTERM) 21:53:14.199107 --- ParallelTerminationStrategy: PID 19835 died... 21:53:14.220264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19835): Terminated: ok {rc=0} 21:53:14.270130 --- ParallelTerminationStrategy: PID 19998 died... 21:53:14.290851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19998): Terminated: ok {rc=0} 21:53:14.339737 --- ParallelTerminationStrategy: PID 20066 died... 21:53:14.360865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20066): Terminated: ok {rc=0} 21:53:14.453352 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:53:15.753685 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:53:15.760838 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:53:15.783207 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 21:53:15.823802 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 21:53:15.975941 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:53:16.019891 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 21:53:16.082882 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 21:53:16.655644 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 21:53:16.715863 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:16.728020 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:53:16.786124 tst cs_paging_gprs_active.py: using LAC 23904 21:53:16.922463 tst cs_paging_gprs_active.py: using RAC 189 21:53:17.059172 tst cs_paging_gprs_active.py: using CellId 23904 21:53:17.197058 tst cs_paging_gprs_active.py: using BVCI 23905 21:53:17.397503 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:17.413677 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:17.428220 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:17.450305 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:17.469109 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:17.486496 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:17.503435 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:17.517678 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:17.540877 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:17.714498 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:17.846846 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:53:18.093373 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:18.421609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20071): Launched 21:53:18.707373 run iperf3-srv_10.42.42.10(pid=20072): Launched 21:53:18.825630 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:53:19.034787 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:19.361629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20073): Launched 21:53:19.644617 run iperf3-srv_10.42.42.10(pid=20074): Launched 21:53:19.775618 tst cs_paging_gprs_active.py:38: start network... 21:53:19.984028 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:20.473786 run create_hlr_db(pid=20075): Launched 21:53:20.634789 bus /gobi_6: Setting Powered False 21:53:21.698010 run create_hlr_db(pid=20075): Terminated: ok {rc=0} 21:53:22.144811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20077): Launched 21:53:22.482405 run osmo-hlr_10.42.42.2(pid=20078): Launched 21:53:22.730831 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:23.467760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20080): Launched 21:53:23.804699 run osmo-stp_10.42.42.5(pid=20081): Launched 21:53:24.050933 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:53:24.772008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20083): Launched 21:53:24.905340 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:53:25.180046 run patchelf(pid=20084): Launched 21:53:25.381314 run osmo-stp_10.42.42.5(pid=20081): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20081)] 21:53:25.519596 run osmo-stp_10.42.42.5(pid=20081): stdout: | (launched: 2022-12-09_21:53:23.740377) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:25.659635 run osmo-stp_10.42.42.5(pid=20081): stderr: | 20221209215324080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215324080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215324080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215324085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215324085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215324085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215324085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:25.799249 run osmo-stp_10.42.42.5(pid=20081): stdout: | (launched: 2022-12-09_21:53:23.740377) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:25.932701 run osmo-stp_10.42.42.5(pid=20081): stderr: | 20221209215324080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215324080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215324080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215324085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215324085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215324085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215324085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:26.091046 run patchelf(pid=20084): Terminating (SIGINT) 21:53:26.275030 run patchelf(pid=20084): Terminated: ok {rc=0} 21:53:26.408046 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20081): Process ended prematurely: osmo-stp_10.42.42.5(pid=20081) [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20081)] [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 21:53:26.418273 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 21:53:26.446956 run osmo-hlr_10.42.42.2(pid=20078): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20078)] 21:53:26.497393 run osmo-hlr_10.42.42.2(pid=20078): stdout: | (launched: 2022-12-09_21:53:22.414298) 21:53:26.550280 run osmo-hlr_10.42.42.2(pid=20078): stderr: | 20221209215322772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215322772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215322772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215322772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215322772 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215322772 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215322794 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215322803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215322803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215322803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:26.602655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20071): Terminating (SIGTERM) 21:53:26.644741 run iperf3-srv_10.42.42.10(pid=20072): Terminating (SIGTERM) 21:53:26.686936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20073): Terminating (SIGTERM) 21:53:26.729051 run iperf3-srv_10.42.42.10(pid=20074): Terminating (SIGTERM) 21:53:26.770854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20077): Terminating (SIGTERM) 21:53:26.812688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20080): Terminating (SIGTERM) 21:53:26.854580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20083): Terminating (SIGTERM) 21:53:26.896780 --- ParallelTerminationStrategy: PID 20071 died... 21:53:26.916914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20071): Terminated: ok {rc=0} 21:53:26.963520 --- ParallelTerminationStrategy: PID 20072 died... 21:53:26.983150 run iperf3-srv_10.42.42.10(pid=20072): Terminated {rc=256} 21:53:27.029508 --- ParallelTerminationStrategy: PID 20073 died... 21:53:27.049156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20073): Terminated: ok {rc=0} 21:53:27.095658 --- ParallelTerminationStrategy: PID 20074 died... 21:53:27.115332 run iperf3-srv_10.42.42.10(pid=20074): Terminated {rc=256} 21:53:27.161727 --- ParallelTerminationStrategy: PID 20077 died... 21:53:27.181378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20077): Terminated: ok {rc=0} 21:53:27.227650 --- ParallelTerminationStrategy: PID 20080 died... 21:53:27.247327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20080): Terminated: ok {rc=0} 21:53:27.293747 --- ParallelTerminationStrategy: PID 20083 died... 21:53:27.313475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20083): Terminated: ok {rc=0} 21:53:27.401286 bus /gobi_0: Setting Powered False 21:53:28.499935 bus /gobi_0: Setting Powered False 21:53:29.616632 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 21:53:30.763090 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:30.774620 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:53:30.841263 tst iperf3.py: using LAC 23905 21:53:30.975977 tst iperf3.py: using RAC 190 21:53:31.100712 tst iperf3.py: using CellId 23905 21:53:31.235581 tst iperf3.py: using BVCI 23906 21:53:31.356883 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:31.368806 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:31.380458 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:31.392882 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:31.405241 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:31.417485 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:31.429832 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:31.442050 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:31.454427 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:31.577216 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:53:31.803137 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:32.195805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20085): Launched 21:53:32.491893 run iperf3-srv_10.42.42.10(pid=20086): Launched 21:53:32.615850 tst iperf3.py:8: start network... 21:53:32.836522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:33.339921 run create_hlr_db(pid=20087): Launched 21:53:33.471557 bus /gobi_6: Setting Powered False 21:53:34.537108 run create_hlr_db(pid=20087): Terminated: ok {rc=0} 21:53:34.990625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20089): Launched 21:53:35.316885 run osmo-hlr_10.42.42.2(pid=20090): Launched 21:53:35.440085 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:36.002731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20092): Launched 21:53:36.328439 run osmo-stp_10.42.42.5(pid=20093): Launched 21:53:36.452901 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:53:37.015559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20095): Launched 21:53:37.140363 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:53:37.415562 run patchelf(pid=20096): Launched 21:53:37.597683 run osmo-stp_10.42.42.5(pid=20093): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20093)] 21:53:37.736095 run osmo-stp_10.42.42.5(pid=20093): stdout: | (launched: 2022-12-09_21:53:36.269108) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:37.875951 run osmo-stp_10.42.42.5(pid=20093): stderr: | 20221209215336462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215336462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215336462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215336463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215336464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215336464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215336464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:38.015904 run osmo-stp_10.42.42.5(pid=20093): stdout: | (launched: 2022-12-09_21:53:36.269108) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:38.149344 run osmo-stp_10.42.42.5(pid=20093): stderr: | 20221209215336462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215336462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215336462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215336463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215336464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215336464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215336464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:38.307400 run patchelf(pid=20096): Terminating (SIGINT) 21:53:38.492347 run patchelf(pid=20096): Terminated: ok {rc=0} 21:53:38.626589 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20093): Process ended prematurely: osmo-stp_10.42.42.5(pid=20093) [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20093)] [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 21:53:38.636697 tst iperf3.py:8: Test FAILED (7.9 sec) 21:53:38.665334 run osmo-hlr_10.42.42.2(pid=20090): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20090)] 21:53:38.715655 run osmo-hlr_10.42.42.2(pid=20090): stdout: | (launched: 2022-12-09_21:53:35.257210) 21:53:38.767757 run osmo-hlr_10.42.42.2(pid=20090): stderr: | 20221209215335457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215335458 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215335458 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215335458 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215335458 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215335458 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215335506 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215335516 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215335517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215335517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:38.820165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20085): Terminating (SIGTERM) 21:53:38.862260 run iperf3-srv_10.42.42.10(pid=20086): Terminating (SIGTERM) 21:53:38.904163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20089): Terminating (SIGTERM) 21:53:38.946161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20092): Terminating (SIGTERM) 21:53:38.987955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20095): Terminating (SIGTERM) 21:53:39.030101 --- ParallelTerminationStrategy: PID 20085 died... 21:53:39.050186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20085): Terminated: ok {rc=0} 21:53:39.096629 --- ParallelTerminationStrategy: PID 20086 died... 21:53:39.116289 run iperf3-srv_10.42.42.10(pid=20086): Terminated {rc=256} 21:53:39.162359 --- ParallelTerminationStrategy: PID 20089 died... 21:53:39.181906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20089): Terminated: ok {rc=0} 21:53:39.227817 --- ParallelTerminationStrategy: PID 20092 died... 21:53:39.247344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20092): Terminated: ok {rc=0} 21:53:39.293259 --- ParallelTerminationStrategy: PID 20095 died... 21:53:39.312676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20095): Terminated: ok {rc=0} 21:53:39.400181 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 21:53:40.551729 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:40.563692 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:53:40.622411 tst iperf3m4.py: using LAC 23906 21:53:40.754822 tst iperf3m4.py: using RAC 191 21:53:40.882518 tst iperf3m4.py: using CellId 23906 21:53:41.008203 tst iperf3m4.py: using BVCI 23907 21:53:41.127300 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:41.138694 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:41.149828 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:41.160896 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:41.172002 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:41.183201 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:41.194426 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:41.205493 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:41.216614 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:41.336846 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:41.460248 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:41.580610 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:41.698113 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:53:41.902606 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:42.208247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20097): Launched 21:53:42.473521 run iperf3-srv_10.42.42.10(pid=20098): Launched 21:53:42.589343 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:53:42.794975 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:43.102320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20099): Launched 21:53:43.366044 run iperf3-srv_10.42.42.10(pid=20100): Launched 21:53:43.479493 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:53:43.682384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:43.986828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20101): Launched 21:53:44.250676 run iperf3-srv_10.42.42.10(pid=20102): Launched 21:53:44.364376 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:53:44.567004 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:44.871861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20103): Launched 21:53:45.136215 run iperf3-srv_10.42.42.10(pid=20104): Launched 21:53:45.249912 tst iperf3m4.py:8: start network... 21:53:45.452466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:45.930157 run create_hlr_db(pid=20105): Launched 21:53:46.072124 bus /gobi_6: Setting Powered False 21:53:47.133673 run create_hlr_db(pid=20105): Terminated: ok {rc=0} 21:53:47.563656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20107): Launched 21:53:47.869807 run osmo-hlr_10.42.42.2(pid=20108): Launched 21:53:47.986522 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:48.535876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20110): Launched 21:53:48.841300 run osmo-stp_10.42.42.5(pid=20111): Launched 21:53:48.956631 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:53:49.481844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20113): Launched 21:53:49.599624 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:53:49.859541 run patchelf(pid=20114): Launched 21:53:50.029429 run osmo-stp_10.42.42.5(pid=20111): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20111)] 21:53:50.158974 run osmo-stp_10.42.42.5(pid=20111): stdout: | (launched: 2022-12-09_21:53:48.784890) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:50.289563 run osmo-stp_10.42.42.5(pid=20111): stderr: | 20221209215348958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215348958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215348958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215348959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215348959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215348959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215348959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:50.420497 run osmo-stp_10.42.42.5(pid=20111): stdout: | (launched: 2022-12-09_21:53:48.784890) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:50.544776 run osmo-stp_10.42.42.5(pid=20111): stderr: | 20221209215348958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215348958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215348958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215348959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215348959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215348959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215348959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:50.691942 run patchelf(pid=20114): Terminating (SIGINT) 21:53:50.864876 run patchelf(pid=20114): Terminated: ok {rc=0} 21:53:50.988792 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20111): Process ended prematurely: osmo-stp_10.42.42.5(pid=20111) [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20111)] [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 21:53:50.998318 tst iperf3m4.py:8: Test FAILED (10.5 sec) 21:53:51.025914 run osmo-hlr_10.42.42.2(pid=20108): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20108)] 21:53:51.074007 run osmo-hlr_10.42.42.2(pid=20108): stdout: | (launched: 2022-12-09_21:53:47.812488) 21:53:51.123544 run osmo-hlr_10.42.42.2(pid=20108): stderr: | 20221209215347988 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215347988 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215347988 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215347988 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215347988 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215347988 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215347998 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215348007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215348007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215348007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:51.173423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20097): Terminating (SIGTERM) 21:53:51.213366 run iperf3-srv_10.42.42.10(pid=20098): Terminating (SIGTERM) 21:53:51.253207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20099): Terminating (SIGTERM) 21:53:51.293194 run iperf3-srv_10.42.42.10(pid=20100): Terminating (SIGTERM) 21:53:51.333141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20101): Terminating (SIGTERM) 21:53:51.373071 run iperf3-srv_10.42.42.10(pid=20102): Terminating (SIGTERM) 21:53:51.412713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20103): Terminating (SIGTERM) 21:53:51.452559 run iperf3-srv_10.42.42.10(pid=20104): Terminating (SIGTERM) 21:53:51.492221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20107): Terminating (SIGTERM) 21:53:51.532063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20110): Terminating (SIGTERM) 21:53:51.572004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20113): Terminating (SIGTERM) 21:53:51.612361 --- ParallelTerminationStrategy: PID 20097 died... 21:53:51.631563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20097): Terminated: ok {rc=0} 21:53:51.676150 --- ParallelTerminationStrategy: PID 20098 died... 21:53:51.694655 run iperf3-srv_10.42.42.10(pid=20098): Terminated {rc=256} 21:53:51.738725 --- ParallelTerminationStrategy: PID 20099 died... 21:53:51.757293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20099): Terminated: ok {rc=0} 21:53:51.801322 --- ParallelTerminationStrategy: PID 20100 died... 21:53:51.819803 run iperf3-srv_10.42.42.10(pid=20100): Terminated {rc=256} 21:53:51.863846 --- ParallelTerminationStrategy: PID 20101 died... 21:53:51.882919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20101): Terminated: ok {rc=0} 21:53:51.926980 --- ParallelTerminationStrategy: PID 20102 died... 21:53:51.945438 run iperf3-srv_10.42.42.10(pid=20102): Terminated {rc=256} 21:53:51.989494 --- ParallelTerminationStrategy: PID 20103 died... 21:53:52.007914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20103): Terminated: ok {rc=0} 21:53:52.052088 --- ParallelTerminationStrategy: PID 20104 died... 21:53:52.070760 run iperf3-srv_10.42.42.10(pid=20104): Terminated {rc=256} 21:53:52.114856 --- ParallelTerminationStrategy: PID 20107 died... 21:53:52.133503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20107): Terminated: ok {rc=0} 21:53:52.181593 --- ParallelTerminationStrategy: PID 20110 died... 21:53:52.201502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20110): Terminated: ok {rc=0} 21:53:52.248022 --- ParallelTerminationStrategy: PID 20113 died... 21:53:52.267746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20113): Terminated: ok {rc=0} 21:53:52.357212 bus /gobi_4: Setting Powered False 21:53:53.455553 bus /gobi_4: Setting Powered False 21:53:54.574447 bus /gobi_1: Setting Powered False 21:53:55.674400 bus /gobi_1: Setting Powered False 21:53:56.790185 bus /gobi_0: Setting Powered False 21:53:57.888311 bus /gobi_0: Setting Powered False 21:53:59.004758 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 21:54:00.107430 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:00.118946 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:54:00.175700 tst ping.py: using LAC 23907 21:54:00.294425 tst ping.py: using RAC 192 21:54:00.414020 tst ping.py: using CellId 23907 21:54:00.530718 tst ping.py: using BVCI 23908 21:54:00.638928 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:00.650069 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:00.660799 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:00.671629 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:00.682330 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:00.693100 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:00.704058 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:00.714928 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:54:00.829552 tst ping.py:19: start network... 21:54:01.037118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:54:01.515599 run create_hlr_db(pid=20115): Launched 21:54:01.722673 bus /gobi_6: Setting Powered False 21:54:02.782333 run create_hlr_db(pid=20115): Terminated: ok {rc=0} 21:54:03.223154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20117): Launched 21:54:03.543942 run osmo-hlr_10.42.42.2(pid=20118): Launched 21:54:03.666641 run osmo-stp_10.42.42.5: Starting osmo-stp 21:54:04.222474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20120): Launched 21:54:04.541815 run osmo-stp_10.42.42.5(pid=20121): Launched 21:54:04.664545 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:54:05.218900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20123): Launched 21:54:05.340354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:54:05.610372 run patchelf(pid=20124): Launched 21:54:05.787521 run osmo-stp_10.42.42.5(pid=20121): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20121)] 21:54:05.922815 run osmo-stp_10.42.42.5(pid=20121): stdout: | (launched: 2022-12-09_21:54:04.483014) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:06.059682 run osmo-stp_10.42.42.5(pid=20121): stderr: | 20221209215404675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215404676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215404676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215404676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215404677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215404677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215404677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:06.197158 run osmo-stp_10.42.42.5(pid=20121): stdout: | (launched: 2022-12-09_21:54:04.483014) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:06.327460 run osmo-stp_10.42.42.5(pid=20121): stderr: | 20221209215404675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215404676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215404676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215404676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215404677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215404677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215404677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:06.482123 run patchelf(pid=20124): Terminating (SIGINT) 21:54:06.662621 run patchelf(pid=20124): Terminated: ok {rc=0} 21:54:06.791945 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20121): Process ended prematurely: osmo-stp_10.42.42.5(pid=20121) [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20121)] [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 21:54:06.801418 tst ping.py:22: Test FAILED (6.7 sec) 21:54:06.829454 run osmo-hlr_10.42.42.2(pid=20118): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20118)] 21:54:06.879591 run osmo-hlr_10.42.42.2(pid=20118): stdout: | (launched: 2022-12-09_21:54:03.485299) 21:54:06.931208 run osmo-hlr_10.42.42.2(pid=20118): stderr: | 20221209215403683 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215403683 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215403683 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215403683 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215403683 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215403683 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215403695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215403703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215403704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215403704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:54:06.983173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20117): Terminating (SIGTERM) 21:54:07.025488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20120): Terminating (SIGTERM) 21:54:07.067362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20123): Terminating (SIGTERM) 21:54:07.109645 --- ParallelTerminationStrategy: PID 20117 died... 21:54:07.129765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20117): Terminated: ok {rc=0} 21:54:07.176183 --- ParallelTerminationStrategy: PID 20120 died... 21:54:07.195631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20120): Terminated: ok {rc=0} 21:54:07.242078 --- ParallelTerminationStrategy: PID 20123 died... 21:54:07.261756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20123): Terminated: ok {rc=0} 21:54:07.349517 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 21:54:08.438265 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:08.450681 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:54:08.510211 tst ping_idle_ping.py: using LAC 23908 21:54:08.637806 tst ping_idle_ping.py: using RAC 193 21:54:08.764324 tst ping_idle_ping.py: using CellId 23908 21:54:08.890453 tst ping_idle_ping.py: using BVCI 23909 21:54:09.006351 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:09.017782 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:09.028789 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:09.039943 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:09.051048 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:09.062180 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:09.073557 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:09.084561 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:54:09.202403 tst ping_idle_ping.py:24: start network... 21:54:09.419926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:54:09.918587 run create_hlr_db(pid=20125): Launched 21:54:10.047883 bus /gobi_6: Setting Powered False 21:54:11.112279 run create_hlr_db(pid=20125): Terminated: ok {rc=0} 21:54:11.542771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20127): Launched 21:54:11.844581 run osmo-hlr_10.42.42.2(pid=20128): Launched 21:54:11.961629 run osmo-stp_10.42.42.5: Starting osmo-stp 21:54:12.481632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20130): Launched 21:54:12.784594 run osmo-stp_10.42.42.5(pid=20131): Launched 21:54:12.899760 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:54:13.417756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20133): Launched 21:54:13.533418 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:54:13.788866 run patchelf(pid=20134): Launched 21:54:13.956016 run osmo-stp_10.42.42.5(pid=20131): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20131)] 21:54:14.083716 run osmo-stp_10.42.42.5(pid=20131): stdout: | (launched: 2022-12-09_21:54:12.728802) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:14.212753 run osmo-stp_10.42.42.5(pid=20131): stderr: | 20221209215412901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215412901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215412901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215412902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215412902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215412902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215412902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:14.342730 run osmo-stp_10.42.42.5(pid=20131): stdout: | (launched: 2022-12-09_21:54:12.728802) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:14.465828 run osmo-stp_10.42.42.5(pid=20131): stderr: | 20221209215412901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215412901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215412901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215412902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215412902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215412902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215412902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:14.611848 run patchelf(pid=20134): Terminating (SIGINT) 21:54:14.782374 run patchelf(pid=20134): Terminated: ok {rc=0} 21:54:14.905085 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20131): Process ended prematurely: osmo-stp_10.42.42.5(pid=20131) [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20131)] [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 21:54:14.914054 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 21:54:14.940907 run osmo-hlr_10.42.42.2(pid=20128): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20128)] 21:54:14.988857 run osmo-hlr_10.42.42.2(pid=20128): stdout: | (launched: 2022-12-09_21:54:11.788676) 21:54:15.038505 run osmo-hlr_10.42.42.2(pid=20128): stderr: | 20221209215411970 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215411970 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215411970 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215411970 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215411970 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215411970 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215411982 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215411990 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215411991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215411991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:54:15.088666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20127): Terminating (SIGTERM) 21:54:15.128638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20130): Terminating (SIGTERM) 21:54:15.168368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20133): Terminating (SIGTERM) 21:54:15.208216 --- ParallelTerminationStrategy: PID 20127 died... 21:54:15.227205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20127): Terminated: ok {rc=0} 21:54:15.271947 --- ParallelTerminationStrategy: PID 20130 died... 21:54:15.290675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20130): Terminated: ok {rc=0} 21:54:15.335030 --- ParallelTerminationStrategy: PID 20133 died... 21:54:15.353878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20133): Terminated: ok {rc=0} 21:54:15.438900 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:54:16.765073 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:54:16.776828 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:54:16.803587 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 21:54:16.842324 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:54:16.898976 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:54:16.927945 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 21:54:16.972695 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:54:17.509319 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2365 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 21:54:17.515425 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:17.526638 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:54:17.581655 tst switch_tch_pdch.py: using LAC 23909 21:54:17.713403 tst switch_tch_pdch.py: using RAC 194 21:54:17.838662 tst switch_tch_pdch.py: using CellId 23909 21:54:17.961519 tst switch_tch_pdch.py: using BVCI 23910 21:54:18.076573 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:18.088193 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:18.099672 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:18.110985 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:18.122197 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:18.134132 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:18.145752 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:18.157127 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:54:18.275978 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:54:18.394598 tst switch_tch_pdch.py:51: start network... 21:54:18.594628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:54:19.055224 run create_hlr_db(pid=20138): Launched 21:54:19.168815 bus /gobi_6: Setting Powered False 21:54:20.228568 run create_hlr_db(pid=20138): Terminated: ok {rc=0} 21:54:20.646079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20140): Launched 21:54:20.943548 run osmo-hlr_10.42.42.2(pid=20141): Launched 21:54:21.056656 run osmo-stp_10.42.42.5: Starting osmo-stp 21:54:21.587744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20143): Launched 21:54:21.885728 run osmo-stp_10.42.42.5(pid=20144): Launched 21:54:21.998716 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:54:22.511311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20146): Launched 21:54:22.625498 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:54:22.876865 run patchelf(pid=20147): Launched 21:54:23.042481 run osmo-stp_10.42.42.5(pid=20144): ERR: Terminated: ERROR {rc=1} [trial-2365↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20144)] 21:54:23.168848 run osmo-stp_10.42.42.5(pid=20144): stdout: | (launched: 2022-12-09_21:54:21.830470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:23.296805 run osmo-stp_10.42.42.5(pid=20144): stderr: | 20221209215422000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215422000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215422000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215422001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215422001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215422002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215422002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:23.424557 run osmo-stp_10.42.42.5(pid=20144): stdout: | (launched: 2022-12-09_21:54:21.830470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:23.546022 run osmo-stp_10.42.42.5(pid=20144): stderr: | 20221209215422000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215422000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215422000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215422001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215422001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215422002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215422002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:23.690483 run patchelf(pid=20147): Terminating (SIGINT) 21:54:23.859516 run patchelf(pid=20147): Terminated: ok {rc=0} 21:54:23.980664 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20144): Process ended prematurely: osmo-stp_10.42.42.5(pid=20144) [trial-2365↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20144)] [trial-2365↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 21:54:23.989561 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 21:54:24.016721 run osmo-hlr_10.42.42.2(pid=20141): ERR: Terminated: ERROR {rc=237} [trial-2365↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20141)] 21:54:24.064590 run osmo-hlr_10.42.42.2(pid=20141): stdout: | (launched: 2022-12-09_21:54:20.888375) 21:54:24.114124 run osmo-hlr_10.42.42.2(pid=20141): stderr: | 20221209215421066 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215421066 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215421066 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215421066 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215421066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215421066 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215421082 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215421092 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215421092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215421092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:54:24.163925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20140): Terminating (SIGTERM) 21:54:24.203700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20143): Terminating (SIGTERM) 21:54:24.243788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20146): Terminating (SIGTERM) 21:54:24.283707 --- ParallelTerminationStrategy: PID 20140 died... 21:54:24.302881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20140): Terminated: ok {rc=0} 21:54:24.347389 --- ParallelTerminationStrategy: PID 20143 died... 21:54:24.366005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20143): Terminated: ok {rc=0} 21:54:24.410405 --- ParallelTerminationStrategy: PID 20146 died... 21:54:24.429114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20146): Terminated: ok {rc=0} 21:54:24.516166 bus /gobi_0: Setting Powered False 21:54:25.616432 bus /gobi_0: Setting Powered False 21:54:26.733216 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 21:54:27.985342 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:54:27.991638 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 21:54:28.012824 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 21:54:28.048118 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 21:54:28.102676 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 21:54:28.124425 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 21:54:28.159343 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 21:54:28.714030 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2365 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 21:54:28.719106 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:28.730380 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 21:54:28.788548 tst switch_tch_pdch.py: using LAC 23910 21:54:28.914877 tst switch_tch_pdch.py: using RAC 195 21:54:29.040796 tst switch_tch_pdch.py: using CellId 23910 21:54:29.166222 tst switch_tch_pdch.py: using BVCI 23911 21:54:29.283284 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:29.294642 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:29.305784 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:29.316803 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:29.327877 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:29.338933 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:29.350268 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:29.361381 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:54:29.477942 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:54:29.598958 tst switch_tch_pdch.py:51: start network... 21:54:29.814922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:54:30.280671 run create_hlr_db(pid=20154): Launched 21:54:30.409199 bus /gobi_6: Setting Powered False 21:54:31.471616 run create_hlr_db(pid=20154): Terminated: ok {rc=0} 21:54:31.904428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20156): Launched 21:54:32.230005 run osmo-hlr_10.42.42.2(pid=20157): Launched 21:54:32.344810 run osmo-stp_10.42.42.5: Starting osmo-stp 21:54:32.852691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20159): Launched 21:54:33.152496 run osmo-stp_10.42.42.5(pid=20160): Launched 21:54:33.265680 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:54:33.753575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20162): Launched 21:54:33.868655 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:54:34.122942 run patchelf(pid=20163): Launched 21:54:34.288842 run osmo-stp_10.42.42.5(pid=20160): ERR: Terminated: ERROR {rc=1} [trial-2365↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20160)] 21:54:34.415676 run osmo-stp_10.42.42.5(pid=20160): stdout: | (launched: 2022-12-09_21:54:33.097270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:34.543844 run osmo-stp_10.42.42.5(pid=20160): stderr: | 20221209215433268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215433268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215433269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215433269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215433270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215433270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215433270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:34.672491 run osmo-stp_10.42.42.5(pid=20160): stdout: | (launched: 2022-12-09_21:54:33.097270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:34.794234 run osmo-stp_10.42.42.5(pid=20160): stderr: | 20221209215433268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215433268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215433269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215433269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215433270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215433270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215433270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:34.940095 run patchelf(pid=20163): Terminating (SIGINT) 21:54:35.110003 run patchelf(pid=20163): Terminated: ok {rc=0} 21:54:35.231219 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20160): Process ended prematurely: osmo-stp_10.42.42.5(pid=20160) [trial-2365↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20160)] [trial-2365↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 21:54:35.240098 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 21:54:35.267175 run osmo-hlr_10.42.42.2(pid=20157): ERR: Terminated: ERROR {rc=237} [trial-2365↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20157)] 21:54:35.314943 run osmo-hlr_10.42.42.2(pid=20157): stdout: | (launched: 2022-12-09_21:54:32.175021) 21:54:35.364778 run osmo-hlr_10.42.42.2(pid=20157): stderr: | 20221209215432352 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215432352 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215432352 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215432352 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215432352 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215432352 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215432370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215432379 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215432379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215432380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:54:35.414925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20156): Terminating (SIGTERM) 21:54:35.455304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20159): Terminating (SIGTERM) 21:54:35.495576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20162): Terminating (SIGTERM) 21:54:35.535882 --- ParallelTerminationStrategy: PID 20156 died... 21:54:35.555089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20156): Terminated: ok {rc=0} 21:54:35.599870 --- ParallelTerminationStrategy: PID 20159 died... 21:54:35.618547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20159): Terminated: ok {rc=0} 21:54:35.663153 --- ParallelTerminationStrategy: PID 20162 died... 21:54:35.681941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20162): Terminated: ok {rc=0} 21:54:35.767527 bus /gobi_0: Setting Powered False 21:54:36.868045 bus /gobi_0: Setting Powered False 21:54:37.982810 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_sms:oc2g --------------------------------------------------------------------- 21:54:39.224116 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:54:39.228107 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 21:54:39.249045 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 21:54:39.256345 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 21:54:39.309821 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 21:54:39.330217 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 21:54:39.337085 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 21:54:39.874241 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 21:54:39.879259 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 21:54:39.889857 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 21:54:39.925369 tst mo_mt_sms.py: using LAC 23911 21:54:40.043540 tst mo_mt_sms.py: using RAC 196 21:54:40.162988 tst mo_mt_sms.py: using CellId 23911 21:54:40.290822 tst mo_mt_sms.py: using BVCI 23912 21:54:40.409690 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 21:54:40.524415 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 21:54:40.643496 tst mo_mt_sms.py:9: start nitb and bts... 21:54:40.859596 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:54:41.510282 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20168): Launched 21:54:41.830920 run osmo-nitb_10.42.42.2(pid=20169): Launched 21:54:42.007709 run osmo-nitb_10.42.42.2(pid=20169): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20169)] 21:54:42.151167 run osmo-nitb_10.42.42.2(pid=20169): stdout: | (launched: 2022-12-09_21:54:41.772559) 21:54:42.296119 run osmo-nitb_10.42.42.2(pid=20169): stderr: | (launched: 2022-12-09_21:54:41.820007) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:54:42.441065 run osmo-nitb_10.42.42.2(pid=20169): stdout: | (launched: 2022-12-09_21:54:41.772559) 21:54:42.580065 run osmo-nitb_10.42.42.2(pid=20169): stderr: | (launched: 2022-12-09_21:54:41.820007) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20169): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20169) [trial-2365↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20169)] 21:54:42.951028 tst osmo-nitb_10.42.42.2(pid=20169): stdout: | (launched: 2022-12-09_21:54:41.772559) 21:54:43.080600 tst osmo-nitb_10.42.42.2(pid=20169): stderr: | (launched: 2022-12-09_21:54:41.820007) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:54:43.234094 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20169): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20169) [trial-2365↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20169)] [trial-2365↪nitb_sms:oc2g↪mo_mt_sms.py:11] 21:54:43.243021 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 21:54:43.249927 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20168): Terminating (SIGTERM) 21:54:43.460270 --- ParallelTerminationStrategy: PID 20168 died... 21:54:43.481680 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20168): Terminated: ok {rc=0} 21:54:43.570460 bus /sierra_3: Setting Powered False 21:54:44.670020 bus /sierra_3: Setting Powered False 21:54:45.785972 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 sms:oc2g --------------------------------------------------------------------- 21:54:46.986536 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:54:46.995981 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 21:54:47.030823 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 21:54:47.066555 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 21:54:47.118103 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 21:54:47.141235 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 21:54:47.172427 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 21:54:47.715320 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 sms:oc2g mo_mt_sms.py ---------------------------------------------- 21:54:47.720671 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:47.731739 tst sms:oc2g: Using 1 x bts (candidates: 1) 21:54:47.766955 tst mo_mt_sms.py: using LAC 23912 21:54:47.892844 tst mo_mt_sms.py: using RAC 197 21:54:48.017968 tst mo_mt_sms.py: using CellId 23912 21:54:48.143876 tst mo_mt_sms.py: using BVCI 23913 21:54:48.259005 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:48.269880 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:48.280588 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:48.291389 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:48.302130 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:48.312691 tst sms:oc2g: Using 1 x modem (candidates: 2) 21:54:48.427561 tst sms:oc2g: Using 1 x modem (candidates: 2) 21:54:48.542535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:54:49.004204 run create_hlr_db(pid=20173): Launched 21:54:49.118783 bus /sierra_2: Setting Powered False 21:54:50.178813 run create_hlr_db(pid=20173): Terminated: ok {rc=0} 21:54:50.617905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20175): Launched 21:54:50.936612 run osmo-hlr_10.42.42.2(pid=20176): Launched 21:54:51.058959 run osmo-stp_10.42.42.5: Starting osmo-stp 21:54:51.614425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20179): Launched 21:54:51.934377 run osmo-stp_10.42.42.5(pid=20180): Launched 21:54:52.055494 run osmo-msc_10.42.42.6: Starting osmo-msc 21:54:52.633282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20182): Launched 21:54:52.952864 run osmo-msc_10.42.42.6(pid=20183): Launched 21:54:53.130782 run osmo-stp_10.42.42.5(pid=20180): ERR: Terminated: ERROR {rc=1} [trial-2365↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20180)] 21:54:53.265717 run osmo-stp_10.42.42.5(pid=20180): stdout: | (launched: 2022-12-09_21:54:51.875383) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:53.400753 run osmo-stp_10.42.42.5(pid=20180): stderr: | 20221209215452067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215452067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215452067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215452068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215452070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215452070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215452070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:53.534953 run osmo-stp_10.42.42.5(pid=20180): stdout: | (launched: 2022-12-09_21:54:51.875383) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:53.663454 run osmo-stp_10.42.42.5(pid=20180): stderr: | 20221209215452067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215452067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215452067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215452068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215452070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215452070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215452070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:53.815649 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20180): Process ended prematurely: osmo-stp_10.42.42.5(pid=20180) [trial-2365↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20180)] [trial-2365↪sms:oc2g↪mo_mt_sms.py:16] 21:54:53.824557 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 21:54:53.852446 run osmo-hlr_10.42.42.2(pid=20176): ERR: Terminated: ERROR {rc=237} [trial-2365↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20176)] 21:54:53.902829 run osmo-hlr_10.42.42.2(pid=20176): stdout: | (launched: 2022-12-09_21:54:50.878274) 21:54:53.954991 run osmo-hlr_10.42.42.2(pid=20176): stderr: | 20221209215451076 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215451076 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215451076 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215451076 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215451076 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215451076 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215451090 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215451098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215451098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215451098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:54:54.027582 run osmo-msc_10.42.42.6(pid=20183): ERR: Terminated: ERROR {rc=2} [trial-2365↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20183)] 21:54:54.078136 run osmo-msc_10.42.42.6(pid=20183): stdout: | (launched: 2022-12-09_21:54:52.894425) 21:54:54.130279 run osmo-msc_10.42.42.6(pid=20183): stderr: | 20221209215453218 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215453218 DLGLOBAL DEBUG validating counter group 0x7f9345129c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215453218 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215453218 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215453218 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215453218 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215453220 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215453220 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215453221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215453221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:54:54.182473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20175): Terminating (SIGTERM) 21:54:54.224177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20179): Terminating (SIGTERM) 21:54:54.266209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20182): Terminating (SIGTERM) 21:54:54.308744 --- ParallelTerminationStrategy: PID 20175 died... 21:54:54.328627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20175): Terminated: ok {rc=0} 21:54:54.375482 --- ParallelTerminationStrategy: PID 20179 died... 21:54:54.395237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20179): Terminated: ok {rc=0} 21:54:54.441931 --- ParallelTerminationStrategy: PID 20182 died... 21:54:54.461654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20182): Terminated: ok {rc=0} 21:54:54.549415 bus /sierra_3: Setting Powered False 21:54:55.651074 bus /sierra_3: Setting Powered False 21:54:56.770816 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_ussd:oc2g --------------------------------------------------------------------- 21:54:57.988255 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:54:57.992111 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 21:54:58.013340 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 21:54:58.020792 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 21:54:58.055540 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 21:54:58.076536 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 21:54:58.083531 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 21:54:58.609411 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2365 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 21:54:58.614796 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 21:54:58.627857 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 21:54:58.664530 tst assert_extension.py: using LAC 23913 21:54:58.790895 tst assert_extension.py: using RAC 198 21:54:58.915040 tst assert_extension.py: using CellId 23913 21:54:59.039858 tst assert_extension.py: using BVCI 23914 21:54:59.156810 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 21:54:59.269600 tst assert_extension.py:10: start nitb and bts... 21:54:59.471367 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:55:00.081269 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20189): Launched 21:55:00.380117 run osmo-nitb_10.42.42.2(pid=20190): Launched 21:55:00.545243 run osmo-nitb_10.42.42.2(pid=20190): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20190)] 21:55:00.679770 run osmo-nitb_10.42.42.2(pid=20190): stdout: | (launched: 2022-12-09_21:55:00.324873) 21:55:00.815421 run osmo-nitb_10.42.42.2(pid=20190): stderr: | (launched: 2022-12-09_21:55:00.369309) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:55:00.982284 run osmo-nitb_10.42.42.2(pid=20190): stdout: | (launched: 2022-12-09_21:55:00.324873) 21:55:01.117531 run osmo-nitb_10.42.42.2(pid=20190): stderr: | (launched: 2022-12-09_21:55:00.369309) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20190): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20190) [trial-2365↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20190)] 21:55:01.492132 tst osmo-nitb_10.42.42.2(pid=20190): stdout: | (launched: 2022-12-09_21:55:00.324873) 21:55:01.657989 tst osmo-nitb_10.42.42.2(pid=20190): stderr: | (launched: 2022-12-09_21:55:00.369309) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:55:01.885504 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20190): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20190) [trial-2365↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20190)] [trial-2365↪nitb_ussd:oc2g↪assert_extension.py:12] 21:55:01.899142 tst assert_extension.py:12: Test FAILED (3.3 sec) 21:55:01.909559 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20189): Terminating (SIGTERM) 21:55:02.127864 --- ParallelTerminationStrategy: PID 20189 died... 21:55:02.156746 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20189): Terminated: ok {rc=0} 21:55:02.300080 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 ussd:oc2g --------------------------------------------------------------------- 21:55:03.476703 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:55:03.480830 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 21:55:03.502572 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 21:55:03.529901 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 21:55:03.566179 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 21:55:03.587902 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 21:55:03.615034 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 21:55:04.141309 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2365 ussd:oc2g assert_extension.py ---------------------------------------------- 21:55:04.146416 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:04.156921 tst ussd:oc2g: Using 1 x bts (candidates: 1) 21:55:04.191784 tst assert_extension.py: using LAC 23914 21:55:04.308103 tst assert_extension.py: using RAC 199 21:55:04.429128 tst assert_extension.py: using CellId 23914 21:55:04.545956 tst assert_extension.py: using BVCI 23915 21:55:04.655372 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:04.665840 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:04.676080 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:04.686572 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:04.697097 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:04.707509 tst ussd:oc2g: Using 1 x modem (candidates: 1) 21:55:04.823144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:05.318488 run create_hlr_db(pid=20205): Launched 21:55:05.448658 bus /sierra_2: Setting Powered False 21:55:06.512289 run create_hlr_db(pid=20205): Terminated: ok {rc=0} 21:55:06.959835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20207): Launched 21:55:07.279839 run osmo-hlr_10.42.42.2(pid=20208): Launched 21:55:07.403270 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:07.966800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20210): Launched 21:55:08.286282 run osmo-stp_10.42.42.5(pid=20211): Launched 21:55:08.407995 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:08.982757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20213): Launched 21:55:09.301372 run osmo-msc_10.42.42.6(pid=20214): Launched 21:55:09.482573 run osmo-stp_10.42.42.5(pid=20211): ERR: Terminated: ERROR {rc=1} [trial-2365↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20211)] 21:55:09.619118 run osmo-stp_10.42.42.5(pid=20211): stdout: | (launched: 2022-12-09_21:55:08.227825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:09.756451 run osmo-stp_10.42.42.5(pid=20211): stderr: | 20221209215508420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215508420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215508421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215508421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215508422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215508422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215508422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:09.892102 run osmo-stp_10.42.42.5(pid=20211): stdout: | (launched: 2022-12-09_21:55:08.227825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:10.020312 run osmo-stp_10.42.42.5(pid=20211): stderr: | 20221209215508420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215508420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215508421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215508421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215508422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215508422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215508422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:10.174103 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20211): Process ended prematurely: osmo-stp_10.42.42.5(pid=20211) [trial-2365↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20211)] [trial-2365↪ussd:oc2g↪assert_extension.py:17] 21:55:10.183122 tst assert_extension.py:17: Test FAILED (6.0 sec) 21:55:10.210623 run osmo-hlr_10.42.42.2(pid=20208): ERR: Terminated: ERROR {rc=237} [trial-2365↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20208)] 21:55:10.260490 run osmo-hlr_10.42.42.2(pid=20208): stdout: | (launched: 2022-12-09_21:55:07.221301) 21:55:10.312259 run osmo-hlr_10.42.42.2(pid=20208): stderr: | 20221209215507419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215507419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215507419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215507420 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215507420 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215507420 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215507432 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215507440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215507440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215507440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:55:10.384120 run osmo-msc_10.42.42.6(pid=20214): ERR: Terminated: ERROR {rc=2} [trial-2365↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20214)] 21:55:10.434017 run osmo-msc_10.42.42.6(pid=20214): stdout: | (launched: 2022-12-09_21:55:09.242881) 21:55:10.485483 run osmo-msc_10.42.42.6(pid=20214): stderr: | 20221209215509562 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215509562 DLGLOBAL DEBUG validating counter group 0x7fb121ba9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215509562 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215509562 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215509563 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215509563 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215509564 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215509565 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215509565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215509565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:55:10.537587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20207): Terminating (SIGTERM) 21:55:10.579472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20210): Terminating (SIGTERM) 21:55:10.621338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20213): Terminating (SIGTERM) 21:55:10.663515 --- ParallelTerminationStrategy: PID 20207 died... 21:55:10.683576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20207): Terminated: ok {rc=0} 21:55:10.729880 --- ParallelTerminationStrategy: PID 20210 died... 21:55:10.749484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20210): Terminated: ok {rc=0} 21:55:10.795542 --- ParallelTerminationStrategy: PID 20213 died... 21:55:10.815007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20213): Terminated: ok {rc=0} 21:55:10.902817 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 21:55:12.102315 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:55:12.109687 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 21:55:12.131372 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 21:55:12.158589 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 21:55:12.212033 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 21:55:12.233285 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 21:55:12.260170 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 21:55:12.812116 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 21:55:12.865856 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:12.877722 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:55:12.935512 tst mo_mt_call.py: using LAC 23915 21:55:13.064600 tst mo_mt_call.py: using RAC 200 21:55:13.189340 tst mo_mt_call.py: using CellId 23915 21:55:13.323683 tst mo_mt_call.py: using BVCI 23916 21:55:13.447586 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:13.459623 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:13.471346 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:13.484115 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:13.496678 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:13.509725 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:55:13.631597 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:55:13.751425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:14.234207 run create_hlr_db(pid=20532): Launched 21:55:14.389020 bus /sierra_2: Setting Powered False 21:55:15.449868 run create_hlr_db(pid=20532): Terminated: ok {rc=0} 21:55:15.889715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20573): Launched 21:55:16.236454 run osmo-hlr_10.42.42.2(pid=20574): Launched 21:55:16.487416 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:17.082266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20576): Launched 21:55:17.403438 run osmo-stp_10.42.42.5(pid=20577): Launched 21:55:17.524670 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:18.074857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20579): Launched 21:55:18.378440 run osmo-msc_10.42.42.6(pid=20580): Launched 21:55:18.547368 run osmo-stp_10.42.42.5(pid=20577): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20577)] 21:55:18.675877 run osmo-stp_10.42.42.5(pid=20577): stdout: | (launched: 2022-12-09_21:55:17.346103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:18.805339 run osmo-stp_10.42.42.5(pid=20577): stderr: | 20221209215517518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215517518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215517518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215517519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215517519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215517519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215517519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:18.932565 run osmo-stp_10.42.42.5(pid=20577): stdout: | (launched: 2022-12-09_21:55:17.346103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:19.053269 run osmo-stp_10.42.42.5(pid=20577): stderr: | 20221209215517518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215517518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215517518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215517519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215517519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215517519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215517519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:19.198567 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20577): Process ended prematurely: osmo-stp_10.42.42.5(pid=20577) [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20577)] [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 21:55:19.207539 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:55:19.238239 run osmo-hlr_10.42.42.2(pid=20574): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20574)] 21:55:19.288565 run osmo-hlr_10.42.42.2(pid=20574): stdout: | (launched: 2022-12-09_21:55:16.170276) 21:55:19.340516 run osmo-hlr_10.42.42.2(pid=20574): stderr: | 20221209215516441 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215516441 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215516441 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215516441 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215516441 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215516441 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215516459 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215516468 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215516469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215516469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:55:19.413342 run osmo-msc_10.42.42.6(pid=20580): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20580)] 21:55:19.463822 run osmo-msc_10.42.42.6(pid=20580): stdout: | (launched: 2022-12-09_21:55:18.322469) 21:55:19.515551 run osmo-msc_10.42.42.6(pid=20580): stderr: | 20221209215518596 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215518596 DLGLOBAL DEBUG validating counter group 0x7f4f7b622c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215518596 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215518596 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215518596 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215518597 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215518598 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215518599 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215518599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215518599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:55:19.568015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20573): Terminating (SIGTERM) 21:55:19.610001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20576): Terminating (SIGTERM) 21:55:19.651857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20579): Terminating (SIGTERM) 21:55:19.693899 --- ParallelTerminationStrategy: PID 20573 died... 21:55:19.714029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20573): Terminated: ok {rc=0} 21:55:19.760379 --- ParallelTerminationStrategy: PID 20576 died... 21:55:19.780257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20576): Terminated: ok {rc=0} 21:55:19.826563 --- ParallelTerminationStrategy: PID 20579 died... 21:55:19.846401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20579): Terminated: ok {rc=0} 21:55:19.933571 bus /sierra_3: Setting Powered False 21:55:21.032156 bus /sierra_3: Setting Powered False 21:55:22.148693 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 21:55:23.302419 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:23.315074 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:55:23.374541 tst mo_mt_call_osmux.py: using LAC 23916 21:55:23.502682 tst mo_mt_call_osmux.py: using RAC 201 21:55:23.631107 tst mo_mt_call_osmux.py: using CellId 23916 21:55:23.760143 tst mo_mt_call_osmux.py: using BVCI 23917 21:55:23.875580 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:23.887620 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:23.900488 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:23.912162 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:23.924030 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:23.935936 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:55:24.058848 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:55:24.179640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:24.671639 run create_hlr_db(pid=20757): Launched 21:55:24.828282 bus /sierra_2: Setting Powered False 21:55:25.890611 run create_hlr_db(pid=20757): Terminated: ok {rc=0} 21:55:26.329776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20759): Launched 21:55:26.668348 run osmo-hlr_10.42.42.2(pid=20760): Launched 21:55:26.913621 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:27.649670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20762): Launched 21:55:27.991137 run osmo-stp_10.42.42.5(pid=20763): Launched 21:55:28.239940 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:28.921608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20766): Launched 21:55:29.250324 run osmo-msc_10.42.42.6(pid=20767): Launched 21:55:29.431578 run osmo-stp_10.42.42.5(pid=20763): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20763)] 21:55:29.572563 run osmo-stp_10.42.42.5(pid=20763): stdout: | (launched: 2022-12-09_21:55:27.924179) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:29.711237 run osmo-stp_10.42.42.5(pid=20763): stderr: | 20221209215528228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215528228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215528229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215528229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215528230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215528230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215528230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:29.848092 run osmo-stp_10.42.42.5(pid=20763): stdout: | (launched: 2022-12-09_21:55:27.924179) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:29.977807 run osmo-stp_10.42.42.5(pid=20763): stderr: | 20221209215528228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215528228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215528229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215528229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215528230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215528230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215528230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:30.133315 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20763): Process ended prematurely: osmo-stp_10.42.42.5(pid=20763) [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20763)] [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 21:55:30.142936 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 21:55:30.170896 run osmo-hlr_10.42.42.2(pid=20760): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20760)] 21:55:30.221488 run osmo-hlr_10.42.42.2(pid=20760): stdout: | (launched: 2022-12-09_21:55:26.597468) 21:55:30.273523 run osmo-hlr_10.42.42.2(pid=20760): stderr: | 20221209215526947 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215526947 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215526947 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215526947 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215526947 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215526947 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215526966 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215526978 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215526978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215526978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:55:30.346154 run osmo-msc_10.42.42.6(pid=20767): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20767)] 21:55:30.396755 run osmo-msc_10.42.42.6(pid=20767): stdout: | (launched: 2022-12-09_21:55:29.190392) 21:55:30.448672 run osmo-msc_10.42.42.6(pid=20767): stderr: | 20221209215529518 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215529518 DLGLOBAL DEBUG validating counter group 0x7f17325c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215529518 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215529518 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215529518 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215529519 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215529520 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215529521 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215529521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215529521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:55:30.500896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20759): Terminating (SIGTERM) 21:55:30.542787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20762): Terminating (SIGTERM) 21:55:30.585780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20766): Terminating (SIGTERM) 21:55:30.628242 --- ParallelTerminationStrategy: PID 20759 died... 21:55:30.648487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20759): Terminated: ok {rc=0} 21:55:30.695396 --- ParallelTerminationStrategy: PID 20762 died... 21:55:30.715220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20762): Terminated: ok {rc=0} 21:55:30.761852 --- ParallelTerminationStrategy: PID 20766 died... 21:55:30.781540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20766): Terminated: ok {rc=0} 21:55:30.887119 bus /sierra_3: Setting Powered False 21:55:31.995995 bus /sierra_3: Setting Powered False 21:55:33.118112 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 21:55:34.352435 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:55:34.360208 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 21:55:34.381835 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 21:55:34.408265 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 21:55:34.459846 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 21:55:34.480137 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 21:55:34.506527 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 21:55:35.056693 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 21:55:35.105816 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:35.116684 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:55:35.170278 tst mo_mt_call.py: using LAC 23917 21:55:35.290244 tst mo_mt_call.py: using RAC 202 21:55:35.412244 tst mo_mt_call.py: using CellId 23917 21:55:35.531154 tst mo_mt_call.py: using BVCI 23918 21:55:35.641897 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:35.652861 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:35.663688 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:35.674714 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:35.685767 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:35.696638 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:55:35.815265 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:55:35.931408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:36.407769 run create_hlr_db(pid=20772): Launched 21:55:36.524397 bus /sierra_2: Setting Powered False 21:55:37.586052 run create_hlr_db(pid=20772): Terminated: ok {rc=0} 21:55:38.013625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20774): Launched 21:55:38.321672 run osmo-hlr_10.42.42.2(pid=20775): Launched 21:55:38.439262 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:38.978589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20777): Launched 21:55:39.282786 run osmo-stp_10.42.42.5(pid=20778): Launched 21:55:39.399077 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:39.949798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20780): Launched 21:55:40.257202 run osmo-msc_10.42.42.6(pid=20781): Launched 21:55:40.428599 run osmo-stp_10.42.42.5(pid=20778): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20778)] 21:55:40.558543 run osmo-stp_10.42.42.5(pid=20778): stdout: | (launched: 2022-12-09_21:55:39.226843) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:40.688609 run osmo-stp_10.42.42.5(pid=20778): stderr: | 20221209215539397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215539397 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215539398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215539398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215539398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215539399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215539399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:40.816129 run osmo-stp_10.42.42.5(pid=20778): stdout: | (launched: 2022-12-09_21:55:39.226843) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:40.937729 run osmo-stp_10.42.42.5(pid=20778): stderr: | 20221209215539397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215539397 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215539398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215539398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215539398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215539399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215539399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:41.082954 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20778): Process ended prematurely: osmo-stp_10.42.42.5(pid=20778) [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20778)] [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 21:55:41.091867 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 21:55:41.119072 run osmo-hlr_10.42.42.2(pid=20775): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20775)] 21:55:41.167359 run osmo-hlr_10.42.42.2(pid=20775): stdout: | (launched: 2022-12-09_21:55:38.265275) 21:55:41.217265 run osmo-hlr_10.42.42.2(pid=20775): stderr: | 20221209215538443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215538443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215538443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215538443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215538443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215538443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215538455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215538463 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215538464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215538464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:55:41.286618 run osmo-msc_10.42.42.6(pid=20781): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20781)] 21:55:41.334576 run osmo-msc_10.42.42.6(pid=20781): stdout: | (launched: 2022-12-09_21:55:40.200434) 21:55:41.384176 run osmo-msc_10.42.42.6(pid=20781): stderr: | 20221209215540475 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215540475 DLGLOBAL DEBUG validating counter group 0x7f759a42dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215540475 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215540475 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215540475 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215540476 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215540477 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215540478 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215540478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215540479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:55:41.434410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20774): Terminating (SIGTERM) 21:55:41.474301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20777): Terminating (SIGTERM) 21:55:41.514284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20780): Terminating (SIGTERM) 21:55:41.554449 --- ParallelTerminationStrategy: PID 20774 died... 21:55:41.573575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20774): Terminated: ok {rc=0} 21:55:41.618485 --- ParallelTerminationStrategy: PID 20777 died... 21:55:41.636997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20777): Terminated: ok {rc=0} 21:55:41.680836 --- ParallelTerminationStrategy: PID 20780 died... 21:55:41.699776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20780): Terminated: ok {rc=0} 21:55:41.785865 bus /sierra_3: Setting Powered False 21:55:42.884877 bus /sierra_3: Setting Powered False 21:55:44.001398 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 21:55:45.150254 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:45.162338 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:55:45.221126 tst mo_mt_call_osmux.py: using LAC 23918 21:55:45.352542 tst mo_mt_call_osmux.py: using RAC 203 21:55:45.481280 tst mo_mt_call_osmux.py: using CellId 23918 21:55:45.610755 tst mo_mt_call_osmux.py: using BVCI 23919 21:55:45.731481 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:45.742819 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:45.753958 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:45.765099 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:45.776287 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:45.787463 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:55:45.933387 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:55:46.081782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:46.599812 run create_hlr_db(pid=20783): Launched 21:55:46.762272 bus /sierra_2: Setting Powered False 21:55:47.823283 run create_hlr_db(pid=20783): Terminated: ok {rc=0} 21:55:48.280362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20785): Launched 21:55:48.605740 run osmo-hlr_10.42.42.2(pid=20786): Launched 21:55:48.730767 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:49.294222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20788): Launched 21:55:49.620404 run osmo-stp_10.42.42.5(pid=20789): Launched 21:55:49.745076 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:50.332639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20791): Launched 21:55:50.658348 run osmo-msc_10.42.42.6(pid=20792): Launched 21:55:50.839858 run osmo-stp_10.42.42.5(pid=20789): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20789)] 21:55:50.976248 run osmo-stp_10.42.42.5(pid=20789): stdout: | (launched: 2022-12-09_21:55:49.560191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:51.114013 run osmo-stp_10.42.42.5(pid=20789): stderr: | 20221209215549755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215549755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215549756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215549756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215549756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215549756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215549757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:51.250766 run osmo-stp_10.42.42.5(pid=20789): stdout: | (launched: 2022-12-09_21:55:49.560191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:51.380078 run osmo-stp_10.42.42.5(pid=20789): stderr: | 20221209215549755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215549755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215549756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215549756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215549756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215549756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215549757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:51.534890 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20789): Process ended prematurely: osmo-stp_10.42.42.5(pid=20789) [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20789)] [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 21:55:51.544218 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 21:55:51.572056 run osmo-hlr_10.42.42.2(pid=20786): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20786)] 21:55:51.622428 run osmo-hlr_10.42.42.2(pid=20786): stdout: | (launched: 2022-12-09_21:55:48.545735) 21:55:51.674472 run osmo-hlr_10.42.42.2(pid=20786): stderr: | 20221209215548747 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215548747 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215548747 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215548747 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215548747 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215548747 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215548762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215548772 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215548772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215548772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:55:51.746789 run osmo-msc_10.42.42.6(pid=20792): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20792)] 21:55:51.796654 run osmo-msc_10.42.42.6(pid=20792): stdout: | (launched: 2022-12-09_21:55:50.598564) 21:55:51.848261 run osmo-msc_10.42.42.6(pid=20792): stderr: | 20221209215550924 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215550924 DLGLOBAL DEBUG validating counter group 0x7f93305aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215550925 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215550925 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215550925 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215550925 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215550927 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215550927 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215550927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215550927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:55:51.900144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20785): Terminating (SIGTERM) 21:55:51.941842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20788): Terminating (SIGTERM) 21:55:51.983484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20791): Terminating (SIGTERM) 21:55:52.025449 --- ParallelTerminationStrategy: PID 20785 died... 21:55:52.045196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20785): Terminated: ok {rc=0} 21:55:52.091364 --- ParallelTerminationStrategy: PID 20788 died... 21:55:52.110770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20788): Terminated: ok {rc=0} 21:55:52.157070 --- ParallelTerminationStrategy: PID 20791 died... 21:55:52.176542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20791): Terminated: ok {rc=0} 21:55:52.263824 bus /sierra_3: Setting Powered False 21:55:53.360677 bus /sierra_3: Setting Powered False 21:55:54.476343 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 21:55:55.713279 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:55:55.720212 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 21:55:55.741583 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 21:55:55.768715 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 21:55:55.822394 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 21:55:55.844807 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 21:55:55.872053 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 21:55:56.421698 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 21:55:56.473630 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:56.485009 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:55:56.541874 tst mo_mt_call.py: using LAC 23919 21:55:56.672579 tst mo_mt_call.py: using RAC 204 21:55:56.802343 tst mo_mt_call.py: using CellId 23919 21:55:56.930596 tst mo_mt_call.py: using BVCI 23920 21:55:57.051771 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:57.063189 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:57.074390 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:57.085633 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:57.096784 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:57.108017 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:55:57.223512 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:55:57.339581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:57.813360 run create_hlr_db(pid=20797): Launched 21:55:57.930480 bus /sierra_2: Setting Powered False 21:55:58.991323 run create_hlr_db(pid=20797): Terminated: ok {rc=0} 21:55:59.416258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20799): Launched 21:55:59.721615 run osmo-hlr_10.42.42.2(pid=20800): Launched 21:55:59.838714 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:00.367891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20802): Launched 21:56:00.674309 run osmo-stp_10.42.42.5(pid=20803): Launched 21:56:00.798907 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:01.505712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20805): Launched 21:56:01.832219 run osmo-msc_10.42.42.6(pid=20806): Launched 21:56:02.233830 run osmo-stp_10.42.42.5(pid=20803): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20803)] 21:56:02.427816 run osmo-stp_10.42.42.5(pid=20803): stdout: | (launched: 2022-12-09_21:56:00.617851) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:02.567660 run osmo-stp_10.42.42.5(pid=20803): stderr: | 20221209215600804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215600805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215600805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215600805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215600807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215600808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215600808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:02.705179 run osmo-stp_10.42.42.5(pid=20803): stdout: | (launched: 2022-12-09_21:56:00.617851) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:02.834755 run osmo-stp_10.42.42.5(pid=20803): stderr: | 20221209215600804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215600805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215600805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215600805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215600807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215600808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215600808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:02.990103 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20803): Process ended prematurely: osmo-stp_10.42.42.5(pid=20803) [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20803)] [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 21:56:02.999722 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 21:56:03.027922 run osmo-hlr_10.42.42.2(pid=20800): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20800)] 21:56:03.078306 run osmo-hlr_10.42.42.2(pid=20800): stdout: | (launched: 2022-12-09_21:55:59.665189) 21:56:03.130368 run osmo-hlr_10.42.42.2(pid=20800): stderr: | 20221209215559840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215559840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215559841 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215559841 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215559841 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215559841 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215559853 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215559861 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215559862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215559862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:03.202778 run osmo-msc_10.42.42.6(pid=20806): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20806)] 21:56:03.252829 run osmo-msc_10.42.42.6(pid=20806): stdout: | (launched: 2022-12-09_21:56:01.772522) 21:56:03.304519 run osmo-msc_10.42.42.6(pid=20806): stderr: | 20221209215602422 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215602422 DLGLOBAL DEBUG validating counter group 0x7f1ad68cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215602422 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215602422 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215602423 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215602423 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215602425 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215602425 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215602425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215602425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:03.356411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20799): Terminating (SIGTERM) 21:56:03.398215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20802): Terminating (SIGTERM) 21:56:03.440031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20805): Terminating (SIGTERM) 21:56:03.482137 --- ParallelTerminationStrategy: PID 20799 died... 21:56:03.502256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20799): Terminated: ok {rc=0} 21:56:03.549089 --- ParallelTerminationStrategy: PID 20802 died... 21:56:03.568785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20802): Terminated: ok {rc=0} 21:56:03.615471 --- ParallelTerminationStrategy: PID 20805 died... 21:56:03.635099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20805): Terminated: ok {rc=0} 21:56:03.723118 bus /sierra_3: Setting Powered False 21:56:04.822842 bus /sierra_3: Setting Powered False 21:56:05.940310 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 21:56:07.091321 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:07.103398 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:56:07.166922 tst mo_mt_call_osmux.py: using LAC 23920 21:56:07.294962 tst mo_mt_call_osmux.py: using RAC 205 21:56:07.422323 tst mo_mt_call_osmux.py: using CellId 23920 21:56:07.551700 tst mo_mt_call_osmux.py: using BVCI 23921 21:56:07.671985 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:07.683661 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:07.694875 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:07.706126 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:07.717393 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:07.728572 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:56:07.845367 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:56:07.965122 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:08.470347 run create_hlr_db(pid=20808): Launched 21:56:08.602113 bus /sierra_2: Setting Powered False 21:56:09.667166 run create_hlr_db(pid=20808): Terminated: ok {rc=0} 21:56:10.103644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20810): Launched 21:56:10.409652 run osmo-hlr_10.42.42.2(pid=20811): Launched 21:56:10.525634 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:11.050295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20813): Launched 21:56:11.354739 run osmo-stp_10.42.42.5(pid=20814): Launched 21:56:11.470387 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:12.021251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20816): Launched 21:56:12.326820 run osmo-msc_10.42.42.6(pid=20817): Launched 21:56:12.496469 run osmo-stp_10.42.42.5(pid=20814): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20814)] 21:56:12.626528 run osmo-stp_10.42.42.5(pid=20814): stdout: | (launched: 2022-12-09_21:56:11.298361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:12.755973 run osmo-stp_10.42.42.5(pid=20814): stderr: | 20221209215611467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215611468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215611468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215611468 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215611469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215611469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215611469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:12.883143 run osmo-stp_10.42.42.5(pid=20814): stdout: | (launched: 2022-12-09_21:56:11.298361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:13.004159 run osmo-stp_10.42.42.5(pid=20814): stderr: | 20221209215611467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215611468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215611468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215611468 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215611469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215611469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215611469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:13.149683 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20814): Process ended prematurely: osmo-stp_10.42.42.5(pid=20814) [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20814)] [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 21:56:13.158531 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 21:56:13.185515 run osmo-hlr_10.42.42.2(pid=20811): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20811)] 21:56:13.234374 run osmo-hlr_10.42.42.2(pid=20811): stdout: | (launched: 2022-12-09_21:56:10.353386) 21:56:13.284064 run osmo-hlr_10.42.42.2(pid=20811): stderr: | 20221209215610533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215610533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215610533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215610533 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215610533 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215610533 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215610550 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215610559 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215610560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215610560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:13.353174 run osmo-msc_10.42.42.6(pid=20817): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20817)] 21:56:13.400847 run osmo-msc_10.42.42.6(pid=20817): stdout: | (launched: 2022-12-09_21:56:12.270655) 21:56:13.450425 run osmo-msc_10.42.42.6(pid=20817): stderr: | 20221209215612541 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215612541 DLGLOBAL DEBUG validating counter group 0x7f4d93cadc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215612541 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215612541 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215612542 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215612542 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215612545 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215612546 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215612546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215612546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:13.500483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20810): Terminating (SIGTERM) 21:56:13.540625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20813): Terminating (SIGTERM) 21:56:13.580429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20816): Terminating (SIGTERM) 21:56:13.620657 --- ParallelTerminationStrategy: PID 20810 died... 21:56:13.639865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20810): Terminated: ok {rc=0} 21:56:13.685195 --- ParallelTerminationStrategy: PID 20813 died... 21:56:13.703792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20813): Terminated: ok {rc=0} 21:56:13.748327 --- ParallelTerminationStrategy: PID 20816 died... 21:56:13.767130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20816): Terminated: ok {rc=0} 21:56:13.850779 bus /sierra_3: Setting Powered False 21:56:14.948446 bus /sierra_3: Setting Powered False 21:56:16.065088 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 21:56:17.310711 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:56:17.317797 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 21:56:17.339301 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 21:56:17.366679 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 21:56:17.419262 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 21:56:17.440408 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 21:56:17.467595 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 21:56:18.018891 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 21:56:18.071511 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:18.083164 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:56:18.141011 tst mo_mt_call.py: using LAC 23921 21:56:18.269399 tst mo_mt_call.py: using RAC 206 21:56:18.398620 tst mo_mt_call.py: using CellId 23921 21:56:18.527568 tst mo_mt_call.py: using BVCI 23922 21:56:18.646517 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:18.658133 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:18.669566 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:18.680754 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:18.692223 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:18.703599 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:56:18.822107 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:56:18.940344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:19.415818 run create_hlr_db(pid=20822): Launched 21:56:19.531457 bus /sierra_2: Setting Powered False 21:56:20.592020 run create_hlr_db(pid=20822): Terminated: ok {rc=0} 21:56:21.017927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20824): Launched 21:56:21.322343 run osmo-hlr_10.42.42.2(pid=20825): Launched 21:56:21.438634 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:21.963478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20827): Launched 21:56:22.267634 run osmo-stp_10.42.42.5(pid=20828): Launched 21:56:22.384275 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:22.935256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20830): Launched 21:56:23.240434 run osmo-msc_10.42.42.6(pid=20831): Launched 21:56:23.410429 run osmo-stp_10.42.42.5(pid=20828): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20828)] 21:56:23.539891 run osmo-stp_10.42.42.5(pid=20828): stdout: | (launched: 2022-12-09_21:56:22.211391) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:23.669441 run osmo-stp_10.42.42.5(pid=20828): stderr: | 20221209215622382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215622382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215622382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215622382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215622383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215622383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215622383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:23.795877 run osmo-stp_10.42.42.5(pid=20828): stdout: | (launched: 2022-12-09_21:56:22.211391) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:23.916514 run osmo-stp_10.42.42.5(pid=20828): stderr: | 20221209215622382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215622382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215622382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215622382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215622383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215622383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215622383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:24.061505 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20828): Process ended prematurely: osmo-stp_10.42.42.5(pid=20828) [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20828)] [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 21:56:24.070241 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 21:56:24.096696 run osmo-hlr_10.42.42.2(pid=20825): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20825)] 21:56:24.144790 run osmo-hlr_10.42.42.2(pid=20825): stdout: | (launched: 2022-12-09_21:56:21.266603) 21:56:24.194185 run osmo-hlr_10.42.42.2(pid=20825): stderr: | 20221209215621444 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215621444 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215621444 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215621444 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215621444 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215621444 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215621456 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215621465 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215621465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215621465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:24.263149 run osmo-msc_10.42.42.6(pid=20831): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20831)] 21:56:24.311092 run osmo-msc_10.42.42.6(pid=20831): stdout: | (launched: 2022-12-09_21:56:23.183638) 21:56:24.360445 run osmo-msc_10.42.42.6(pid=20831): stderr: | 20221209215623456 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215623456 DLGLOBAL DEBUG validating counter group 0x7f401717ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215623456 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215623456 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215623456 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215623457 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215623458 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215623459 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215623459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215623459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:24.410112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20824): Terminating (SIGTERM) 21:56:24.449555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20827): Terminating (SIGTERM) 21:56:24.489052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20830): Terminating (SIGTERM) 21:56:24.528759 --- ParallelTerminationStrategy: PID 20824 died... 21:56:24.547713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20824): Terminated: ok {rc=0} 21:56:24.591737 --- ParallelTerminationStrategy: PID 20827 died... 21:56:24.610244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20827): Terminated: ok {rc=0} 21:56:24.654574 --- ParallelTerminationStrategy: PID 20830 died... 21:56:24.673003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20830): Terminated: ok {rc=0} 21:56:24.758845 bus /sierra_3: Setting Powered False 21:56:25.856431 bus /sierra_3: Setting Powered False 21:56:26.971750 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 21:56:28.121950 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:28.134071 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:56:28.192273 tst mo_mt_call_osmux.py: using LAC 23922 21:56:28.322585 tst mo_mt_call_osmux.py: using RAC 207 21:56:28.451900 tst mo_mt_call_osmux.py: using CellId 23922 21:56:28.579128 tst mo_mt_call_osmux.py: using BVCI 23923 21:56:28.691776 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:28.702754 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:28.713494 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:28.724545 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:28.735604 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:28.746619 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:56:28.862798 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:56:28.978897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:29.451965 run create_hlr_db(pid=20833): Launched 21:56:29.569548 bus /sierra_2: Setting Powered False 21:56:30.630647 run create_hlr_db(pid=20833): Terminated: ok {rc=0} 21:56:31.101539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20835): Launched 21:56:31.472150 run osmo-hlr_10.42.42.2(pid=20836): Launched 21:56:31.711345 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:32.389247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20838): Launched 21:56:32.715976 run osmo-stp_10.42.42.5(pid=20839): Launched 21:56:32.839525 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:33.427220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20841): Launched 21:56:33.753461 run osmo-msc_10.42.42.6(pid=20842): Launched 21:56:33.936012 run osmo-stp_10.42.42.5(pid=20839): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20839)] 21:56:34.074534 run osmo-stp_10.42.42.5(pid=20839): stdout: | (launched: 2022-12-09_21:56:32.656220) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:34.212868 run osmo-stp_10.42.42.5(pid=20839): stderr: | 20221209215632847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215632848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215632848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215632848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215632849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215632849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215632849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:34.350569 run osmo-stp_10.42.42.5(pid=20839): stdout: | (launched: 2022-12-09_21:56:32.656220) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:34.481098 run osmo-stp_10.42.42.5(pid=20839): stderr: | 20221209215632847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215632848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215632848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215632848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215632849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215632849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215632849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:34.637713 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20839): Process ended prematurely: osmo-stp_10.42.42.5(pid=20839) [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20839)] [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 21:56:34.647282 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 21:56:34.675277 run osmo-hlr_10.42.42.2(pid=20836): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20836)] 21:56:34.725319 run osmo-hlr_10.42.42.2(pid=20836): stdout: | (launched: 2022-12-09_21:56:31.407083) 21:56:34.776857 run osmo-hlr_10.42.42.2(pid=20836): stderr: | 20221209215631707 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215631707 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215631707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215631707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215631708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215631708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215631727 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215631744 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215631744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215631744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:34.848903 run osmo-msc_10.42.42.6(pid=20842): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20842)] 21:56:34.898831 run osmo-msc_10.42.42.6(pid=20842): stdout: | (launched: 2022-12-09_21:56:33.693769) 21:56:34.950272 run osmo-msc_10.42.42.6(pid=20842): stderr: | 20221209215634017 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215634017 DLGLOBAL DEBUG validating counter group 0x7f020e7ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215634017 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215634017 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215634018 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215634018 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215634019 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215634020 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215634020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215634020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:35.002091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20835): Terminating (SIGTERM) 21:56:35.043458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20838): Terminating (SIGTERM) 21:56:35.084753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20841): Terminating (SIGTERM) 21:56:35.126864 --- ParallelTerminationStrategy: PID 20835 died... 21:56:35.146901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20835): Terminated: ok {rc=0} 21:56:35.193285 --- ParallelTerminationStrategy: PID 20838 died... 21:56:35.212768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20838): Terminated: ok {rc=0} 21:56:35.259079 --- ParallelTerminationStrategy: PID 20841 died... 21:56:35.278744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20841): Terminated: ok {rc=0} 21:56:35.366759 bus /sierra_3: Setting Powered False 21:56:36.465277 bus /sierra_3: Setting Powered False 21:56:37.582191 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 21:56:38.814542 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:56:38.820695 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 21:56:38.841344 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 21:56:38.867702 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 21:56:38.919681 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 21:56:38.939872 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 21:56:38.966390 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 21:56:39.515422 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 21:56:39.564435 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:39.575347 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:56:39.631266 tst mo_mt_call.py: using LAC 23923 21:56:39.751928 tst mo_mt_call.py: using RAC 208 21:56:39.872886 tst mo_mt_call.py: using CellId 23923 21:56:39.993230 tst mo_mt_call.py: using BVCI 23924 21:56:40.103664 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:40.114799 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:40.125603 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:40.136520 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:40.147532 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:40.158563 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:56:40.278990 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:56:40.401758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:40.907122 run create_hlr_db(pid=20850): Launched 21:56:41.039866 bus /sierra_2: Setting Powered False 21:56:42.100635 run create_hlr_db(pid=20850): Terminated: ok {rc=0} 21:56:42.553672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20852): Launched 21:56:42.884694 run osmo-hlr_10.42.42.2(pid=20853): Launched 21:56:43.008334 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:43.570180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20855): Launched 21:56:43.898580 run osmo-stp_10.42.42.5(pid=20856): Launched 21:56:44.023234 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:44.614692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20858): Launched 21:56:44.941861 run osmo-msc_10.42.42.6(pid=20859): Launched 21:56:45.123643 run osmo-stp_10.42.42.5(pid=20856): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20856)] 21:56:45.261219 run osmo-stp_10.42.42.5(pid=20856): stdout: | (launched: 2022-12-09_21:56:43.838477) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:45.398880 run osmo-stp_10.42.42.5(pid=20856): stderr: | 20221209215644033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215644033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215644033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215644034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215644034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215644034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215644034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:45.536508 run osmo-stp_10.42.42.5(pid=20856): stdout: | (launched: 2022-12-09_21:56:43.838477) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:45.666407 run osmo-stp_10.42.42.5(pid=20856): stderr: | 20221209215644033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215644033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215644033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215644034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215644034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215644034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215644034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:45.822263 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20856): Process ended prematurely: osmo-stp_10.42.42.5(pid=20856) [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20856)] [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 21:56:45.831760 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:56:45.861186 run osmo-hlr_10.42.42.2(pid=20853): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20853)] 21:56:45.926646 run osmo-hlr_10.42.42.2(pid=20853): stdout: | (launched: 2022-12-09_21:56:42.823489) 21:56:45.979274 run osmo-hlr_10.42.42.2(pid=20853): stderr: | 20221209215643023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215643023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215643024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215643024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215643024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215643024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215643040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215643050 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215643050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215643050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:46.064671 run osmo-msc_10.42.42.6(pid=20859): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20859)] 21:56:46.130186 run osmo-msc_10.42.42.6(pid=20859): stdout: | (launched: 2022-12-09_21:56:44.881949) 21:56:46.197217 run osmo-msc_10.42.42.6(pid=20859): stderr: | 20221209215645203 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215645203 DLGLOBAL DEBUG validating counter group 0x7ff2c588fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215645203 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215645204 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215645204 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215645204 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215645208 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215645208 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215645208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215645208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:46.261091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20852): Terminating (SIGTERM) 21:56:46.315844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20855): Terminating (SIGTERM) 21:56:46.371068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20858): Terminating (SIGTERM) 21:56:46.418869 --- ParallelTerminationStrategy: PID 20852 died... 21:56:46.440218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20852): Terminated: ok {rc=0} 21:56:46.490898 --- ParallelTerminationStrategy: PID 20855 died... 21:56:46.510821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20855): Terminated: ok {rc=0} 21:56:46.558939 --- ParallelTerminationStrategy: PID 20858 died... 21:56:46.579022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20858): Terminated: ok {rc=0} 21:56:46.668010 bus /sierra_3: Setting Powered False 21:56:47.767763 bus /sierra_3: Setting Powered False 21:56:48.884634 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 21:56:50.035326 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:50.047228 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:56:50.105026 tst mo_mt_call_osmux.py: using LAC 23924 21:56:50.236279 tst mo_mt_call_osmux.py: using RAC 209 21:56:50.367686 tst mo_mt_call_osmux.py: using CellId 23924 21:56:50.496590 tst mo_mt_call_osmux.py: using BVCI 23925 21:56:50.615268 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:50.627048 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:50.638304 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:50.649529 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:50.660665 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:50.671947 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:56:50.792052 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:56:50.911002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:51.382484 run create_hlr_db(pid=20861): Launched 21:56:51.499281 bus /sierra_2: Setting Powered False 21:56:52.559796 run create_hlr_db(pid=20861): Terminated: ok {rc=0} 21:56:53.005109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20863): Launched 21:56:53.331492 run osmo-hlr_10.42.42.2(pid=20864): Launched 21:56:53.455723 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:54.021710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20866): Launched 21:56:54.347484 run osmo-stp_10.42.42.5(pid=20867): Launched 21:56:54.470835 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:55.059516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20869): Launched 21:56:55.385998 run osmo-msc_10.42.42.6(pid=20870): Launched 21:56:55.568017 run osmo-stp_10.42.42.5(pid=20867): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20867)] 21:56:55.705688 run osmo-stp_10.42.42.5(pid=20867): stdout: | (launched: 2022-12-09_21:56:54.287622) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:55.843563 run osmo-stp_10.42.42.5(pid=20867): stderr: | 20221209215654480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215654480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215654481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215654481 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215654481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215654482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215654482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:55.980485 run osmo-stp_10.42.42.5(pid=20867): stdout: | (launched: 2022-12-09_21:56:54.287622) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:56.109732 run osmo-stp_10.42.42.5(pid=20867): stderr: | 20221209215654480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215654480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215654481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215654481 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215654481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215654482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215654482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:56.265042 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20867): Process ended prematurely: osmo-stp_10.42.42.5(pid=20867) [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20867)] [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 21:56:56.274543 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:56:56.302193 run osmo-hlr_10.42.42.2(pid=20864): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20864)] 21:56:56.352178 run osmo-hlr_10.42.42.2(pid=20864): stdout: | (launched: 2022-12-09_21:56:53.271501) 21:56:56.403789 run osmo-hlr_10.42.42.2(pid=20864): stderr: | 20221209215653469 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215653469 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215653469 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215653469 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215653469 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215653469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215653483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215653493 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215653494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215653494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:56.475987 run osmo-msc_10.42.42.6(pid=20870): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20870)] 21:56:56.525967 run osmo-msc_10.42.42.6(pid=20870): stdout: | (launched: 2022-12-09_21:56:55.325832) 21:56:56.577460 run osmo-msc_10.42.42.6(pid=20870): stderr: | 20221209215655650 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215655650 DLGLOBAL DEBUG validating counter group 0x7f0b30b9fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215655650 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215655650 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215655650 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215655651 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215655652 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215655653 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215655653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215655653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:56.629800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20863): Terminating (SIGTERM) 21:56:56.671343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20866): Terminating (SIGTERM) 21:56:56.713177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20869): Terminating (SIGTERM) 21:56:56.755331 --- ParallelTerminationStrategy: PID 20863 died... 21:56:56.775409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20863): Terminated: ok {rc=0} 21:56:56.821600 --- ParallelTerminationStrategy: PID 20866 died... 21:56:56.841147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20866): Terminated: ok {rc=0} 21:56:56.887269 --- ParallelTerminationStrategy: PID 20869 died... 21:56:56.906861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20869): Terminated: ok {rc=0} 21:56:56.994167 bus /sierra_3: Setting Powered False 21:56:58.093403 bus /sierra_3: Setting Powered False 21:56:59.208845 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:57:00.440475 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:57:00.446762 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:57:00.467290 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 21:57:00.494079 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:57:00.545577 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:57:00.567032 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 21:57:00.593374 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:57:01.173202 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 21:57:01.250858 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:01.267305 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:57:01.343594 tst mo_mt_call.py: using LAC 23925 21:57:01.511229 tst mo_mt_call.py: using RAC 210 21:57:01.674151 tst mo_mt_call.py: using CellId 23925 21:57:01.840718 tst mo_mt_call.py: using BVCI 23926 21:57:01.956387 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:01.968306 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:01.980112 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:01.992478 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:02.005495 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:02.017250 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:57:02.133602 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:57:02.251318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:02.728194 run create_hlr_db(pid=20875): Launched 21:57:02.845401 bus /sierra_2: Setting Powered False 21:57:03.906253 run create_hlr_db(pid=20875): Terminated: ok {rc=0} 21:57:04.351299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20877): Launched 21:57:04.677992 run osmo-hlr_10.42.42.2(pid=20878): Launched 21:57:04.801664 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:05.360648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20880): Launched 21:57:05.687031 run osmo-stp_10.42.42.5(pid=20881): Launched 21:57:05.811111 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:06.401143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20883): Launched 21:57:06.728614 run osmo-msc_10.42.42.6(pid=20884): Launched 21:57:06.910507 run osmo-stp_10.42.42.5(pid=20881): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20881)] 21:57:07.051806 run osmo-stp_10.42.42.5(pid=20881): stdout: | (launched: 2022-12-09_21:57:05.626983) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:07.191187 run osmo-stp_10.42.42.5(pid=20881): stderr: | 20221209215705821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215705821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215705821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215705822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215705822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215705822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215705822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:07.328420 run osmo-stp_10.42.42.5(pid=20881): stdout: | (launched: 2022-12-09_21:57:05.626983) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:07.459041 run osmo-stp_10.42.42.5(pid=20881): stderr: | 20221209215705821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215705821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215705821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215705822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215705822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215705822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215705822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:07.615869 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20881): Process ended prematurely: osmo-stp_10.42.42.5(pid=20881) [trial-2365↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20881)] [trial-2365↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 21:57:07.625589 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:57:07.653885 run osmo-hlr_10.42.42.2(pid=20878): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20878)] 21:57:07.704245 run osmo-hlr_10.42.42.2(pid=20878): stdout: | (launched: 2022-12-09_21:57:04.618018) 21:57:07.756249 run osmo-hlr_10.42.42.2(pid=20878): stderr: | 20221209215704819 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215704819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215704819 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215704819 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215704819 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215704819 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215704830 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215704838 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215704839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215704839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:07.828810 run osmo-msc_10.42.42.6(pid=20884): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20884)] 21:57:07.879095 run osmo-msc_10.42.42.6(pid=20884): stdout: | (launched: 2022-12-09_21:57:06.668416) 21:57:07.930948 run osmo-msc_10.42.42.6(pid=20884): stderr: | 20221209215706995 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215706996 DLGLOBAL DEBUG validating counter group 0x7f015b5bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215706996 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215706996 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215706996 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215706996 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215706998 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215706998 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215706998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215706999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:07.983284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20877): Terminating (SIGTERM) 21:57:08.025104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20880): Terminating (SIGTERM) 21:57:08.066946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20883): Terminating (SIGTERM) 21:57:08.109292 --- ParallelTerminationStrategy: PID 20877 died... 21:57:08.129358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20877): Terminated: ok {rc=0} 21:57:08.175566 --- ParallelTerminationStrategy: PID 20880 died... 21:57:08.195230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20880): Terminated: ok {rc=0} 21:57:08.241406 --- ParallelTerminationStrategy: PID 20883 died... 21:57:08.260841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20883): Terminated: ok {rc=0} 21:57:08.348441 bus /sierra_3: Setting Powered False 21:57:09.447453 bus /sierra_3: Setting Powered False 21:57:10.565089 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 21:57:11.711613 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:11.723245 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:57:11.779787 tst mo_mt_call_osmux.py: using LAC 23926 21:57:11.900781 tst mo_mt_call_osmux.py: using RAC 211 21:57:12.020873 tst mo_mt_call_osmux.py: using CellId 23926 21:57:12.138510 tst mo_mt_call_osmux.py: using BVCI 23927 21:57:12.250138 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:12.261220 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:12.272049 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:12.283104 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:12.294206 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:12.305568 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:57:12.426367 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:57:12.547554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:13.054246 run create_hlr_db(pid=20886): Launched 21:57:13.186762 bus /sierra_2: Setting Powered False 21:57:14.251037 run create_hlr_db(pid=20886): Terminated: ok {rc=0} 21:57:14.687898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20888): Launched 21:57:14.994112 run osmo-hlr_10.42.42.2(pid=20889): Launched 21:57:15.110512 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:15.633804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20891): Launched 21:57:15.959481 run osmo-stp_10.42.42.5(pid=20892): Launched 21:57:16.235114 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:16.848757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20894): Launched 21:57:17.177523 run osmo-msc_10.42.42.6(pid=20895): Launched 21:57:17.400564 run osmo-stp_10.42.42.5(pid=20892): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20892)] 21:57:17.531471 run osmo-stp_10.42.42.5(pid=20892): stdout: | (launched: 2022-12-09_21:57:15.884636) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:17.662036 run osmo-stp_10.42.42.5(pid=20892): stderr: | 20221209215716111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215716111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215716111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215716111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215716112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215716112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215716112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:17.789988 run osmo-stp_10.42.42.5(pid=20892): stdout: | (launched: 2022-12-09_21:57:15.884636) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:17.911807 run osmo-stp_10.42.42.5(pid=20892): stderr: | 20221209215716111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215716111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215716111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215716111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215716112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215716112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215716112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:18.056655 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20892): Process ended prematurely: osmo-stp_10.42.42.5(pid=20892) [trial-2365↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20892)] [trial-2365↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:57:18.065819 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 21:57:18.093069 run osmo-hlr_10.42.42.2(pid=20889): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20889)] 21:57:18.141375 run osmo-hlr_10.42.42.2(pid=20889): stdout: | (launched: 2022-12-09_21:57:14.938183) 21:57:18.191203 run osmo-hlr_10.42.42.2(pid=20889): stderr: | 20221209215715114 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215715114 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215715114 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215715114 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215715114 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215715114 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215715127 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215715137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215715137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215715137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:18.260476 run osmo-msc_10.42.42.6(pid=20895): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20895)] 21:57:18.308181 run osmo-msc_10.42.42.6(pid=20895): stdout: | (launched: 2022-12-09_21:57:17.118821) 21:57:18.357863 run osmo-msc_10.42.42.6(pid=20895): stderr: | 20221209215717447 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215717447 DLGLOBAL DEBUG validating counter group 0x7f7b62de6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215717447 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215717447 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215717448 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215717448 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215717450 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215717450 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215717450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215717450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:18.407914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20888): Terminating (SIGTERM) 21:57:18.448036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20891): Terminating (SIGTERM) 21:57:18.488053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20894): Terminating (SIGTERM) 21:57:18.528413 --- ParallelTerminationStrategy: PID 20888 died... 21:57:18.547718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20888): Terminated: ok {rc=0} 21:57:18.592706 --- ParallelTerminationStrategy: PID 20891 died... 21:57:18.611508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20891): Terminated: ok {rc=0} 21:57:18.656545 --- ParallelTerminationStrategy: PID 20894 died... 21:57:18.675443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20894): Terminated: ok {rc=0} 21:57:18.759969 bus /sierra_3: Setting Powered False 21:57:19.858013 bus /sierra_3: Setting Powered False 21:57:20.975701 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:57:22.204533 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:57:22.210145 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:57:22.230656 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 21:57:22.257793 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 21:57:22.309439 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:57:22.331323 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 21:57:22.357955 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 21:57:22.903336 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 21:57:22.952560 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:22.963469 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:57:23.022438 tst mo_mt_call.py: using LAC 23927 21:57:23.141310 tst mo_mt_call.py: using RAC 212 21:57:23.260316 tst mo_mt_call.py: using CellId 23927 21:57:23.377354 tst mo_mt_call.py: using BVCI 23928 21:57:23.487200 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:23.498284 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:23.509007 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:23.519995 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:23.530789 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:23.541858 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:57:23.657092 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:57:23.777924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:24.287114 run create_hlr_db(pid=20900): Launched 21:57:24.420283 bus /sierra_2: Setting Powered False 21:57:25.485459 run create_hlr_db(pid=20900): Terminated: ok {rc=0} 21:57:25.921372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20902): Launched 21:57:26.227698 run osmo-hlr_10.42.42.2(pid=20903): Launched 21:57:26.344393 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:26.874256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20905): Launched 21:57:27.179822 run osmo-stp_10.42.42.5(pid=20906): Launched 21:57:27.295388 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:27.846087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20908): Launched 21:57:28.151590 run osmo-msc_10.42.42.6(pid=20909): Launched 21:57:28.321359 run osmo-stp_10.42.42.5(pid=20906): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20906)] 21:57:28.450638 run osmo-stp_10.42.42.5(pid=20906): stdout: | (launched: 2022-12-09_21:57:27.123470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:28.580453 run osmo-stp_10.42.42.5(pid=20906): stderr: | 20221209215727297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215727297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215727297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215727298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215727298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215727298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215727298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:28.708758 run osmo-stp_10.42.42.5(pid=20906): stdout: | (launched: 2022-12-09_21:57:27.123470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:28.829833 run osmo-stp_10.42.42.5(pid=20906): stderr: | 20221209215727297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215727297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215727297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215727298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215727298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215727298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215727298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:28.975232 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20906): Process ended prematurely: osmo-stp_10.42.42.5(pid=20906) [trial-2365↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20906)] [trial-2365↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 21:57:28.984048 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 21:57:29.010891 run osmo-hlr_10.42.42.2(pid=20903): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20903)] 21:57:29.058953 run osmo-hlr_10.42.42.2(pid=20903): stdout: | (launched: 2022-12-09_21:57:26.171441) 21:57:29.108908 run osmo-hlr_10.42.42.2(pid=20903): stderr: | 20221209215726349 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215726350 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215726350 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215726350 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215726350 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215726350 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215726363 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215726374 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215726374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215726374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:29.178050 run osmo-msc_10.42.42.6(pid=20909): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20909)] 21:57:29.225790 run osmo-msc_10.42.42.6(pid=20909): stdout: | (launched: 2022-12-09_21:57:28.095201) 21:57:29.276381 run osmo-msc_10.42.42.6(pid=20909): stderr: | 20221209215728368 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215728368 DLGLOBAL DEBUG validating counter group 0x7fb1364fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215728368 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215728368 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215728368 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215728368 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215728370 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215728370 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215728371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215728371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:29.326800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20902): Terminating (SIGTERM) 21:57:29.366835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20905): Terminating (SIGTERM) 21:57:29.406769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20908): Terminating (SIGTERM) 21:57:29.446992 --- ParallelTerminationStrategy: PID 20902 died... 21:57:29.466249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20902): Terminated: ok {rc=0} 21:57:29.511148 --- ParallelTerminationStrategy: PID 20905 died... 21:57:29.529889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20905): Terminated: ok {rc=0} 21:57:29.575001 --- ParallelTerminationStrategy: PID 20908 died... 21:57:29.593829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20908): Terminated: ok {rc=0} 21:57:29.680112 bus /sierra_3: Setting Powered False 21:57:30.779680 bus /sierra_3: Setting Powered False 21:57:31.911991 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 21:57:33.072405 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:33.083951 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:57:33.139703 tst mo_mt_call_osmux.py: using LAC 23928 21:57:33.258816 tst mo_mt_call_osmux.py: using RAC 213 21:57:33.376452 tst mo_mt_call_osmux.py: using CellId 23928 21:57:33.493550 tst mo_mt_call_osmux.py: using BVCI 23929 21:57:33.613146 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:33.624721 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:33.635986 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:33.647256 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:33.658841 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:33.670247 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:57:33.786676 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:57:33.907478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:34.413157 run create_hlr_db(pid=20911): Launched 21:57:34.545079 bus /sierra_2: Setting Powered False 21:57:35.610310 run create_hlr_db(pid=20911): Terminated: ok {rc=0} 21:57:36.062553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20913): Launched 21:57:36.389671 run osmo-hlr_10.42.42.2(pid=20914): Launched 21:57:36.514074 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:37.075180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20916): Launched 21:57:37.401492 run osmo-stp_10.42.42.5(pid=20917): Launched 21:57:37.527377 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:38.122539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20919): Launched 21:57:38.449374 run osmo-msc_10.42.42.6(pid=20920): Launched 21:57:38.632852 run osmo-stp_10.42.42.5(pid=20917): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20917)] 21:57:38.771703 run osmo-stp_10.42.42.5(pid=20917): stdout: | (launched: 2022-12-09_21:57:37.341678) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:38.911361 run osmo-stp_10.42.42.5(pid=20917): stderr: | 20221209215737537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215737537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215737537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215737538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215737538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215737538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215737538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:39.049281 run osmo-stp_10.42.42.5(pid=20917): stdout: | (launched: 2022-12-09_21:57:37.341678) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:39.179489 run osmo-stp_10.42.42.5(pid=20917): stderr: | 20221209215737537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215737537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215737537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215737538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215737538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215737538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215737538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:39.335826 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20917): Process ended prematurely: osmo-stp_10.42.42.5(pid=20917) [trial-2365↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20917)] [trial-2365↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 21:57:39.345375 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:57:39.373194 run osmo-hlr_10.42.42.2(pid=20914): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20914)] 21:57:39.423292 run osmo-hlr_10.42.42.2(pid=20914): stdout: | (launched: 2022-12-09_21:57:36.329850) 21:57:39.475022 run osmo-hlr_10.42.42.2(pid=20914): stderr: | 20221209215736529 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215736529 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215736529 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215736529 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215736529 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215736529 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215736544 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215736552 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215736553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215736553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:39.547065 run osmo-msc_10.42.42.6(pid=20920): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20920)] 21:57:39.596909 run osmo-msc_10.42.42.6(pid=20920): stdout: | (launched: 2022-12-09_21:57:38.389622) 21:57:39.648530 run osmo-msc_10.42.42.6(pid=20920): stderr: | 20221209215738716 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215738716 DLGLOBAL DEBUG validating counter group 0x7f57f353ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215738716 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215738716 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215738716 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215738716 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215738718 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215738718 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215738719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215738719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:39.701048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20913): Terminating (SIGTERM) 21:57:39.742516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20916): Terminating (SIGTERM) 21:57:39.784114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20919): Terminating (SIGTERM) 21:57:39.825998 --- ParallelTerminationStrategy: PID 20913 died... 21:57:39.845941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20913): Terminated: ok {rc=0} 21:57:39.891863 --- ParallelTerminationStrategy: PID 20916 died... 21:57:39.911397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20916): Terminated: ok {rc=0} 21:57:39.957427 --- ParallelTerminationStrategy: PID 20919 died... 21:57:39.976750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20919): Terminated: ok {rc=0} 21:57:40.063818 bus /sierra_3: Setting Powered False 21:57:41.163236 bus /sierra_3: Setting Powered False 21:57:42.279522 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 emergency:oc2g --------------------------------------------------------------------- 21:57:43.515343 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:57:43.519988 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 21:57:43.541113 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 21:57:43.568461 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 21:57:43.654646 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 21:57:43.675799 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 21:57:43.703129 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 21:57:44.287665 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2365 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 21:57:44.292761 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:44.303676 tst emergency:oc2g: Using 1 x bts (candidates: 1) 21:57:44.340313 tst emergency_mo_mt_call.py: using LAC 23929 21:57:44.466073 tst emergency_mo_mt_call.py: using RAC 214 21:57:44.593239 tst emergency_mo_mt_call.py: using CellId 23929 21:57:44.718823 tst emergency_mo_mt_call.py: using BVCI 23930 21:57:44.836135 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:44.847131 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:44.857987 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:44.868720 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:44.879528 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:44.890244 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:45.005179 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:45.124317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:45.621080 run create_hlr_db(pid=20925): Launched 21:57:45.750836 bus /sierra_2: Setting Powered False 21:57:46.810452 run create_hlr_db(pid=20925): Terminated: ok {rc=0} 21:57:47.286714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20927): Launched 21:57:47.587969 run osmo-hlr_10.42.42.2(pid=20928): Launched 21:57:47.702146 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:48.231653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20930): Launched 21:57:48.531579 run osmo-stp_10.42.42.5(pid=20931): Launched 21:57:48.656143 tst emergency_mo_mt_call.py: using MSISDN 7399 21:57:48.808066 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:49.345364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20933): Launched 21:57:49.646006 run osmo-msc_10.42.42.6(pid=20934): Launched 21:57:49.812771 run osmo-stp_10.42.42.5(pid=20931): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20931)] 21:57:49.939237 run osmo-stp_10.42.42.5(pid=20931): stdout: | (launched: 2022-12-09_21:57:48.476366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:50.066079 run osmo-stp_10.42.42.5(pid=20931): stderr: | 20221209215748647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215748647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215748647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215748647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215748649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215748649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215748649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:50.190866 run osmo-stp_10.42.42.5(pid=20931): stdout: | (launched: 2022-12-09_21:57:48.476366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:50.310372 run osmo-stp_10.42.42.5(pid=20931): stderr: | 20221209215748647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215748647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215748647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215748647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215748649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215748649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215748649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:50.452763 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20931): Process ended prematurely: osmo-stp_10.42.42.5(pid=20931) [trial-2365↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20931)] [trial-2365↪emergency:oc2g↪emergency_mo_mt_call.py:19] 21:57:50.461227 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 21:57:50.487854 run osmo-hlr_10.42.42.2(pid=20928): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20928)] 21:57:50.535669 run osmo-hlr_10.42.42.2(pid=20928): stdout: | (launched: 2022-12-09_21:57:47.532373) 21:57:50.585420 run osmo-hlr_10.42.42.2(pid=20928): stderr: | 20221209215747710 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215747710 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215747710 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215747711 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215747711 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215747711 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215747735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215747745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215747745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215747746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:50.654518 run osmo-msc_10.42.42.6(pid=20934): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20934)] 21:57:50.702472 run osmo-msc_10.42.42.6(pid=20934): stdout: | (launched: 2022-12-09_21:57:49.590590) 21:57:50.752023 run osmo-msc_10.42.42.6(pid=20934): stderr: | 20221209215749865 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215749865 DLGLOBAL DEBUG validating counter group 0x7f1a5e444c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215749865 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215749865 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215749865 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215749866 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215749867 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215749868 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215749868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215749868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:50.802103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20927): Terminating (SIGTERM) 21:57:50.841779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20930): Terminating (SIGTERM) 21:57:50.881517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20933): Terminating (SIGTERM) 21:57:50.921567 --- ParallelTerminationStrategy: PID 20927 died... 21:57:50.940750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20927): Terminated: ok {rc=0} 21:57:50.985322 --- ParallelTerminationStrategy: PID 20930 died... 21:57:51.004121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20930): Terminated: ok {rc=0} 21:57:51.049352 --- ParallelTerminationStrategy: PID 20933 died... 21:57:51.068106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20933): Terminated: ok {rc=0} 21:57:51.152139 bus /sierra_3: Setting Powered False 21:57:52.249500 bus /sierra_3: Setting Powered False 21:57:53.363681 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 21:57:54.450984 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:54.462649 tst emergency:oc2g: Using 1 x bts (candidates: 1) 21:57:54.499437 tst emergency_preemptive_call.py: using LAC 23930 21:57:54.624310 tst emergency_preemptive_call.py: using RAC 215 21:57:54.750354 tst emergency_preemptive_call.py: using CellId 23930 21:57:54.874310 tst emergency_preemptive_call.py: using BVCI 23931 21:57:54.990351 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:55.001362 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:55.012201 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:55.023124 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:55.034008 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:55.044747 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:55.165098 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:55.281646 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:55.399860 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:55.515104 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:55.982792 run create_hlr_db(pid=20936): Launched 21:57:56.098279 bus /sierra_2: Setting Powered False 21:57:57.158310 run create_hlr_db(pid=20936): Terminated: ok {rc=0} 21:57:57.599545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20938): Launched 21:57:57.922304 run osmo-hlr_10.42.42.2(pid=20939): Launched 21:57:58.044841 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:58.601908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20941): Launched 21:57:58.925877 run osmo-stp_10.42.42.5(pid=20942): Launched 21:57:59.056568 tst emergency_preemptive_call.py: using MSISDN 7400 21:57:59.221616 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:59.800546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20944): Launched 21:58:00.121542 run osmo-msc_10.42.42.6(pid=20945): Launched 21:58:00.301829 run osmo-stp_10.42.42.5(pid=20942): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20942)] 21:58:00.437933 run osmo-stp_10.42.42.5(pid=20942): stdout: | (launched: 2022-12-09_21:57:58.866596) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:00.574985 run osmo-stp_10.42.42.5(pid=20942): stderr: | 20221209215759058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215759058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215759059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215759059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215759061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215759062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215759062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:00.711831 run osmo-stp_10.42.42.5(pid=20942): stdout: | (launched: 2022-12-09_21:57:58.866596) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:00.840403 run osmo-stp_10.42.42.5(pid=20942): stderr: | 20221209215759058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215759058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215759059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215759059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215759061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215759062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215759062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:01.004012 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=20942): Process ended prematurely: osmo-stp_10.42.42.5(pid=20942) [trial-2365↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20942)] [trial-2365↪emergency:oc2g↪emergency_preemptive_call.py:32] 21:58:01.013353 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 21:58:01.041488 run osmo-hlr_10.42.42.2(pid=20939): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20939)] 21:58:01.092746 run osmo-hlr_10.42.42.2(pid=20939): stdout: | (launched: 2022-12-09_21:57:57.863228) 21:58:01.145609 run osmo-hlr_10.42.42.2(pid=20939): stderr: | 20221209215758062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215758062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215758062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215758062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215758062 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215758062 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215758075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215758086 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215758086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215758086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:01.219027 run osmo-msc_10.42.42.6(pid=20945): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20945)] 21:58:01.270026 run osmo-msc_10.42.42.6(pid=20945): stdout: | (launched: 2022-12-09_21:58:00.062152) 21:58:01.322754 run osmo-msc_10.42.42.6(pid=20945): stderr: | 20221209215800384 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209215800385 DLGLOBAL DEBUG validating counter group 0x7efde4c1fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209215800385 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209215800385 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209215800385 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209215800385 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209215800387 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209215800387 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209215800387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209215800388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:58:01.375788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20938): Terminating (SIGTERM) 21:58:01.418505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20941): Terminating (SIGTERM) 21:58:01.461323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20944): Terminating (SIGTERM) 21:58:01.504194 --- ParallelTerminationStrategy: PID 20938 died... 21:58:01.525381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20938): Terminated: ok {rc=0} 21:58:01.572240 --- ParallelTerminationStrategy: PID 20941 died... 21:58:01.592387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20941): Terminated: ok {rc=0} 21:58:01.638932 --- ParallelTerminationStrategy: PID 20944 died... 21:58:01.659178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20944): Terminated: ok {rc=0} 21:58:01.747469 bus /sierra_9: Setting Powered False 21:58:02.847781 bus /sierra_9: Setting Powered False 21:58:03.963162 bus /sierra_8: Setting Powered False 21:58:05.062023 bus /sierra_8: Setting Powered False 21:58:06.180301 bus /sierra_3: Setting Powered False 21:58:07.278276 bus /sierra_3: Setting Powered False 21:58:08.394932 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:oc2g --------------------------------------------------------------------- 21:58:09.649016 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:58:09.653492 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 21:58:09.673838 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 21:58:09.712862 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 21:58:09.798531 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 21:58:09.820028 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 21:58:09.860912 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 21:58:10.449818 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 21:58:10.502763 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:10.513175 tst gprs:oc2g: Using 1 x bts (candidates: 1) 21:58:10.546820 tst cs_paging_gprs_active.py: using LAC 23931 21:58:10.675854 tst cs_paging_gprs_active.py: using RAC 216 21:58:10.803485 tst cs_paging_gprs_active.py: using CellId 23931 21:58:10.931690 tst cs_paging_gprs_active.py: using BVCI 23932 21:58:11.044067 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:11.054724 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:11.064934 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:11.075426 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:11.085885 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:11.096244 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:11.106737 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:11.117255 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:11.127796 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:11.248655 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:11.371128 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:58:11.592784 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:11.923333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20950): Launched 21:58:12.209464 run iperf3-srv_10.42.42.10(pid=20951): Launched 21:58:12.333820 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:58:12.557567 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:12.891220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20952): Launched 21:58:13.177638 run iperf3-srv_10.42.42.10(pid=20953): Launched 21:58:13.301476 tst cs_paging_gprs_active.py:38: start network... 21:58:13.524276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:14.035429 run create_hlr_db(pid=20954): Launched 21:58:14.168302 bus /sierra_2: Setting Powered False 21:58:15.233567 run create_hlr_db(pid=20954): Terminated: ok {rc=0} 21:58:15.670432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20956): Launched 21:58:16.027882 run osmo-hlr_10.42.42.2(pid=20957): Launched 21:58:16.283341 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:16.931827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20959): Launched 21:58:17.275872 run osmo-stp_10.42.42.5(pid=20960): Launched 21:58:17.403418 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:58:17.969318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20962): Launched 21:58:18.094950 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:58:18.372150 run patchelf(pid=20963): Launched 21:58:18.554351 run osmo-stp_10.42.42.5(pid=20960): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20960)] 21:58:18.693746 run osmo-stp_10.42.42.5(pid=20960): stdout: | (launched: 2022-12-09_21:58:17.215745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:18.834246 run osmo-stp_10.42.42.5(pid=20960): stderr: | 20221209215817408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215817408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215817408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215817409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215817409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215817409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215817409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:18.974795 run osmo-stp_10.42.42.5(pid=20960): stdout: | (launched: 2022-12-09_21:58:17.215745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:19.109132 run osmo-stp_10.42.42.5(pid=20960): stderr: | 20221209215817408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215817408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215817408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215817409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215817409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215817409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215817409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:19.268068 run patchelf(pid=20963): Terminating (SIGINT) 21:58:19.452895 run patchelf(pid=20963): Terminated: ok {rc=0} 21:58:19.586077 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20960): Process ended prematurely: osmo-stp_10.42.42.5(pid=20960) [trial-2365↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20960)] [trial-2365↪gprs:oc2g↪cs_paging_gprs_active.py:38] 21:58:19.595992 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 21:58:19.624728 run osmo-hlr_10.42.42.2(pid=20957): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20957)] 21:58:19.675760 run osmo-hlr_10.42.42.2(pid=20957): stdout: | (launched: 2022-12-09_21:58:15.958700) 21:58:19.727810 run osmo-hlr_10.42.42.2(pid=20957): stderr: | 20221209215816192 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215816192 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215816192 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215816192 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215816192 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215816192 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215816204 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215816219 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215816219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215816219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:19.779854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20950): Terminating (SIGTERM) 21:58:19.821829 run iperf3-srv_10.42.42.10(pid=20951): Terminating (SIGTERM) 21:58:19.863631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20952): Terminating (SIGTERM) 21:58:19.905935 run iperf3-srv_10.42.42.10(pid=20953): Terminating (SIGTERM) 21:58:19.947841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20956): Terminating (SIGTERM) 21:58:19.989964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20959): Terminating (SIGTERM) 21:58:20.031945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20962): Terminating (SIGTERM) 21:58:20.074242 --- ParallelTerminationStrategy: PID 20950 died... 21:58:20.094419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20950): Terminated: ok {rc=0} 21:58:20.140763 --- ParallelTerminationStrategy: PID 20951 died... 21:58:20.160439 run iperf3-srv_10.42.42.10(pid=20951): Terminated {rc=256} 21:58:20.206852 --- ParallelTerminationStrategy: PID 20952 died... 21:58:20.226510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20952): Terminated: ok {rc=0} 21:58:20.272500 --- ParallelTerminationStrategy: PID 20953 died... 21:58:20.292120 run iperf3-srv_10.42.42.10(pid=20953): Terminated {rc=256} 21:58:20.338080 --- ParallelTerminationStrategy: PID 20956 died... 21:58:20.357831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20956): Terminated: ok {rc=0} 21:58:20.403766 --- ParallelTerminationStrategy: PID 20959 died... 21:58:20.423542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20959): Terminated: ok {rc=0} 21:58:20.469445 --- ParallelTerminationStrategy: PID 20962 died... 21:58:20.488866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20962): Terminated: ok {rc=0} 21:58:20.576487 bus /gobi_0: Setting Powered False 21:58:21.676443 bus /gobi_0: Setting Powered False 21:58:22.793177 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:oc2g iperf3.py ---------------------------------------------- 21:58:23.939982 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:23.951154 tst gprs:oc2g: Using 1 x bts (candidates: 1) 21:58:23.987454 tst iperf3.py: using LAC 23932 21:58:24.117940 tst iperf3.py: using RAC 217 21:58:24.248239 tst iperf3.py: using CellId 23932 21:58:24.376201 tst iperf3.py: using BVCI 23933 21:58:24.494715 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:24.505847 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:24.516633 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:24.527438 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:24.538126 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:24.548730 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:24.559553 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:24.570288 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:24.581137 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:24.700260 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:58:24.906962 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:25.214065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20964): Launched 21:58:25.481832 run iperf3-srv_10.42.42.10(pid=20965): Launched 21:58:25.596411 tst iperf3.py:8: start network... 21:58:25.801358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:26.274365 run create_hlr_db(pid=20966): Launched 21:58:26.391625 bus /gobi_6: Setting Powered False 21:58:27.452241 run create_hlr_db(pid=20966): Terminated: ok {rc=0} 21:58:27.900704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20968): Launched 21:58:28.229099 run osmo-hlr_10.42.42.2(pid=20969): Launched 21:58:28.354197 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:28.919087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20971): Launched 21:58:29.247211 run osmo-stp_10.42.42.5(pid=20972): Launched 21:58:29.372167 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:58:29.938748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20974): Launched 21:58:30.063948 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:58:30.341492 run patchelf(pid=20975): Launched 21:58:30.525323 run osmo-stp_10.42.42.5(pid=20972): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20972)] 21:58:30.665761 run osmo-stp_10.42.42.5(pid=20972): stdout: | (launched: 2022-12-09_21:58:29.187303) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:30.807536 run osmo-stp_10.42.42.5(pid=20972): stderr: | 20221209215829383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215829383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215829383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215829384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215829384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215829384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215829384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:30.957697 run osmo-stp_10.42.42.5(pid=20972): stdout: | (launched: 2022-12-09_21:58:29.187303) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:31.094806 run osmo-stp_10.42.42.5(pid=20972): stderr: | 20221209215829383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215829383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215829383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215829384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215829384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215829384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215829384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:31.257223 run patchelf(pid=20975): Terminating (SIGINT) 21:58:31.459355 run patchelf(pid=20975): Terminated: ok {rc=0} 21:58:31.609026 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20972): Process ended prematurely: osmo-stp_10.42.42.5(pid=20972) [trial-2365↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20972)] [trial-2365↪gprs:oc2g↪iperf3.py:8] 21:58:31.619804 tst iperf3.py:8: Test FAILED (7.7 sec) 21:58:31.649645 run osmo-hlr_10.42.42.2(pid=20969): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20969)] 21:58:31.701182 run osmo-hlr_10.42.42.2(pid=20969): stdout: | (launched: 2022-12-09_21:58:28.169068) 21:58:31.754324 run osmo-hlr_10.42.42.2(pid=20969): stderr: | 20221209215828370 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215828370 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215828370 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215828370 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215828370 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215828370 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215828383 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215828391 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215828391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215828391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:31.808054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20964): Terminating (SIGTERM) 21:58:31.851668 run iperf3-srv_10.42.42.10(pid=20965): Terminating (SIGTERM) 21:58:31.899335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20968): Terminating (SIGTERM) 21:58:31.942682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20971): Terminating (SIGTERM) 21:58:31.985772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20974): Terminating (SIGTERM) 21:58:32.028933 --- ParallelTerminationStrategy: PID 20964 died... 21:58:32.049289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20964): Terminated: ok {rc=0} 21:58:32.096860 --- ParallelTerminationStrategy: PID 20965 died... 21:58:32.117159 run iperf3-srv_10.42.42.10(pid=20965): Terminated {rc=256} 21:58:32.164641 --- ParallelTerminationStrategy: PID 20968 died... 21:58:32.184912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20968): Terminated: ok {rc=0} 21:58:32.232063 --- ParallelTerminationStrategy: PID 20971 died... 21:58:32.252141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20971): Terminated: ok {rc=0} 21:58:32.298399 --- ParallelTerminationStrategy: PID 20974 died... 21:58:32.318156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20974): Terminated: ok {rc=0} 21:58:32.405651 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:oc2g iperf3m4.py ---------------------------------------------- 21:58:33.555419 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:33.567089 tst gprs:oc2g: Using 1 x bts (candidates: 1) 21:58:33.603392 tst iperf3m4.py: using LAC 23933 21:58:33.735044 tst iperf3m4.py: using RAC 218 21:58:33.864871 tst iperf3m4.py: using CellId 23933 21:58:33.992662 tst iperf3m4.py: using BVCI 23934 21:58:34.111707 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:34.122808 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:34.133746 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:34.144682 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:34.155470 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:34.166411 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:34.177393 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:34.188092 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:34.199174 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:34.315596 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:34.437867 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:34.556014 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:34.669757 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:58:34.874714 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:35.183203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20976): Launched 21:58:35.450499 run iperf3-srv_10.42.42.10(pid=20977): Launched 21:58:35.565635 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:58:35.770488 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:36.077897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20978): Launched 21:58:36.343686 run iperf3-srv_10.42.42.10(pid=20979): Launched 21:58:36.458198 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:58:36.662450 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:36.970005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20980): Launched 21:58:37.238268 run iperf3-srv_10.42.42.10(pid=20981): Launched 21:58:37.352460 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:58:37.556114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:37.862318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20982): Launched 21:58:38.127506 run iperf3-srv_10.42.42.10(pid=20983): Launched 21:58:38.241981 tst iperf3m4.py:8: start network... 21:58:38.446208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:38.919579 run create_hlr_db(pid=20984): Launched 21:58:39.037526 bus /gobi_6: Setting Powered False 21:58:40.098916 run create_hlr_db(pid=20984): Terminated: ok {rc=0} 21:58:40.524864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20986): Launched 21:58:40.831204 run osmo-hlr_10.42.42.2(pid=20987): Launched 21:58:40.947390 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:41.488136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20989): Launched 21:58:41.792878 run osmo-stp_10.42.42.5(pid=20990): Launched 21:58:41.909059 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:58:42.435994 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20992): Launched 21:58:42.553758 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:58:42.812874 run patchelf(pid=20993): Launched 21:58:42.982810 run osmo-stp_10.42.42.5(pid=20990): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20990)] 21:58:43.112906 run osmo-stp_10.42.42.5(pid=20990): stdout: | (launched: 2022-12-09_21:58:41.736391) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:43.243766 run osmo-stp_10.42.42.5(pid=20990): stderr: | 20221209215841909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215841909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215841909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215841910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215841910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215841910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215841910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:43.374742 run osmo-stp_10.42.42.5(pid=20990): stdout: | (launched: 2022-12-09_21:58:41.736391) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:43.498983 run osmo-stp_10.42.42.5(pid=20990): stderr: | 20221209215841909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215841909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215841909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215841910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215841910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215841910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215841910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:43.646662 run patchelf(pid=20993): Terminating (SIGINT) 21:58:43.820238 run patchelf(pid=20993): Terminated: ok {rc=0} 21:58:43.944592 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20990): Process ended prematurely: osmo-stp_10.42.42.5(pid=20990) [trial-2365↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20990)] [trial-2365↪gprs:oc2g↪iperf3m4.py:8] 21:58:43.953979 tst iperf3m4.py:8: Test FAILED (10.4 sec) 21:58:43.981566 run osmo-hlr_10.42.42.2(pid=20987): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20987)] 21:58:44.029459 run osmo-hlr_10.42.42.2(pid=20987): stdout: | (launched: 2022-12-09_21:58:40.774596) 21:58:44.078952 run osmo-hlr_10.42.42.2(pid=20987): stderr: | 20221209215840953 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215840953 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215840953 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215840953 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215840953 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215840953 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215840965 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215840974 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215840974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215840974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:44.129209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20976): Terminating (SIGTERM) 21:58:44.169282 run iperf3-srv_10.42.42.10(pid=20977): Terminating (SIGTERM) 21:58:44.209201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20978): Terminating (SIGTERM) 21:58:44.249088 run iperf3-srv_10.42.42.10(pid=20979): Terminating (SIGTERM) 21:58:44.288892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20980): Terminating (SIGTERM) 21:58:44.328650 run iperf3-srv_10.42.42.10(pid=20981): Terminating (SIGTERM) 21:58:44.368313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20982): Terminating (SIGTERM) 21:58:44.408223 run iperf3-srv_10.42.42.10(pid=20983): Terminating (SIGTERM) 21:58:44.448030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20986): Terminating (SIGTERM) 21:58:44.487823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20989): Terminating (SIGTERM) 21:58:44.527720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20992): Terminating (SIGTERM) 21:58:44.567744 --- ParallelTerminationStrategy: PID 20976 died... 21:58:44.586895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20976): Terminated: ok {rc=0} 21:58:44.631612 --- ParallelTerminationStrategy: PID 20977 died... 21:58:44.650260 run iperf3-srv_10.42.42.10(pid=20977): Terminated {rc=256} 21:58:44.694977 --- ParallelTerminationStrategy: PID 20978 died... 21:58:44.713565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20978): Terminated: ok {rc=0} 21:58:44.757601 --- ParallelTerminationStrategy: PID 20979 died... 21:58:44.776032 run iperf3-srv_10.42.42.10(pid=20979): Terminated {rc=256} 21:58:44.820169 --- ParallelTerminationStrategy: PID 20980 died... 21:58:44.838715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20980): Terminated: ok {rc=0} 21:58:44.882747 --- ParallelTerminationStrategy: PID 20981 died... 21:58:44.901290 run iperf3-srv_10.42.42.10(pid=20981): Terminated {rc=256} 21:58:44.945307 --- ParallelTerminationStrategy: PID 20982 died... 21:58:44.963594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20982): Terminated: ok {rc=0} 21:58:45.007762 --- ParallelTerminationStrategy: PID 20983 died... 21:58:45.026495 run iperf3-srv_10.42.42.10(pid=20983): Terminated {rc=256} 21:58:45.070899 --- ParallelTerminationStrategy: PID 20986 died... 21:58:45.089593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20986): Terminated: ok {rc=0} 21:58:45.133436 --- ParallelTerminationStrategy: PID 20989 died... 21:58:45.152115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20989): Terminated: ok {rc=0} 21:58:45.196060 --- ParallelTerminationStrategy: PID 20992 died... 21:58:45.214684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20992): Terminated: ok {rc=0} 21:58:45.297488 bus /gobi_4: Setting Powered False 21:58:46.392936 bus /gobi_4: Setting Powered False 21:58:47.505865 bus /gobi_1: Setting Powered False 21:58:48.604545 bus /gobi_1: Setting Powered False 21:58:49.719926 bus /gobi_0: Setting Powered False 21:58:50.818210 bus /gobi_0: Setting Powered False 21:58:51.936073 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:oc2g ping.py ---------------------------------------------- 21:58:53.037600 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:53.048529 tst gprs:oc2g: Using 1 x bts (candidates: 1) 21:58:53.084605 tst ping.py: using LAC 23934 21:58:53.213030 tst ping.py: using RAC 219 21:58:53.345702 tst ping.py: using CellId 23934 21:58:53.464406 tst ping.py: using BVCI 23935 21:58:53.573233 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:53.584007 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:53.594439 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:53.604632 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:53.616147 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:53.627135 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:53.638270 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:53.649317 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:53.769047 tst ping.py:19: start network... 21:58:53.987413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:54.484936 run create_hlr_db(pid=20995): Launched 21:58:54.615052 bus /gobi_6: Setting Powered False 21:58:55.678844 run create_hlr_db(pid=20995): Terminated: ok {rc=0} 21:58:56.126393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20997): Launched 21:58:56.448073 run osmo-hlr_10.42.42.2(pid=20998): Launched 21:58:56.570156 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:57.124087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21000): Launched 21:58:57.446118 run osmo-stp_10.42.42.5(pid=21001): Launched 21:58:57.568719 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:58:58.124351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21003): Launched 21:58:58.246939 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:58:58.518440 run patchelf(pid=21004): Launched 21:58:58.697168 run osmo-stp_10.42.42.5(pid=21001): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21001)] 21:58:58.833606 run osmo-stp_10.42.42.5(pid=21001): stdout: | (launched: 2022-12-09_21:58:57.387036) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:58.971718 run osmo-stp_10.42.42.5(pid=21001): stderr: | 20221209215857582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215857582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215857582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215857583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215857583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215857583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215857583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:59.109961 run osmo-stp_10.42.42.5(pid=21001): stdout: | (launched: 2022-12-09_21:58:57.387036) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:59.242135 run osmo-stp_10.42.42.5(pid=21001): stderr: | 20221209215857582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215857582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215857582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215857583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215857583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215857583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215857583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:59.398100 run patchelf(pid=21004): Terminating (SIGINT) 21:58:59.580002 run patchelf(pid=21004): Terminated: ok {rc=0} 21:58:59.711763 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21001): Process ended prematurely: osmo-stp_10.42.42.5(pid=21001) [trial-2365↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21001)] [trial-2365↪gprs:oc2g↪ping.py:22] 21:58:59.721169 tst ping.py:22: Test FAILED (6.7 sec) 21:58:59.749576 run osmo-hlr_10.42.42.2(pid=20998): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20998)] 21:58:59.799704 run osmo-hlr_10.42.42.2(pid=20998): stdout: | (launched: 2022-12-09_21:58:56.388918) 21:58:59.851698 run osmo-hlr_10.42.42.2(pid=20998): stderr: | 20221209215856590 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215856590 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215856590 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215856590 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215856590 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215856590 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215856603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215856613 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215856613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215856613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:59.904154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20997): Terminating (SIGTERM) 21:58:59.946193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21000): Terminating (SIGTERM) 21:58:59.988039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21003): Terminating (SIGTERM) 21:59:00.030242 --- ParallelTerminationStrategy: PID 20997 died... 21:59:00.050330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20997): Terminated: ok {rc=0} 21:59:00.096629 --- ParallelTerminationStrategy: PID 21000 died... 21:59:00.116380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21000): Terminated: ok {rc=0} 21:59:00.162761 --- ParallelTerminationStrategy: PID 21003 died... 21:59:00.182389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21003): Terminated: ok {rc=0} 21:59:00.270373 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 21:59:01.365132 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:59:01.381832 tst gprs:oc2g: Using 1 x bts (candidates: 1) 21:59:01.428257 tst ping_idle_ping.py: using LAC 23935 21:59:01.586895 tst ping_idle_ping.py: using RAC 220 21:59:01.743396 tst ping_idle_ping.py: using CellId 23935 21:59:01.862934 tst ping_idle_ping.py: using BVCI 23936 21:59:01.975467 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:59:01.986899 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:59:01.998282 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:59:02.011852 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:59:02.024177 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:59:02.035485 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:59:02.047897 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:59:02.060273 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:59:02.200449 tst ping_idle_ping.py:24: start network... 21:59:02.434495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:02.935106 run create_hlr_db(pid=21005): Launched 21:59:03.065828 bus /gobi_6: Setting Powered False 21:59:04.131033 run create_hlr_db(pid=21005): Terminated: ok {rc=0} 21:59:04.580165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21007): Launched 21:59:04.903754 run osmo-hlr_10.42.42.2(pid=21008): Launched 21:59:05.025970 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:05.583713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21010): Launched 21:59:05.907444 run osmo-stp_10.42.42.5(pid=21011): Launched 21:59:06.029600 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:59:06.586382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21013): Launched 21:59:06.709833 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:59:06.983035 run patchelf(pid=21014): Launched 21:59:07.161985 run osmo-stp_10.42.42.5(pid=21011): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21011)] 21:59:07.299227 run osmo-stp_10.42.42.5(pid=21011): stdout: | (launched: 2022-12-09_21:59:05.848162) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:07.437760 run osmo-stp_10.42.42.5(pid=21011): stderr: | 20221209215906041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215906041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215906041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215906042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215906042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215906042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215906042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:07.576067 run osmo-stp_10.42.42.5(pid=21011): stdout: | (launched: 2022-12-09_21:59:05.848162) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:07.708106 run osmo-stp_10.42.42.5(pid=21011): stderr: | 20221209215906041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215906041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215906041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215906042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215906042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215906042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215906042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:07.864282 run patchelf(pid=21014): Terminating (SIGINT) 21:59:08.046583 run patchelf(pid=21014): Terminated: ok {rc=0} 21:59:08.177386 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21011): Process ended prematurely: osmo-stp_10.42.42.5(pid=21011) [trial-2365↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21011)] [trial-2365↪gprs:oc2g↪ping_idle_ping.py:27] 21:59:08.186856 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 21:59:08.214929 run osmo-hlr_10.42.42.2(pid=21008): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21008)] 21:59:08.264935 run osmo-hlr_10.42.42.2(pid=21008): stdout: | (launched: 2022-12-09_21:59:04.844724) 21:59:08.316768 run osmo-hlr_10.42.42.2(pid=21008): stderr: | 20221209215905041 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215905041 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215905041 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215905041 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215905042 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215905042 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215905054 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215905064 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215905065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215905065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:08.368837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21007): Terminating (SIGTERM) 21:59:08.410642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21010): Terminating (SIGTERM) 21:59:08.452577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21013): Terminating (SIGTERM) 21:59:08.495182 --- ParallelTerminationStrategy: PID 21007 died... 21:59:08.515358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21007): Terminated: ok {rc=0} 21:59:08.561587 --- ParallelTerminationStrategy: PID 21010 died... 21:59:08.581192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21010): Terminated: ok {rc=0} 21:59:08.627162 --- ParallelTerminationStrategy: PID 21013 died... 21:59:08.646815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21013): Terminated: ok {rc=0} 21:59:08.734191 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 21:59:10.026552 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:59:10.032078 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:59:10.053143 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:59:10.092057 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:59:10.181018 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:59:10.201300 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:59:10.239550 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:59:10.836146 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:59:10.887560 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:10.898571 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:59:10.936261 tst cs_paging_gprs_active.py: using LAC 23936 21:59:11.065840 tst cs_paging_gprs_active.py: using RAC 221 21:59:11.191715 tst cs_paging_gprs_active.py: using CellId 23936 21:59:11.316715 tst cs_paging_gprs_active.py: using BVCI 23937 21:59:11.434049 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:11.445096 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:11.455939 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:11.466835 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:11.477628 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:11.488322 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:11.499270 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:11.510122 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:11.521054 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:11.636282 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:11.750079 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:59:11.952430 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:12.254657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21019): Launched 21:59:12.517546 run iperf3-srv_10.42.42.10(pid=21020): Launched 21:59:12.631827 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:59:12.834985 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:13.140145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21021): Launched 21:59:13.402521 run iperf3-srv_10.42.42.10(pid=21022): Launched 21:59:13.515367 tst cs_paging_gprs_active.py:38: start network... 21:59:13.716169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:14.183837 run create_hlr_db(pid=21023): Launched 21:59:14.299287 bus /gobi_6: Setting Powered False 21:59:15.358872 run create_hlr_db(pid=21023): Terminated: ok {rc=0} 21:59:15.799233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21025): Launched 21:59:16.150158 run osmo-hlr_10.42.42.2(pid=21026): Launched 21:59:16.333483 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:16.988169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21028): Launched 21:59:17.321638 run osmo-stp_10.42.42.5(pid=21029): Launched 21:59:17.447733 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:59:18.002725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21031): Launched 21:59:18.125562 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:59:18.397584 run patchelf(pid=21032): Launched 21:59:18.577450 run osmo-stp_10.42.42.5(pid=21029): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21029)] 21:59:18.715303 run osmo-stp_10.42.42.5(pid=21029): stdout: | (launched: 2022-12-09_21:59:17.255842) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:18.854762 run osmo-stp_10.42.42.5(pid=21029): stderr: | 20221209215917458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215917458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215917458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215917459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215917459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215917459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215917459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:18.993722 run osmo-stp_10.42.42.5(pid=21029): stdout: | (launched: 2022-12-09_21:59:17.255842) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:19.126803 run osmo-stp_10.42.42.5(pid=21029): stderr: | 20221209215917458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215917458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215917458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215917459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215917459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215917459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215917459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:19.284153 run patchelf(pid=21032): Terminating (SIGINT) 21:59:19.468331 run patchelf(pid=21032): Terminated: ok {rc=0} 21:59:19.600489 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21029): Process ended prematurely: osmo-stp_10.42.42.5(pid=21029) [trial-2365↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21029)] [trial-2365↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:59:19.610665 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 21:59:19.638883 run osmo-hlr_10.42.42.2(pid=21026): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21026)] 21:59:19.688879 run osmo-hlr_10.42.42.2(pid=21026): stdout: | (launched: 2022-12-09_21:59:16.087167) 21:59:19.740942 run osmo-hlr_10.42.42.2(pid=21026): stderr: | 20221209215916451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215916451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215916451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215916451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215916451 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215916452 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215916476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215916492 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215916492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215916492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:19.793356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21019): Terminating (SIGTERM) 21:59:19.835291 run iperf3-srv_10.42.42.10(pid=21020): Terminating (SIGTERM) 21:59:19.877329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21021): Terminating (SIGTERM) 21:59:19.919421 run iperf3-srv_10.42.42.10(pid=21022): Terminating (SIGTERM) 21:59:19.961568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21025): Terminating (SIGTERM) 21:59:20.003894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21028): Terminating (SIGTERM) 21:59:20.046132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21031): Terminating (SIGTERM) 21:59:20.088344 --- ParallelTerminationStrategy: PID 21019 died... 21:59:20.108560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21019): Terminated: ok {rc=0} 21:59:20.154983 --- ParallelTerminationStrategy: PID 21020 died... 21:59:20.174421 run iperf3-srv_10.42.42.10(pid=21020): Terminated {rc=256} 21:59:20.219989 --- ParallelTerminationStrategy: PID 21021 died... 21:59:20.239474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21021): Terminated: ok {rc=0} 21:59:20.285384 --- ParallelTerminationStrategy: PID 21022 died... 21:59:20.304733 run iperf3-srv_10.42.42.10(pid=21022): Terminated {rc=256} 21:59:20.350611 --- ParallelTerminationStrategy: PID 21025 died... 21:59:20.370113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21025): Terminated: ok {rc=0} 21:59:20.415651 --- ParallelTerminationStrategy: PID 21028 died... 21:59:20.434868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21028): Terminated: ok {rc=0} 21:59:20.480545 --- ParallelTerminationStrategy: PID 21031 died... 21:59:20.500167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21031): Terminated: ok {rc=0} 21:59:20.587386 bus /gobi_0: Setting Powered False 21:59:21.687321 bus /gobi_0: Setting Powered False 21:59:22.802411 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:59:23.950430 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:23.962313 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:59:24.000470 tst iperf3.py: using LAC 23937 21:59:24.128281 tst iperf3.py: using RAC 222 21:59:24.254487 tst iperf3.py: using CellId 23937 21:59:24.383895 tst iperf3.py: using BVCI 23938 21:59:24.495627 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:24.506448 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:24.517194 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:24.528364 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:24.539187 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:24.549998 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:24.560777 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:24.571210 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:24.582297 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:24.705418 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:59:24.923004 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:25.246424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21033): Launched 21:59:25.526413 run iperf3-srv_10.42.42.10(pid=21034): Launched 21:59:25.646158 tst iperf3.py:8: start network... 21:59:25.862134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:26.357859 run create_hlr_db(pid=21035): Launched 21:59:26.487554 bus /gobi_6: Setting Powered False 21:59:27.550343 run create_hlr_db(pid=21035): Terminated: ok {rc=0} 21:59:27.995744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21037): Launched 21:59:28.316187 run osmo-hlr_10.42.42.2(pid=21038): Launched 21:59:28.437975 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:28.987400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21040): Launched 21:59:29.308159 run osmo-stp_10.42.42.5(pid=21041): Launched 21:59:29.431236 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:59:29.983455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21043): Launched 21:59:30.105877 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:59:30.377456 run patchelf(pid=21044): Launched 21:59:30.556894 run osmo-stp_10.42.42.5(pid=21041): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21041)] 21:59:30.694514 run osmo-stp_10.42.42.5(pid=21041): stdout: | (launched: 2022-12-09_21:59:29.249487) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:30.837326 run osmo-stp_10.42.42.5(pid=21041): stderr: | 20221209215929443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215929443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215929443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215929444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215929444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215929444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215929444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:30.980532 run osmo-stp_10.42.42.5(pid=21041): stdout: | (launched: 2022-12-09_21:59:29.249487) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:31.108905 run osmo-stp_10.42.42.5(pid=21041): stderr: | 20221209215929443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215929443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215929443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215929444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215929444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215929444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215929444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:31.260730 run patchelf(pid=21044): Terminating (SIGINT) 21:59:31.440072 run patchelf(pid=21044): Terminated: ok {rc=0} 21:59:31.569493 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21041): Process ended prematurely: osmo-stp_10.42.42.5(pid=21041) [trial-2365↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21041)] [trial-2365↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 21:59:31.580543 tst iperf3.py:8: Test FAILED (7.7 sec) 21:59:31.611082 run osmo-hlr_10.42.42.2(pid=21038): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21038)] 21:59:31.661720 run osmo-hlr_10.42.42.2(pid=21038): stdout: | (launched: 2022-12-09_21:59:28.257683) 21:59:31.715499 run osmo-hlr_10.42.42.2(pid=21038): stderr: | 20221209215928455 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215928455 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215928455 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215928455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215928455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215928455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215928479 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215928492 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215928492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215928492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:31.768528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21033): Terminating (SIGTERM) 21:59:31.812232 run iperf3-srv_10.42.42.10(pid=21034): Terminating (SIGTERM) 21:59:31.858181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21037): Terminating (SIGTERM) 21:59:31.905629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21040): Terminating (SIGTERM) 21:59:31.950347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21043): Terminating (SIGTERM) 21:59:31.995223 --- ParallelTerminationStrategy: PID 21033 died... 21:59:32.015349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21033): Terminated: ok {rc=0} 21:59:32.065325 --- ParallelTerminationStrategy: PID 21034 died... 21:59:32.084922 run iperf3-srv_10.42.42.10(pid=21034): Terminated {rc=256} 21:59:32.134074 --- ParallelTerminationStrategy: PID 21037 died... 21:59:32.154192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21037): Terminated: ok {rc=0} 21:59:32.201513 --- ParallelTerminationStrategy: PID 21040 died... 21:59:32.220225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21040): Terminated: ok {rc=0} 21:59:32.265381 --- ParallelTerminationStrategy: PID 21043 died... 21:59:32.284308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21043): Terminated: ok {rc=0} 21:59:32.372197 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:59:33.523129 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:33.534487 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:59:33.571619 tst iperf3m4.py: using LAC 23938 21:59:33.691463 tst iperf3m4.py: using RAC 223 21:59:33.810309 tst iperf3m4.py: using CellId 23938 21:59:33.929641 tst iperf3m4.py: using BVCI 23939 21:59:34.038567 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:34.049348 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:34.059851 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:34.070630 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:34.081322 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:34.092005 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:34.102857 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:34.113766 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:34.124612 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:34.247341 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:34.369773 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:34.491253 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:34.610545 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:59:34.828596 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:35.152256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21045): Launched 21:59:35.430557 run iperf3-srv_10.42.42.10(pid=21046): Launched 21:59:35.553218 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:59:35.769623 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:36.091102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21047): Launched 21:59:36.352889 run iperf3-srv_10.42.42.10(pid=21048): Launched 21:59:36.465193 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:59:36.665832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:36.967044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21049): Launched 21:59:37.227897 run iperf3-srv_10.42.42.10(pid=21050): Launched 21:59:37.339912 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:59:37.540805 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:37.841629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21051): Launched 21:59:38.105404 run iperf3-srv_10.42.42.10(pid=21052): Launched 21:59:38.218677 tst iperf3m4.py:8: start network... 21:59:38.421161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:38.890875 run create_hlr_db(pid=21053): Launched 21:59:39.005456 bus /gobi_6: Setting Powered False 21:59:40.065678 run create_hlr_db(pid=21053): Terminated: ok {rc=0} 21:59:40.486138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21055): Launched 21:59:40.787473 run osmo-hlr_10.42.42.2(pid=21056): Launched 21:59:40.902805 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:41.433327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21058): Launched 21:59:41.736211 run osmo-stp_10.42.42.5(pid=21059): Launched 21:59:41.851301 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:59:42.370620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21061): Launched 21:59:42.487043 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:59:42.743242 run patchelf(pid=21062): Launched 21:59:42.911078 run osmo-stp_10.42.42.5(pid=21059): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21059)] 21:59:43.039684 run osmo-stp_10.42.42.5(pid=21059): stdout: | (launched: 2022-12-09_21:59:41.680056) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:43.169904 run osmo-stp_10.42.42.5(pid=21059): stderr: | 20221209215941851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215941851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215941851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215941852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215941852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215941852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215941852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:43.299986 run osmo-stp_10.42.42.5(pid=21059): stdout: | (launched: 2022-12-09_21:59:41.680056) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:43.423759 run osmo-stp_10.42.42.5(pid=21059): stderr: | 20221209215941851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215941851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215941851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215941852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215941852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215941852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215941852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:43.570565 run patchelf(pid=21062): Terminating (SIGINT) 21:59:43.742011 run patchelf(pid=21062): Terminated: ok {rc=0} 21:59:43.865701 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21059): Process ended prematurely: osmo-stp_10.42.42.5(pid=21059) [trial-2365↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21059)] [trial-2365↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 21:59:43.875253 tst iperf3m4.py:8: Test FAILED (10.4 sec) 21:59:43.903295 run osmo-hlr_10.42.42.2(pid=21056): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21056)] 21:59:43.951557 run osmo-hlr_10.42.42.2(pid=21056): stdout: | (launched: 2022-12-09_21:59:40.731964) 21:59:44.001357 run osmo-hlr_10.42.42.2(pid=21056): stderr: | 20221209215940909 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215940909 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215940909 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215940909 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215940909 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215940909 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215940925 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215940935 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215940935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215940935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:44.051462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21045): Terminating (SIGTERM) 21:59:44.091674 run iperf3-srv_10.42.42.10(pid=21046): Terminating (SIGTERM) 21:59:44.131798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21047): Terminating (SIGTERM) 21:59:44.172232 run iperf3-srv_10.42.42.10(pid=21048): Terminating (SIGTERM) 21:59:44.212371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21049): Terminating (SIGTERM) 21:59:44.252377 run iperf3-srv_10.42.42.10(pid=21050): Terminating (SIGTERM) 21:59:44.292436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21051): Terminating (SIGTERM) 21:59:44.332510 run iperf3-srv_10.42.42.10(pid=21052): Terminating (SIGTERM) 21:59:44.372374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21055): Terminating (SIGTERM) 21:59:44.412348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21058): Terminating (SIGTERM) 21:59:44.452466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21061): Terminating (SIGTERM) 21:59:44.492683 --- ParallelTerminationStrategy: PID 21045 died... 21:59:44.511728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21045): Terminated: ok {rc=0} 21:59:44.556408 --- ParallelTerminationStrategy: PID 21046 died... 21:59:44.575125 run iperf3-srv_10.42.42.10(pid=21046): Terminated {rc=256} 21:59:44.619482 --- ParallelTerminationStrategy: PID 21047 died... 21:59:44.638104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21047): Terminated: ok {rc=0} 21:59:44.682272 --- ParallelTerminationStrategy: PID 21048 died... 21:59:44.700998 run iperf3-srv_10.42.42.10(pid=21048): Terminated {rc=256} 21:59:44.745152 --- ParallelTerminationStrategy: PID 21049 died... 21:59:44.763729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21049): Terminated: ok {rc=0} 21:59:44.807942 --- ParallelTerminationStrategy: PID 21050 died... 21:59:44.826657 run iperf3-srv_10.42.42.10(pid=21050): Terminated {rc=256} 21:59:44.870841 --- ParallelTerminationStrategy: PID 21051 died... 21:59:44.889384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21051): Terminated: ok {rc=0} 21:59:44.933331 --- ParallelTerminationStrategy: PID 21052 died... 21:59:44.951984 run iperf3-srv_10.42.42.10(pid=21052): Terminated {rc=256} 21:59:44.996597 --- ParallelTerminationStrategy: PID 21055 died... 21:59:45.015046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21055): Terminated: ok {rc=0} 21:59:45.059177 --- ParallelTerminationStrategy: PID 21058 died... 21:59:45.077716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21058): Terminated: ok {rc=0} 21:59:45.122474 --- ParallelTerminationStrategy: PID 21061 died... 21:59:45.141102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21061): Terminated: ok {rc=0} 21:59:45.224703 bus /gobi_4: Setting Powered False 21:59:46.321568 bus /gobi_4: Setting Powered False 21:59:47.437980 bus /gobi_1: Setting Powered False 21:59:48.534136 bus /gobi_1: Setting Powered False 21:59:49.646348 bus /gobi_0: Setting Powered False 21:59:50.745174 bus /gobi_0: Setting Powered False 21:59:51.862378 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 21:59:52.964070 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:52.975917 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:59:53.017409 tst ping.py: using LAC 23939 21:59:53.140845 tst ping.py: using RAC 224 21:59:53.266308 tst ping.py: using CellId 23939 21:59:53.388527 tst ping.py: using BVCI 23940 21:59:53.503474 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:53.514668 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:53.525789 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:53.536724 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:53.547643 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:53.558653 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:53.569776 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:53.580898 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:53.699359 tst ping.py:19: start network... 21:59:53.897192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:54.353100 run create_hlr_db(pid=21063): Launched 21:59:54.465508 bus /gobi_6: Setting Powered False 21:59:55.524676 run create_hlr_db(pid=21063): Terminated: ok {rc=0} 21:59:55.958104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21065): Launched 21:59:56.273565 run osmo-hlr_10.42.42.2(pid=21066): Launched 21:59:56.394794 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:56.944411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21068): Launched 21:59:57.260700 run osmo-stp_10.42.42.5(pid=21069): Launched 21:59:57.382116 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:59:57.929436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21071): Launched 21:59:58.050635 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:59:58.318635 run patchelf(pid=21072): Launched 21:59:58.493778 run osmo-stp_10.42.42.5(pid=21069): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21069)] 21:59:58.628061 run osmo-stp_10.42.42.5(pid=21069): stdout: | (launched: 2022-12-09_21:59:57.202849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:58.764263 run osmo-stp_10.42.42.5(pid=21069): stderr: | 20221209215957397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215957397 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215957397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215957397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215957398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215957398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215957398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:58.899712 run osmo-stp_10.42.42.5(pid=21069): stdout: | (launched: 2022-12-09_21:59:57.202849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:59.028609 run osmo-stp_10.42.42.5(pid=21069): stderr: | 20221209215957397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209215957397 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209215957397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209215957397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209215957398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209215957398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209215957398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:59.181965 run patchelf(pid=21072): Terminating (SIGINT) 21:59:59.360352 run patchelf(pid=21072): Terminated: ok {rc=0} 21:59:59.488248 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21069): Process ended prematurely: osmo-stp_10.42.42.5(pid=21069) [trial-2365↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21069)] [trial-2365↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 21:59:59.497781 tst ping.py:22: Test FAILED (6.5 sec) 21:59:59.525694 run osmo-hlr_10.42.42.2(pid=21066): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21066)] 21:59:59.575772 run osmo-hlr_10.42.42.2(pid=21066): stdout: | (launched: 2022-12-09_21:59:56.215621) 21:59:59.627850 run osmo-hlr_10.42.42.2(pid=21066): stderr: | 20221209215956416 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209215956416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209215956416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209215956416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209215956417 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209215956417 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209215956429 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209215956437 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209215956437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209215956437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:59.680276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21065): Terminating (SIGTERM) 21:59:59.722574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21068): Terminating (SIGTERM) 21:59:59.764391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21071): Terminating (SIGTERM) 21:59:59.806816 --- ParallelTerminationStrategy: PID 21065 died... 21:59:59.826978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21065): Terminated: ok {rc=0} 21:59:59.873578 --- ParallelTerminationStrategy: PID 21068 died... 21:59:59.893278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21068): Terminated: ok {rc=0} 21:59:59.939398 --- ParallelTerminationStrategy: PID 21071 died... 21:59:59.959029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21071): Terminated: ok {rc=0} 22:00:00.046620 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:00:01.132336 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:00:01.144623 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:00:01.183451 tst ping_idle_ping.py: using LAC 23940 22:00:01.341568 tst ping_idle_ping.py: using RAC 225 22:00:01.469019 tst ping_idle_ping.py: using CellId 23940 22:00:01.597708 tst ping_idle_ping.py: using BVCI 23941 22:00:01.747685 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:00:01.762755 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:00:01.778277 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:00:01.793494 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:00:01.808340 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:00:01.823808 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:00:01.838100 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:00:01.853964 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:00:01.974778 tst ping_idle_ping.py:24: start network... 22:00:02.181134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:02.646310 run create_hlr_db(pid=21077): Launched 22:00:02.759084 bus /gobi_6: Setting Powered False 22:00:03.817700 run create_hlr_db(pid=21077): Terminated: ok {rc=0} 22:00:04.231709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21079): Launched 22:00:04.528178 run osmo-hlr_10.42.42.2(pid=21080): Launched 22:00:04.639667 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:05.147655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21082): Launched 22:00:05.444146 run osmo-stp_10.42.42.5(pid=21083): Launched 22:00:05.556481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:00:06.067383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21085): Launched 22:00:06.180329 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:00:06.430995 run patchelf(pid=21086): Launched 22:00:06.595819 run osmo-stp_10.42.42.5(pid=21083): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21083)] 22:00:06.722464 run osmo-stp_10.42.42.5(pid=21083): stdout: | (launched: 2022-12-09_22:00:05.389245) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:06.850304 run osmo-stp_10.42.42.5(pid=21083): stderr: | 20221209220005560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220005561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220005561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220005561 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220005562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220005562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220005562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:06.978139 run osmo-stp_10.42.42.5(pid=21083): stdout: | (launched: 2022-12-09_22:00:05.389245) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:07.099476 run osmo-stp_10.42.42.5(pid=21083): stderr: | 20221209220005560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220005561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220005561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220005561 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220005562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220005562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220005562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:07.243103 run patchelf(pid=21086): Terminating (SIGINT) 22:00:07.411375 run patchelf(pid=21086): Terminated: ok {rc=0} 22:00:07.532731 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21083): Process ended prematurely: osmo-stp_10.42.42.5(pid=21083) [trial-2365↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21083)] [trial-2365↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 22:00:07.541682 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:00:07.568725 run osmo-hlr_10.42.42.2(pid=21080): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21080)] 22:00:07.616685 run osmo-hlr_10.42.42.2(pid=21080): stdout: | (launched: 2022-12-09_22:00:04.473545) 22:00:07.666287 run osmo-hlr_10.42.42.2(pid=21080): stderr: | 20221209220004648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220004648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220004649 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220004649 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220004649 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220004649 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220004662 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220004670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220004670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220004671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:07.716602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21079): Terminating (SIGTERM) 22:00:07.756686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21082): Terminating (SIGTERM) 22:00:07.796597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21085): Terminating (SIGTERM) 22:00:07.836852 --- ParallelTerminationStrategy: PID 21079 died... 22:00:07.856048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21079): Terminated: ok {rc=0} 22:00:07.900667 --- ParallelTerminationStrategy: PID 21082 died... 22:00:07.919401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21082): Terminated: ok {rc=0} 22:00:07.963921 --- ParallelTerminationStrategy: PID 21085 died... 22:00:07.982543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21085): Terminated: ok {rc=0} 22:00:08.068397 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:00:09.360602 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:00:09.366896 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:00:09.387846 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:00:09.427097 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:00:09.512892 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:00:09.533237 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:00:09.571219 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:00:10.164043 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:00:10.213102 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:10.223874 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:00:10.278902 tst cs_paging_gprs_active.py: using LAC 23941 22:00:10.396738 tst cs_paging_gprs_active.py: using RAC 226 22:00:10.514290 tst cs_paging_gprs_active.py: using CellId 23941 22:00:10.633365 tst cs_paging_gprs_active.py: using BVCI 23942 22:00:10.745276 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:10.756038 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:10.766554 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:10.777375 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:10.787908 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:10.798644 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:10.809521 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:10.820118 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:10.830989 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:10.946712 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:11.062457 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:00:11.266262 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:11.570032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21091): Launched 22:00:11.835435 run iperf3-srv_10.42.42.10(pid=21092): Launched 22:00:11.949681 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:00:12.152127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:12.456043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21093): Launched 22:00:12.719734 run iperf3-srv_10.42.42.10(pid=21094): Launched 22:00:12.833195 tst cs_paging_gprs_active.py:38: start network... 22:00:13.036000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:13.503354 run create_hlr_db(pid=21095): Launched 22:00:13.618527 bus /gobi_6: Setting Powered False 22:00:14.679074 run create_hlr_db(pid=21095): Terminated: ok {rc=0} 22:00:15.100754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21097): Launched 22:00:15.402902 run osmo-hlr_10.42.42.2(pid=21098): Launched 22:00:15.518065 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:16.103604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21100): Launched 22:00:16.426476 run osmo-stp_10.42.42.5(pid=21101): Launched 22:00:16.762751 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:00:17.416173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21103): Launched 22:00:17.539781 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:00:17.813216 run patchelf(pid=21104): Launched 22:00:17.992301 run osmo-stp_10.42.42.5(pid=21101): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21101)] 22:00:18.129158 run osmo-stp_10.42.42.5(pid=21101): stdout: | (launched: 2022-12-09_22:00:16.364587) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:18.267503 run osmo-stp_10.42.42.5(pid=21101): stderr: | 20221209220016647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220016647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220016648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220016650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220016650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220016651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220016651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:18.405801 run osmo-stp_10.42.42.5(pid=21101): stdout: | (launched: 2022-12-09_22:00:16.364587) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:18.537872 run osmo-stp_10.42.42.5(pid=21101): stderr: | 20221209220016647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220016647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220016648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220016650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220016650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220016651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220016651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:18.694520 run patchelf(pid=21104): Terminating (SIGINT) 22:00:18.877184 run patchelf(pid=21104): Terminated: ok {rc=0} 22:00:19.008540 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21101): Process ended prematurely: osmo-stp_10.42.42.5(pid=21101) [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21101)] [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:00:19.018582 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 22:00:19.046752 run osmo-hlr_10.42.42.2(pid=21098): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21098)] 22:00:19.096354 run osmo-hlr_10.42.42.2(pid=21098): stdout: | (launched: 2022-12-09_22:00:15.347335) 22:00:19.147850 run osmo-hlr_10.42.42.2(pid=21098): stderr: | 20221209220015526 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220015526 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220015526 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220015526 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220015526 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220015526 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220015538 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220015547 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220015547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220015547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:19.199846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21091): Terminating (SIGTERM) 22:00:19.241562 run iperf3-srv_10.42.42.10(pid=21092): Terminating (SIGTERM) 22:00:19.283213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21093): Terminating (SIGTERM) 22:00:19.324742 run iperf3-srv_10.42.42.10(pid=21094): Terminating (SIGTERM) 22:00:19.366249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21097): Terminating (SIGTERM) 22:00:19.408169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21100): Terminating (SIGTERM) 22:00:19.450210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21103): Terminating (SIGTERM) 22:00:19.491850 --- ParallelTerminationStrategy: PID 21091 died... 22:00:19.511685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21091): Terminated: ok {rc=0} 22:00:19.557697 --- ParallelTerminationStrategy: PID 21092 died... 22:00:19.577327 run iperf3-srv_10.42.42.10(pid=21092): Terminated {rc=256} 22:00:19.622953 --- ParallelTerminationStrategy: PID 21093 died... 22:00:19.642327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21093): Terminated: ok {rc=0} 22:00:19.688167 --- ParallelTerminationStrategy: PID 21094 died... 22:00:19.707297 run iperf3-srv_10.42.42.10(pid=21094): Terminated {rc=256} 22:00:19.753298 --- ParallelTerminationStrategy: PID 21097 died... 22:00:19.772700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21097): Terminated: ok {rc=0} 22:00:19.819031 --- ParallelTerminationStrategy: PID 21100 died... 22:00:19.838425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21100): Terminated: ok {rc=0} 22:00:19.884036 --- ParallelTerminationStrategy: PID 21103 died... 22:00:19.903411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21103): Terminated: ok {rc=0} 22:00:19.990789 bus /gobi_0: Setting Powered False 22:00:21.090750 bus /gobi_0: Setting Powered False 22:00:22.208410 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:00:23.353090 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:23.364521 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:00:23.422616 tst iperf3.py: using LAC 23942 22:00:23.542605 tst iperf3.py: using RAC 227 22:00:23.662259 tst iperf3.py: using CellId 23942 22:00:23.780848 tst iperf3.py: using BVCI 23943 22:00:23.901996 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:23.913430 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:23.924488 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:23.935632 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:23.946636 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:23.957949 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:23.969558 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:23.980527 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:23.991854 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:24.111154 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:00:24.328243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:24.652438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21105): Launched 22:00:24.932852 run iperf3-srv_10.42.42.10(pid=21106): Launched 22:00:25.053251 tst iperf3.py:8: start network... 22:00:25.272840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:25.773760 run create_hlr_db(pid=21107): Launched 22:00:25.904413 bus /gobi_6: Setting Powered False 22:00:26.964505 run create_hlr_db(pid=21107): Terminated: ok {rc=0} 22:00:27.415264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21109): Launched 22:00:27.739196 run osmo-hlr_10.42.42.2(pid=21110): Launched 22:00:27.861438 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:28.413625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21112): Launched 22:00:28.734998 run osmo-stp_10.42.42.5(pid=21113): Launched 22:00:28.856249 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:00:29.410388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21115): Launched 22:00:29.531474 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:00:29.805294 run patchelf(pid=21116): Launched 22:00:29.981812 run osmo-stp_10.42.42.5(pid=21113): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21113)] 22:00:30.117509 run osmo-stp_10.42.42.5(pid=21113): stdout: | (launched: 2022-12-09_22:00:28.673082) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:30.254254 run osmo-stp_10.42.42.5(pid=21113): stderr: | 20221209220028866 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220028867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220028867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220028867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220028868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220028868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220028868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:30.391042 run osmo-stp_10.42.42.5(pid=21113): stdout: | (launched: 2022-12-09_22:00:28.673082) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:30.521172 run osmo-stp_10.42.42.5(pid=21113): stderr: | 20221209220028866 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220028867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220028867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220028867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220028868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220028868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220028868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:30.675247 run patchelf(pid=21116): Terminating (SIGINT) 22:00:30.857089 run patchelf(pid=21116): Terminated: ok {rc=0} 22:00:30.994811 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21113): Process ended prematurely: osmo-stp_10.42.42.5(pid=21113) [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21113)] [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 22:00:31.005490 tst iperf3.py:8: Test FAILED (7.7 sec) 22:00:31.034507 run osmo-hlr_10.42.42.2(pid=21110): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21110)] 22:00:31.085758 run osmo-hlr_10.42.42.2(pid=21110): stdout: | (launched: 2022-12-09_22:00:27.675574) 22:00:31.138328 run osmo-hlr_10.42.42.2(pid=21110): stderr: | 20221209220027879 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220027879 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220027879 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220027879 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220027879 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220027879 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220027892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220027900 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220027901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220027901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:31.191255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21105): Terminating (SIGTERM) 22:00:31.233785 run iperf3-srv_10.42.42.10(pid=21106): Terminating (SIGTERM) 22:00:31.276089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21109): Terminating (SIGTERM) 22:00:31.318755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21112): Terminating (SIGTERM) 22:00:31.361574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21115): Terminating (SIGTERM) 22:00:31.405893 --- ParallelTerminationStrategy: PID 21105 died... 22:00:31.426592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21105): Terminated: ok {rc=0} 22:00:31.475389 --- ParallelTerminationStrategy: PID 21106 died... 22:00:31.495422 run iperf3-srv_10.42.42.10(pid=21106): Terminated {rc=256} 22:00:31.541633 --- ParallelTerminationStrategy: PID 21109 died... 22:00:31.561874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21109): Terminated: ok {rc=0} 22:00:31.608249 --- ParallelTerminationStrategy: PID 21112 died... 22:00:31.628559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21112): Terminated: ok {rc=0} 22:00:31.675003 --- ParallelTerminationStrategy: PID 21115 died... 22:00:31.694732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21115): Terminated: ok {rc=0} 22:00:31.783210 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:00:32.933879 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:32.945703 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:00:33.002936 tst iperf3m4.py: using LAC 23943 22:00:33.130086 tst iperf3m4.py: using RAC 228 22:00:33.257567 tst iperf3m4.py: using CellId 23943 22:00:33.383489 tst iperf3m4.py: using BVCI 23944 22:00:33.499043 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:33.510427 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:33.521471 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:33.532430 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:33.543247 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:33.554396 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:33.565625 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:33.576348 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:33.587383 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:33.703769 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:33.823132 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:33.942698 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:34.060331 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:00:34.261698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:34.567127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21117): Launched 22:00:34.831005 run iperf3-srv_10.42.42.10(pid=21118): Launched 22:00:34.943588 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:00:35.143504 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:35.458377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21119): Launched 22:00:35.721415 run iperf3-srv_10.42.42.10(pid=21120): Launched 22:00:35.835061 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:00:36.037934 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:36.343810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21121): Launched 22:00:36.608265 run iperf3-srv_10.42.42.10(pid=21122): Launched 22:00:36.720660 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:00:36.920039 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:37.223105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21123): Launched 22:00:37.487082 run iperf3-srv_10.42.42.10(pid=21124): Launched 22:00:37.598925 tst iperf3m4.py:8: start network... 22:00:37.798533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:38.262409 run create_hlr_db(pid=21125): Launched 22:00:38.393279 bus /gobi_6: Setting Powered False 22:00:39.456657 run create_hlr_db(pid=21125): Terminated: ok {rc=0} 22:00:39.904774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21127): Launched 22:00:40.229738 run osmo-hlr_10.42.42.2(pid=21128): Launched 22:00:40.350423 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:40.901631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21130): Launched 22:00:41.224896 run osmo-stp_10.42.42.5(pid=21131): Launched 22:00:41.345156 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:00:41.898878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21133): Launched 22:00:42.021257 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:00:42.295057 run patchelf(pid=21134): Launched 22:00:42.472359 run osmo-stp_10.42.42.5(pid=21131): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21131)] 22:00:42.607988 run osmo-stp_10.42.42.5(pid=21131): stdout: | (launched: 2022-12-09_22:00:41.162687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:42.745373 run osmo-stp_10.42.42.5(pid=21131): stderr: | 20221209220041358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220041358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220041358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220041359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220041359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220041359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220041359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:42.882273 run osmo-stp_10.42.42.5(pid=21131): stdout: | (launched: 2022-12-09_22:00:41.162687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:43.012913 run osmo-stp_10.42.42.5(pid=21131): stderr: | 20221209220041358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220041358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220041358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220041359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220041359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220041359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220041359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:43.167605 run patchelf(pid=21134): Terminating (SIGINT) 22:00:43.348441 run patchelf(pid=21134): Terminated: ok {rc=0} 22:00:43.478376 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21131): Process ended prematurely: osmo-stp_10.42.42.5(pid=21131) [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21131)] [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:00:43.488235 tst iperf3m4.py:8: Test FAILED (10.6 sec) 22:00:43.516729 run osmo-hlr_10.42.42.2(pid=21128): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21128)] 22:00:43.566407 run osmo-hlr_10.42.42.2(pid=21128): stdout: | (launched: 2022-12-09_22:00:40.166588) 22:00:43.617641 run osmo-hlr_10.42.42.2(pid=21128): stderr: | 20221209220040371 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220040371 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220040371 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220040371 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220040371 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220040371 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220040384 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220040393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220040393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220040393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:43.669271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21117): Terminating (SIGTERM) 22:00:43.710779 run iperf3-srv_10.42.42.10(pid=21118): Terminating (SIGTERM) 22:00:43.752583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21119): Terminating (SIGTERM) 22:00:43.794497 run iperf3-srv_10.42.42.10(pid=21120): Terminating (SIGTERM) 22:00:43.836162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21121): Terminating (SIGTERM) 22:00:43.878237 run iperf3-srv_10.42.42.10(pid=21122): Terminating (SIGTERM) 22:00:43.919708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21123): Terminating (SIGTERM) 22:00:43.961433 run iperf3-srv_10.42.42.10(pid=21124): Terminating (SIGTERM) 22:00:44.003358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21127): Terminating (SIGTERM) 22:00:44.045151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21130): Terminating (SIGTERM) 22:00:44.086763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21133): Terminating (SIGTERM) 22:00:44.128594 --- ParallelTerminationStrategy: PID 21117 died... 22:00:44.148652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21117): Terminated: ok {rc=0} 22:00:44.194941 --- ParallelTerminationStrategy: PID 21118 died... 22:00:44.214392 run iperf3-srv_10.42.42.10(pid=21118): Terminated {rc=256} 22:00:44.260202 --- ParallelTerminationStrategy: PID 21119 died... 22:00:44.279751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21119): Terminated: ok {rc=0} 22:00:44.325703 --- ParallelTerminationStrategy: PID 21120 died... 22:00:44.345143 run iperf3-srv_10.42.42.10(pid=21120): Terminated {rc=256} 22:00:44.390828 --- ParallelTerminationStrategy: PID 21121 died... 22:00:44.410155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21121): Terminated: ok {rc=0} 22:00:44.455699 --- ParallelTerminationStrategy: PID 21122 died... 22:00:44.475019 run iperf3-srv_10.42.42.10(pid=21122): Terminated {rc=256} 22:00:44.520635 --- ParallelTerminationStrategy: PID 21123 died... 22:00:44.539989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21123): Terminated: ok {rc=0} 22:00:44.585685 --- ParallelTerminationStrategy: PID 21124 died... 22:00:44.604915 run iperf3-srv_10.42.42.10(pid=21124): Terminated {rc=256} 22:00:44.650356 --- ParallelTerminationStrategy: PID 21127 died... 22:00:44.669668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21127): Terminated: ok {rc=0} 22:00:44.715393 --- ParallelTerminationStrategy: PID 21130 died... 22:00:44.734947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21130): Terminated: ok {rc=0} 22:00:44.781087 --- ParallelTerminationStrategy: PID 21133 died... 22:00:44.800536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21133): Terminated: ok {rc=0} 22:00:44.887673 bus /gobi_4: Setting Powered False 22:00:45.999577 bus /gobi_4: Setting Powered False 22:00:47.113698 bus /gobi_1: Setting Powered False 22:00:48.210378 bus /gobi_1: Setting Powered False 22:00:49.325329 bus /gobi_0: Setting Powered False 22:00:50.423867 bus /gobi_0: Setting Powered False 22:00:51.540132 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:00:52.645228 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:52.657074 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:00:52.714823 tst ping.py: using LAC 23944 22:00:52.840609 tst ping.py: using RAC 229 22:00:52.963873 tst ping.py: using CellId 23944 22:00:53.092029 tst ping.py: using BVCI 23945 22:00:53.206641 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:53.218069 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:53.229204 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:53.240294 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:53.251496 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:53.262429 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:53.273586 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:53.284426 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:53.398218 tst ping.py:19: start network... 22:00:53.596714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:54.053547 run create_hlr_db(pid=21135): Launched 22:00:54.167079 bus /gobi_6: Setting Powered False 22:00:55.225666 run create_hlr_db(pid=21135): Terminated: ok {rc=0} 22:00:55.638996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21137): Launched 22:00:55.934755 run osmo-hlr_10.42.42.2(pid=21138): Launched 22:00:56.047067 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:56.569659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21140): Launched 22:00:56.863935 run osmo-stp_10.42.42.5(pid=21141): Launched 22:00:56.975286 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:00:57.483536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21143): Launched 22:00:57.604871 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:00:57.874769 run patchelf(pid=21144): Launched 22:00:58.048852 run osmo-stp_10.42.42.5(pid=21141): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21141)] 22:00:58.183097 run osmo-stp_10.42.42.5(pid=21141): stdout: | (launched: 2022-12-09_22:00:56.807927) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:58.318652 run osmo-stp_10.42.42.5(pid=21141): stderr: | 20221209220056977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220056977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220056977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220056978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220056980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220056980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220056980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:58.454331 run osmo-stp_10.42.42.5(pid=21141): stdout: | (launched: 2022-12-09_22:00:56.807927) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:58.582911 run osmo-stp_10.42.42.5(pid=21141): stderr: | 20221209220056977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220056977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220056977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220056978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220056980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220056980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220056980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:58.735391 run patchelf(pid=21144): Terminating (SIGINT) 22:00:58.913807 run patchelf(pid=21144): Terminated: ok {rc=0} 22:00:59.041266 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21141): Process ended prematurely: osmo-stp_10.42.42.5(pid=21141) [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21141)] [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 22:00:59.050924 tst ping.py:22: Test FAILED (6.4 sec) 22:00:59.078802 run osmo-hlr_10.42.42.2(pid=21138): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21138)] 22:00:59.128816 run osmo-hlr_10.42.42.2(pid=21138): stdout: | (launched: 2022-12-09_22:00:55.877820) 22:00:59.180825 run osmo-hlr_10.42.42.2(pid=21138): stderr: | 20221209220056056 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220056056 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220056056 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220056056 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220056056 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220056056 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220056068 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220056077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220056077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220056077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:59.233099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21137): Terminating (SIGTERM) 22:00:59.275016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21140): Terminating (SIGTERM) 22:00:59.317754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21143): Terminating (SIGTERM) 22:00:59.359998 --- ParallelTerminationStrategy: PID 21137 died... 22:00:59.380040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21137): Terminated: ok {rc=0} 22:00:59.426945 --- ParallelTerminationStrategy: PID 21140 died... 22:00:59.446606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21140): Terminated: ok {rc=0} 22:00:59.492609 --- ParallelTerminationStrategy: PID 21143 died... 22:00:59.512005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21143): Terminated: ok {rc=0} 22:00:59.600587 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:01:00.688029 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:01:00.700577 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:01:00.758631 tst ping_idle_ping.py: using LAC 23945 22:01:00.895244 tst ping_idle_ping.py: using RAC 230 22:01:01.023465 tst ping_idle_ping.py: using CellId 23945 22:01:01.148214 tst ping_idle_ping.py: using BVCI 23946 22:01:01.259322 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:01:01.271432 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:01:01.283008 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:01:01.295708 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:01:01.308324 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:01:01.320858 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:01:01.333566 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:01:01.346897 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:01:01.488172 tst ping_idle_ping.py:24: start network... 22:01:01.759168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:02.263408 run create_hlr_db(pid=21145): Launched 22:01:02.408191 bus /gobi_6: Setting Powered False 22:01:03.471798 run create_hlr_db(pid=21145): Terminated: ok {rc=0} 22:01:03.896834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21147): Launched 22:01:04.193678 run osmo-hlr_10.42.42.2(pid=21148): Launched 22:01:04.305178 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:04.827500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21150): Launched 22:01:05.123967 run osmo-stp_10.42.42.5(pid=21151): Launched 22:01:05.235866 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:01:05.745663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21153): Launched 22:01:05.857771 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:01:06.108704 run patchelf(pid=21154): Launched 22:01:06.272773 run osmo-stp_10.42.42.5(pid=21151): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21151)] 22:01:06.398062 run osmo-stp_10.42.42.5(pid=21151): stdout: | (launched: 2022-12-09_22:01:05.067133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:06.524935 run osmo-stp_10.42.42.5(pid=21151): stderr: | 20221209220105240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220105240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220105241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220105241 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220105241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220105242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220105242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:06.651901 run osmo-stp_10.42.42.5(pid=21151): stdout: | (launched: 2022-12-09_22:01:05.067133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:06.772316 run osmo-stp_10.42.42.5(pid=21151): stderr: | 20221209220105240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220105240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220105241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220105241 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220105241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220105242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220105242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:06.914930 run patchelf(pid=21154): Terminating (SIGINT) 22:01:07.081567 run patchelf(pid=21154): Terminated: ok {rc=0} 22:01:07.201640 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21151): Process ended prematurely: osmo-stp_10.42.42.5(pid=21151) [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21151)] [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:01:07.210359 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:01:07.236811 run osmo-hlr_10.42.42.2(pid=21148): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21148)] 22:01:07.285071 run osmo-hlr_10.42.42.2(pid=21148): stdout: | (launched: 2022-12-09_22:01:04.136827) 22:01:07.334660 run osmo-hlr_10.42.42.2(pid=21148): stderr: | 20221209220104315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220104315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220104315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220104315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220104315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220104315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220104329 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220104338 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220104339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220104339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:07.384609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21147): Terminating (SIGTERM) 22:01:07.424558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21150): Terminating (SIGTERM) 22:01:07.464390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21153): Terminating (SIGTERM) 22:01:07.504540 --- ParallelTerminationStrategy: PID 21147 died... 22:01:07.523737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21147): Terminated: ok {rc=0} 22:01:07.568428 --- ParallelTerminationStrategy: PID 21150 died... 22:01:07.587210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21150): Terminated: ok {rc=0} 22:01:07.631620 --- ParallelTerminationStrategy: PID 21153 died... 22:01:07.650409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21153): Terminated: ok {rc=0} 22:01:07.736550 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:01:09.025105 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:01:09.031331 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:01:09.052477 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:01:09.090603 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:01:09.177060 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:01:09.197744 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:01:09.235341 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:01:09.826267 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:01:09.874822 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:09.885572 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:01:09.945366 tst cs_paging_gprs_active.py: using LAC 23946 22:01:10.062886 tst cs_paging_gprs_active.py: using RAC 231 22:01:10.178131 tst cs_paging_gprs_active.py: using CellId 23946 22:01:10.294946 tst cs_paging_gprs_active.py: using BVCI 23947 22:01:10.403591 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:10.414397 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:10.424870 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:10.435632 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:10.446358 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:10.457169 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:10.468019 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:10.478670 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:10.489661 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:10.609671 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:10.730126 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:01:10.948696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:11.271113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21158): Launched 22:01:11.552040 run iperf3-srv_10.42.42.10(pid=21160): Launched 22:01:11.674017 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:01:11.891405 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:12.214242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21161): Launched 22:01:12.494622 run iperf3-srv_10.42.42.10(pid=21162): Launched 22:01:12.615864 tst cs_paging_gprs_active.py:38: start network... 22:01:12.833769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:13.331608 run create_hlr_db(pid=21163): Launched 22:01:13.463649 bus /gobi_6: Setting Powered False 22:01:14.526925 run create_hlr_db(pid=21163): Terminated: ok {rc=0} 22:01:14.974777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21165): Launched 22:01:15.297534 run osmo-hlr_10.42.42.2(pid=21166): Launched 22:01:15.422442 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:15.993717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21168): Launched 22:01:16.331335 run osmo-stp_10.42.42.5(pid=21169): Launched 22:01:16.488584 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:01:17.154997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21171): Launched 22:01:17.286233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:01:17.562305 run patchelf(pid=21172): Launched 22:01:17.742430 run osmo-stp_10.42.42.5(pid=21169): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21169)] 22:01:17.879861 run osmo-stp_10.42.42.5(pid=21169): stdout: | (launched: 2022-12-09_22:01:16.268097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:18.017760 run osmo-stp_10.42.42.5(pid=21169): stderr: | 20221209220116653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220116653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220116654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220116654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220116656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220116657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220116657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:18.155816 run osmo-stp_10.42.42.5(pid=21169): stdout: | (launched: 2022-12-09_22:01:16.268097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:18.288293 run osmo-stp_10.42.42.5(pid=21169): stderr: | 20221209220116653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220116653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220116654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220116654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220116656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220116657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220116657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:18.445674 run patchelf(pid=21172): Terminating (SIGINT) 22:01:18.627801 run patchelf(pid=21172): Terminated: ok {rc=0} 22:01:18.759455 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21169): Process ended prematurely: osmo-stp_10.42.42.5(pid=21169) [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21169)] [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:01:18.769566 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 22:01:18.798011 run osmo-hlr_10.42.42.2(pid=21166): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21166)] 22:01:18.847845 run osmo-hlr_10.42.42.2(pid=21166): stdout: | (launched: 2022-12-09_22:01:15.239440) 22:01:18.899262 run osmo-hlr_10.42.42.2(pid=21166): stderr: | 20221209220115437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220115437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220115437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220115437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220115437 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220115437 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220115449 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220115457 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220115457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220115457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:18.951094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21158): Terminating (SIGTERM) 22:01:18.993067 run iperf3-srv_10.42.42.10(pid=21160): Terminating (SIGTERM) 22:01:19.035023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21161): Terminating (SIGTERM) 22:01:19.077149 run iperf3-srv_10.42.42.10(pid=21162): Terminating (SIGTERM) 22:01:19.119056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21165): Terminating (SIGTERM) 22:01:19.161186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21168): Terminating (SIGTERM) 22:01:19.203238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21171): Terminating (SIGTERM) 22:01:19.245235 --- ParallelTerminationStrategy: PID 21158 died... 22:01:19.265145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21158): Terminated: ok {rc=0} 22:01:19.311397 --- ParallelTerminationStrategy: PID 21160 died... 22:01:19.330809 run iperf3-srv_10.42.42.10(pid=21160): Terminated {rc=256} 22:01:19.376668 --- ParallelTerminationStrategy: PID 21161 died... 22:01:19.396157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21161): Terminated: ok {rc=0} 22:01:19.442109 --- ParallelTerminationStrategy: PID 21162 died... 22:01:19.461421 run iperf3-srv_10.42.42.10(pid=21162): Terminated {rc=256} 22:01:19.507703 --- ParallelTerminationStrategy: PID 21165 died... 22:01:19.527191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21165): Terminated: ok {rc=0} 22:01:19.573408 --- ParallelTerminationStrategy: PID 21168 died... 22:01:19.592814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21168): Terminated: ok {rc=0} 22:01:19.639046 --- ParallelTerminationStrategy: PID 21171 died... 22:01:19.658637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21171): Terminated: ok {rc=0} 22:01:19.746738 bus /gobi_0: Setting Powered False 22:01:20.845759 bus /gobi_0: Setting Powered False 22:01:21.961064 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:01:23.109717 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:23.121717 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:01:23.185947 tst iperf3.py: using LAC 23947 22:01:23.311373 tst iperf3.py: using RAC 232 22:01:23.434941 tst iperf3.py: using CellId 23947 22:01:23.558691 tst iperf3.py: using BVCI 23948 22:01:23.674695 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:23.686176 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:23.697422 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:23.708480 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:23.719924 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:23.731075 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:23.742428 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:23.753448 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:23.765042 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:23.879761 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:01:24.082835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:24.385641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21173): Launched 22:01:24.651196 run iperf3-srv_10.42.42.10(pid=21174): Launched 22:01:24.765336 tst iperf3.py:8: start network... 22:01:24.967328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:25.432159 run create_hlr_db(pid=21175): Launched 22:01:25.548848 bus /gobi_6: Setting Powered False 22:01:26.609710 run create_hlr_db(pid=21175): Terminated: ok {rc=0} 22:01:27.049486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21177): Launched 22:01:27.373282 run osmo-hlr_10.42.42.2(pid=21178): Launched 22:01:27.497535 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:28.051677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21180): Launched 22:01:28.372360 run osmo-stp_10.42.42.5(pid=21181): Launched 22:01:28.495209 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:01:29.048362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21183): Launched 22:01:29.171543 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:01:29.442820 run patchelf(pid=21184): Launched 22:01:29.622910 run osmo-stp_10.42.42.5(pid=21181): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21181)] 22:01:29.759681 run osmo-stp_10.42.42.5(pid=21181): stdout: | (launched: 2022-12-09_22:01:28.314322) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:29.898250 run osmo-stp_10.42.42.5(pid=21181): stderr: | 20221209220128507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220128507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220128508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220128508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220128509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220128509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220128509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:30.036645 run osmo-stp_10.42.42.5(pid=21181): stdout: | (launched: 2022-12-09_22:01:28.314322) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:30.168361 run osmo-stp_10.42.42.5(pid=21181): stderr: | 20221209220128507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220128507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220128508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220128508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220128509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220128509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220128509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:30.324234 run patchelf(pid=21184): Terminating (SIGINT) 22:01:30.506691 run patchelf(pid=21184): Terminated: ok {rc=0} 22:01:30.637298 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21181): Process ended prematurely: osmo-stp_10.42.42.5(pid=21181) [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21181)] [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 22:01:30.647581 tst iperf3.py:8: Test FAILED (7.6 sec) 22:01:30.676010 run osmo-hlr_10.42.42.2(pid=21178): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21178)] 22:01:30.725698 run osmo-hlr_10.42.42.2(pid=21178): stdout: | (launched: 2022-12-09_22:01:27.315157) 22:01:30.777638 run osmo-hlr_10.42.42.2(pid=21178): stderr: | 20221209220127515 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220127515 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220127515 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220127515 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220127515 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220127515 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220127527 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220127535 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220127536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220127536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:30.829791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21173): Terminating (SIGTERM) 22:01:30.872689 run iperf3-srv_10.42.42.10(pid=21174): Terminating (SIGTERM) 22:01:30.918155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21177): Terminating (SIGTERM) 22:01:30.968239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21180): Terminating (SIGTERM) 22:01:31.012694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21183): Terminating (SIGTERM) 22:01:31.066501 --- ParallelTerminationStrategy: PID 21173 died... 22:01:31.086498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21173): Terminated: ok {rc=0} 22:01:31.137541 --- ParallelTerminationStrategy: PID 21174 died... 22:01:31.157496 run iperf3-srv_10.42.42.10(pid=21174): Terminated {rc=256} 22:01:31.205505 --- ParallelTerminationStrategy: PID 21177 died... 22:01:31.225176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21177): Terminated: ok {rc=0} 22:01:31.272899 --- ParallelTerminationStrategy: PID 21180 died... 22:01:31.292485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21180): Terminated: ok {rc=0} 22:01:31.341525 --- ParallelTerminationStrategy: PID 21183 died... 22:01:31.361566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21183): Terminated: ok {rc=0} 22:01:31.454447 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:01:32.613649 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:32.625214 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:01:32.682257 tst iperf3m4.py: using LAC 23948 22:01:32.802395 tst iperf3m4.py: using RAC 233 22:01:32.920041 tst iperf3m4.py: using CellId 23948 22:01:33.037400 tst iperf3m4.py: using BVCI 23949 22:01:33.148691 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:33.159796 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:33.170650 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:33.181941 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:33.192895 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:33.204185 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:33.215390 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:33.226633 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:33.238039 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:33.354412 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:33.473461 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:33.589980 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:33.707072 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:01:33.909523 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:34.210095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21185): Launched 22:01:34.472694 run iperf3-srv_10.42.42.10(pid=21186): Launched 22:01:34.586605 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:01:34.787969 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:35.088345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21187): Launched 22:01:35.350263 run iperf3-srv_10.42.42.10(pid=21188): Launched 22:01:35.463851 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:01:35.664871 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:35.965646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21189): Launched 22:01:36.229785 run iperf3-srv_10.42.42.10(pid=21190): Launched 22:01:36.342813 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:01:36.543917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:36.844855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21191): Launched 22:01:37.107219 run iperf3-srv_10.42.42.10(pid=21192): Launched 22:01:37.220910 tst iperf3m4.py:8: start network... 22:01:37.422004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:37.886512 run create_hlr_db(pid=21193): Launched 22:01:38.002321 bus /gobi_6: Setting Powered False 22:01:39.062299 run create_hlr_db(pid=21193): Terminated: ok {rc=0} 22:01:39.503211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21195): Launched 22:01:39.825177 run osmo-hlr_10.42.42.2(pid=21196): Launched 22:01:39.948401 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:40.506147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21198): Launched 22:01:40.828530 run osmo-stp_10.42.42.5(pid=21199): Launched 22:01:40.951163 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:01:41.504030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21201): Launched 22:01:41.627493 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:01:41.898772 run patchelf(pid=21202): Launched 22:01:42.078117 run osmo-stp_10.42.42.5(pid=21199): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21199)] 22:01:42.215125 run osmo-stp_10.42.42.5(pid=21199): stdout: | (launched: 2022-12-09_22:01:40.770367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:42.353198 run osmo-stp_10.42.42.5(pid=21199): stderr: | 20221209220140963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220140963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220140964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220140964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220140964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220140964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220140965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:42.491247 run osmo-stp_10.42.42.5(pid=21199): stdout: | (launched: 2022-12-09_22:01:40.770367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:42.623003 run osmo-stp_10.42.42.5(pid=21199): stderr: | 20221209220140963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220140963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220140964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220140964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220140964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220140964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220140965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:42.779512 run patchelf(pid=21202): Terminating (SIGINT) 22:01:42.961932 run patchelf(pid=21202): Terminated: ok {rc=0} 22:01:43.092755 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21199): Process ended prematurely: osmo-stp_10.42.42.5(pid=21199) [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21199)] [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:01:43.102978 tst iperf3m4.py:8: Test FAILED (10.5 sec) 22:01:43.131748 run osmo-hlr_10.42.42.2(pid=21196): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21196)] 22:01:43.181764 run osmo-hlr_10.42.42.2(pid=21196): stdout: | (launched: 2022-12-09_22:01:39.767052) 22:01:43.233642 run osmo-hlr_10.42.42.2(pid=21196): stderr: | 20221209220139965 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220139965 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220139965 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220139965 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220139965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220139965 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220139978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220139986 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220139986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220139986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:43.286097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21185): Terminating (SIGTERM) 22:01:43.328172 run iperf3-srv_10.42.42.10(pid=21186): Terminating (SIGTERM) 22:01:43.370310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21187): Terminating (SIGTERM) 22:01:43.412405 run iperf3-srv_10.42.42.10(pid=21188): Terminating (SIGTERM) 22:01:43.454610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21189): Terminating (SIGTERM) 22:01:43.497121 run iperf3-srv_10.42.42.10(pid=21190): Terminating (SIGTERM) 22:01:43.539037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21191): Terminating (SIGTERM) 22:01:43.581013 run iperf3-srv_10.42.42.10(pid=21192): Terminating (SIGTERM) 22:01:43.622876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21195): Terminating (SIGTERM) 22:01:43.665034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21198): Terminating (SIGTERM) 22:01:43.706888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21201): Terminating (SIGTERM) 22:01:43.749106 --- ParallelTerminationStrategy: PID 21185 died... 22:01:43.769147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21185): Terminated: ok {rc=0} 22:01:43.815858 --- ParallelTerminationStrategy: PID 21186 died... 22:01:43.835401 run iperf3-srv_10.42.42.10(pid=21186): Terminated {rc=256} 22:01:43.881418 --- ParallelTerminationStrategy: PID 21187 died... 22:01:43.900907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21187): Terminated: ok {rc=0} 22:01:43.946920 --- ParallelTerminationStrategy: PID 21188 died... 22:01:43.966404 run iperf3-srv_10.42.42.10(pid=21188): Terminated {rc=256} 22:01:44.012233 --- ParallelTerminationStrategy: PID 21189 died... 22:01:44.031967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21189): Terminated: ok {rc=0} 22:01:44.077831 --- ParallelTerminationStrategy: PID 21190 died... 22:01:44.097317 run iperf3-srv_10.42.42.10(pid=21190): Terminated {rc=256} 22:01:44.143195 --- ParallelTerminationStrategy: PID 21191 died... 22:01:44.162525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21191): Terminated: ok {rc=0} 22:01:44.208288 --- ParallelTerminationStrategy: PID 21192 died... 22:01:44.227733 run iperf3-srv_10.42.42.10(pid=21192): Terminated {rc=256} 22:01:44.273444 --- ParallelTerminationStrategy: PID 21195 died... 22:01:44.292847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21195): Terminated: ok {rc=0} 22:01:44.338782 --- ParallelTerminationStrategy: PID 21198 died... 22:01:44.358319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21198): Terminated: ok {rc=0} 22:01:44.404302 --- ParallelTerminationStrategy: PID 21201 died... 22:01:44.423741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21201): Terminated: ok {rc=0} 22:01:44.511606 bus /gobi_4: Setting Powered False 22:01:45.608776 bus /gobi_4: Setting Powered False 22:01:46.727087 bus /gobi_1: Setting Powered False 22:01:47.830266 bus /gobi_1: Setting Powered False 22:01:48.948259 bus /gobi_0: Setting Powered False 22:01:50.046560 bus /gobi_0: Setting Powered False 22:01:51.163848 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:01:52.267832 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:52.279335 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:01:52.340117 tst ping.py: using LAC 23949 22:01:52.456005 tst ping.py: using RAC 234 22:01:52.572083 tst ping.py: using CellId 23949 22:01:52.686288 tst ping.py: using BVCI 23950 22:01:52.792820 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:52.803640 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:52.814310 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:52.825370 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:52.836182 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:52.846924 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:52.857984 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:52.868638 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:52.986074 tst ping.py:19: start network... 22:01:53.185147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:53.639612 run create_hlr_db(pid=21204): Launched 22:01:53.753276 bus /gobi_6: Setting Powered False 22:01:54.811995 run create_hlr_db(pid=21204): Terminated: ok {rc=0} 22:01:55.244827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21206): Launched 22:01:55.560415 run osmo-hlr_10.42.42.2(pid=21207): Launched 22:01:55.681586 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:56.227325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21209): Launched 22:01:56.542304 run osmo-stp_10.42.42.5(pid=21210): Launched 22:01:56.663935 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:01:57.207827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21212): Launched 22:01:57.329022 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:01:57.595352 run patchelf(pid=21213): Launched 22:01:57.771384 run osmo-stp_10.42.42.5(pid=21210): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21210)] 22:01:57.906221 run osmo-stp_10.42.42.5(pid=21210): stdout: | (launched: 2022-12-09_22:01:56.485596) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:58.042325 run osmo-stp_10.42.42.5(pid=21210): stderr: | 20221209220156677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220156677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220156677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220156678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220156678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220156678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220156678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:58.178370 run osmo-stp_10.42.42.5(pid=21210): stdout: | (launched: 2022-12-09_22:01:56.485596) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:58.308074 run osmo-stp_10.42.42.5(pid=21210): stderr: | 20221209220156677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220156677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220156677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220156678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220156678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220156678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220156678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:58.461959 run patchelf(pid=21213): Terminating (SIGINT) 22:01:58.640853 run patchelf(pid=21213): Terminated: ok {rc=0} 22:01:58.769029 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21210): Process ended prematurely: osmo-stp_10.42.42.5(pid=21210) [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21210)] [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 22:01:58.778786 tst ping.py:22: Test FAILED (6.5 sec) 22:01:58.806995 run osmo-hlr_10.42.42.2(pid=21207): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21207)] 22:01:58.857627 run osmo-hlr_10.42.42.2(pid=21207): stdout: | (launched: 2022-12-09_22:01:55.503557) 22:01:58.909581 run osmo-hlr_10.42.42.2(pid=21207): stderr: | 20221209220155701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220155701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220155701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220155701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220155701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220155702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220155714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220155723 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220155724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220155724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:58.961894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21206): Terminating (SIGTERM) 22:01:59.004015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21209): Terminating (SIGTERM) 22:01:59.046160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21212): Terminating (SIGTERM) 22:01:59.088282 --- ParallelTerminationStrategy: PID 21206 died... 22:01:59.108469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21206): Terminated: ok {rc=0} 22:01:59.155149 --- ParallelTerminationStrategy: PID 21209 died... 22:01:59.174894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21209): Terminated: ok {rc=0} 22:01:59.221265 --- ParallelTerminationStrategy: PID 21212 died... 22:01:59.240659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21212): Terminated: ok {rc=0} 22:01:59.329237 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:02:00.417950 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:02:00.430533 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:02:00.490447 tst ping_idle_ping.py: using LAC 23950 22:02:00.616681 tst ping_idle_ping.py: using RAC 235 22:02:00.743374 tst ping_idle_ping.py: using CellId 23950 22:02:00.878727 tst ping_idle_ping.py: using BVCI 23951 22:02:00.996159 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:02:01.007927 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:02:01.019538 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:02:01.033501 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:02:01.045113 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:02:01.057582 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:02:01.071406 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:02:01.083176 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:02:01.207819 tst ping_idle_ping.py:24: start network... 22:02:01.450226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:01.971243 run create_hlr_db(pid=21214): Launched 22:02:02.125633 bus /gobi_6: Setting Powered False 22:02:03.185296 run create_hlr_db(pid=21214): Terminated: ok {rc=0} 22:02:03.617627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21216): Launched 22:02:03.935970 run osmo-hlr_10.42.42.2(pid=21217): Launched 22:02:04.056431 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:04.602288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21219): Launched 22:02:04.918431 run osmo-stp_10.42.42.5(pid=21220): Launched 22:02:05.038636 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:02:05.581639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21222): Launched 22:02:05.703317 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:02:05.971147 run patchelf(pid=21223): Launched 22:02:06.147344 run osmo-stp_10.42.42.5(pid=21220): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21220)] 22:02:06.281484 run osmo-stp_10.42.42.5(pid=21220): stdout: | (launched: 2022-12-09_22:02:04.861845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:06.417202 run osmo-stp_10.42.42.5(pid=21220): stderr: | 20221209220205053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220205053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220205053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220205053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220205054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220205054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220205054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:06.552853 run osmo-stp_10.42.42.5(pid=21220): stdout: | (launched: 2022-12-09_22:02:04.861845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:06.682846 run osmo-stp_10.42.42.5(pid=21220): stderr: | 20221209220205053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220205053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220205053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220205053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220205054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220205054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220205054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:06.836398 run patchelf(pid=21223): Terminating (SIGINT) 22:02:07.014653 run patchelf(pid=21223): Terminated: ok {rc=0} 22:02:07.142805 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21220): Process ended prematurely: osmo-stp_10.42.42.5(pid=21220) [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21220)] [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:02:07.152265 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 22:02:07.179932 run osmo-hlr_10.42.42.2(pid=21217): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21217)] 22:02:07.229855 run osmo-hlr_10.42.42.2(pid=21217): stdout: | (launched: 2022-12-09_22:02:03.879052) 22:02:07.281424 run osmo-hlr_10.42.42.2(pid=21217): stderr: | 20221209220204076 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220204076 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220204076 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220204076 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220204076 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220204076 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220204089 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220204098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220204099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220204099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:07.333559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21216): Terminating (SIGTERM) 22:02:07.375237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21219): Terminating (SIGTERM) 22:02:07.416892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21222): Terminating (SIGTERM) 22:02:07.458731 --- ParallelTerminationStrategy: PID 21216 died... 22:02:07.478625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21216): Terminated: ok {rc=0} 22:02:07.524826 --- ParallelTerminationStrategy: PID 21219 died... 22:02:07.544251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21219): Terminated: ok {rc=0} 22:02:07.590063 --- ParallelTerminationStrategy: PID 21222 died... 22:02:07.609582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21222): Terminated: ok {rc=0} 22:02:07.696906 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:02:08.982720 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:08.989741 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:02:09.011155 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:02:09.045130 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:02:09.100544 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:02:09.120755 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:02:09.156014 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:02:09.710898 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2365 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:02:09.715876 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:09.726885 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:02:09.785551 tst switch_tch_pdch.py: using LAC 23951 22:02:09.901064 tst switch_tch_pdch.py: using RAC 236 22:02:10.014907 tst switch_tch_pdch.py: using CellId 23951 22:02:10.128010 tst switch_tch_pdch.py: using BVCI 23952 22:02:10.234374 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:10.245467 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:10.256221 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:10.267266 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:10.278317 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:10.289532 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:10.300602 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:10.311603 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:02:10.430240 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:02:10.546851 tst switch_tch_pdch.py:51: start network... 22:02:10.745912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:11.201965 run create_hlr_db(pid=21227): Launched 22:02:11.314542 bus /gobi_6: Setting Powered False 22:02:12.373869 run create_hlr_db(pid=21227): Terminated: ok {rc=0} 22:02:12.787094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21229): Launched 22:02:13.082319 run osmo-hlr_10.42.42.2(pid=21230): Launched 22:02:13.195084 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:13.702813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21232): Launched 22:02:13.997876 run osmo-stp_10.42.42.5(pid=21233): Launched 22:02:14.110401 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:02:14.617898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21235): Launched 22:02:14.731958 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:02:14.980815 run patchelf(pid=21236): Launched 22:02:15.145423 run osmo-stp_10.42.42.5(pid=21233): ERR: Terminated: ERROR {rc=1} [trial-2365↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21233)] 22:02:15.270974 run osmo-stp_10.42.42.5(pid=21233): stdout: | (launched: 2022-12-09_22:02:13.944445) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:15.398796 run osmo-stp_10.42.42.5(pid=21233): stderr: | 20221209220214115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220214115 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220214115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220214116 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220214116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220214116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220214116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:15.526108 run osmo-stp_10.42.42.5(pid=21233): stdout: | (launched: 2022-12-09_22:02:13.944445) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:15.647387 run osmo-stp_10.42.42.5(pid=21233): stderr: | 20221209220214115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220214115 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220214115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220214116 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220214116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220214116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220214116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:15.791206 run patchelf(pid=21236): Terminating (SIGINT) 22:02:15.970590 run patchelf(pid=21236): Terminated: ok {rc=0} 22:02:16.094640 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21233): Process ended prematurely: osmo-stp_10.42.42.5(pid=21233) [trial-2365↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21233)] [trial-2365↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:02:16.104420 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 22:02:16.134067 run osmo-hlr_10.42.42.2(pid=21230): ERR: Terminated: ERROR {rc=237} [trial-2365↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21230)] 22:02:16.184260 run osmo-hlr_10.42.42.2(pid=21230): stdout: | (launched: 2022-12-09_22:02:13.029081) 22:02:16.236115 run osmo-hlr_10.42.42.2(pid=21230): stderr: | 20221209220213205 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220213205 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220213205 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220213205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220213205 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220213205 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220213218 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220213226 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220213226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220213226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:16.288537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21229): Terminating (SIGTERM) 22:02:16.329263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21232): Terminating (SIGTERM) 22:02:16.372366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21235): Terminating (SIGTERM) 22:02:16.415071 --- ParallelTerminationStrategy: PID 21229 died... 22:02:16.434951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21229): Terminated: ok {rc=0} 22:02:16.483358 --- ParallelTerminationStrategy: PID 21232 died... 22:02:16.502795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21232): Terminated: ok {rc=0} 22:02:16.549996 --- ParallelTerminationStrategy: PID 21235 died... 22:02:16.569474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21235): Terminated: ok {rc=0} 22:02:16.660678 bus /gobi_0: Setting Powered False 22:02:17.771026 bus /gobi_0: Setting Powered False 22:02:18.883616 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:02:20.114327 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:20.119982 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:02:20.141444 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:02:20.175682 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:02:20.228541 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:02:20.250322 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:02:20.284361 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:02:20.837612 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2365 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:02:20.844246 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:20.855733 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:02:20.913988 tst switch_tch_pdch.py: using LAC 23952 22:02:21.038926 tst switch_tch_pdch.py: using RAC 237 22:02:21.165201 tst switch_tch_pdch.py: using CellId 23952 22:02:21.289295 tst switch_tch_pdch.py: using BVCI 23953 22:02:21.402985 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:21.414206 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:21.425227 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:21.436210 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:21.447301 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:21.458487 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:21.469923 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:21.481039 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:02:21.598144 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:02:21.712063 tst switch_tch_pdch.py:51: start network... 22:02:21.926054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:22.386093 run create_hlr_db(pid=21240): Launched 22:02:22.514101 bus /gobi_6: Setting Powered False 22:02:23.573574 run create_hlr_db(pid=21240): Terminated: ok {rc=0} 22:02:23.960878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21242): Launched 22:02:24.258018 run osmo-hlr_10.42.42.2(pid=21243): Launched 22:02:24.369941 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:24.850191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21245): Launched 22:02:25.144143 run osmo-stp_10.42.42.5(pid=21246): Launched 22:02:25.256483 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:02:25.739500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21248): Launched 22:02:25.853121 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:02:26.102461 run patchelf(pid=21249): Launched 22:02:26.267041 run osmo-stp_10.42.42.5(pid=21246): ERR: Terminated: ERROR {rc=1} [trial-2365↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21246)] 22:02:26.392325 run osmo-stp_10.42.42.5(pid=21246): stdout: | (launched: 2022-12-09_22:02:25.090574) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:26.519366 run osmo-stp_10.42.42.5(pid=21246): stderr: | 20221209220225259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220225259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220225259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220225259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220225262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220225262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220225262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:26.646513 run osmo-stp_10.42.42.5(pid=21246): stdout: | (launched: 2022-12-09_22:02:25.090574) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:26.767376 run osmo-stp_10.42.42.5(pid=21246): stderr: | 20221209220225259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220225259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220225259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220225259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220225262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220225262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220225262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:26.911170 run patchelf(pid=21249): Terminating (SIGINT) 22:02:27.078602 run patchelf(pid=21249): Terminated: ok {rc=0} 22:02:27.198855 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21246): Process ended prematurely: osmo-stp_10.42.42.5(pid=21246) [trial-2365↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21246)] [trial-2365↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:02:27.207728 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 22:02:27.234549 run osmo-hlr_10.42.42.2(pid=21243): ERR: Terminated: ERROR {rc=237} [trial-2365↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21243)] 22:02:27.282151 run osmo-hlr_10.42.42.2(pid=21243): stdout: | (launched: 2022-12-09_22:02:24.204527) 22:02:27.331242 run osmo-hlr_10.42.42.2(pid=21243): stderr: | 20221209220224378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220224378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220224378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220224378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220224378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220224378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220224390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220224401 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220224401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220224401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:27.380792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21242): Terminating (SIGTERM) 22:02:27.420692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21245): Terminating (SIGTERM) 22:02:27.460395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21248): Terminating (SIGTERM) 22:02:27.500448 --- ParallelTerminationStrategy: PID 21242 died... 22:02:27.519460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21242): Terminated: ok {rc=0} 22:02:27.563647 --- ParallelTerminationStrategy: PID 21245 died... 22:02:27.581990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21245): Terminated: ok {rc=0} 22:02:27.626816 --- ParallelTerminationStrategy: PID 21248 died... 22:02:27.645261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21248): Terminated: ok {rc=0} 22:02:27.731369 bus /gobi_0: Setting Powered False 22:02:28.831777 bus /gobi_0: Setting Powered False 22:02:29.948096 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_sms:trx-b200 --------------------------------------------------------------------- 22:02:31.221378 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:31.227383 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 22:02:31.270439 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 22:02:31.280213 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 22:02:31.340856 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 22:02:31.383941 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 22:02:31.391847 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 22:02:31.955450 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 22:02:31.965826 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 22:02:31.984793 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 22:02:32.049167 tst mo_mt_sms.py: using LAC 23953 22:02:32.174978 tst mo_mt_sms.py: using RAC 238 22:02:32.293691 tst mo_mt_sms.py: using CellId 23953 22:02:32.411326 tst mo_mt_sms.py: using BVCI 23954 22:02:32.519269 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 22:02:32.638096 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 22:02:32.754254 tst mo_mt_sms.py:9: start nitb and bts... 22:02:32.970226 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:02:33.613961 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21253): Launched 22:02:33.930549 run osmo-nitb_10.42.42.2(pid=21254): Launched 22:02:34.105764 run osmo-nitb_10.42.42.2(pid=21254): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21254)] 22:02:34.248356 run osmo-nitb_10.42.42.2(pid=21254): stdout: | (launched: 2022-12-09_22:02:33.873831) 22:02:34.392515 run osmo-nitb_10.42.42.2(pid=21254): stderr: | (launched: 2022-12-09_22:02:33.920777) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:02:34.536735 run osmo-nitb_10.42.42.2(pid=21254): stdout: | (launched: 2022-12-09_22:02:33.873831) 22:02:34.674906 run osmo-nitb_10.42.42.2(pid=21254): stderr: | (launched: 2022-12-09_22:02:33.920777) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21254): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21254) [trial-2365↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21254)] 22:02:35.050042 tst osmo-nitb_10.42.42.2(pid=21254): stdout: | (launched: 2022-12-09_22:02:33.873831) 22:02:35.178044 tst osmo-nitb_10.42.42.2(pid=21254): stderr: | (launched: 2022-12-09_22:02:33.920777) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:02:35.328640 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=21254): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21254) [trial-2365↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21254)] [trial-2365↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 22:02:35.337625 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 22:02:35.344666 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21253): Terminating (SIGTERM) 22:02:35.555149 --- ParallelTerminationStrategy: PID 21253 died... 22:02:35.576661 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21253): Terminated: ok {rc=0} 22:02:35.665296 bus /sierra_3: Setting Powered False 22:02:36.764791 bus /sierra_3: Setting Powered False 22:02:37.882811 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 sms:trx-b200 --------------------------------------------------------------------- 22:02:39.081436 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:39.085653 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 22:02:39.119090 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 22:02:39.146099 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 22:02:39.199631 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 22:02:39.233565 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 22:02:39.260511 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 22:02:39.807531 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 22:02:39.812534 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:39.823444 tst sms:trx-b200: Using 1 x bts (candidates: 1) 22:02:39.876801 tst mo_mt_sms.py: using LAC 23954 22:02:40.000039 tst mo_mt_sms.py: using RAC 239 22:02:40.121869 tst mo_mt_sms.py: using CellId 23954 22:02:40.243731 tst mo_mt_sms.py: using BVCI 23955 22:02:40.357527 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:40.368373 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:40.379136 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:40.389884 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:40.400551 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:40.411217 tst sms:trx-b200: Using 1 x modem (candidates: 2) 22:02:40.526741 tst sms:trx-b200: Using 1 x modem (candidates: 2) 22:02:40.644335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:41.134293 run create_hlr_db(pid=21261): Launched 22:02:41.262743 bus /sierra_2: Setting Powered False 22:02:42.325726 run create_hlr_db(pid=21261): Terminated: ok {rc=0} 22:02:42.766270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21263): Launched 22:02:43.081993 run osmo-hlr_10.42.42.2(pid=21264): Launched 22:02:43.201975 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:43.742425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21266): Launched 22:02:44.057672 run osmo-stp_10.42.42.5(pid=21267): Launched 22:02:44.178971 run osmo-msc_10.42.42.6: Starting osmo-msc 22:02:44.751683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21269): Launched 22:02:45.066755 run osmo-msc_10.42.42.6(pid=21270): Launched 22:02:45.242544 run osmo-stp_10.42.42.5(pid=21267): ERR: Terminated: ERROR {rc=1} [trial-2365↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21267)] 22:02:45.375463 run osmo-stp_10.42.42.5(pid=21267): stdout: | (launched: 2022-12-09_22:02:44.001063) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:45.509178 run osmo-stp_10.42.42.5(pid=21267): stderr: | 20221209220244192 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220244192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220244192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220244193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220244193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220244193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220244193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:45.641950 run osmo-stp_10.42.42.5(pid=21267): stdout: | (launched: 2022-12-09_22:02:44.001063) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:45.767477 run osmo-stp_10.42.42.5(pid=21267): stderr: | 20221209220244192 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220244192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220244192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220244193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220244193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220244193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220244193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:45.935891 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=21267): Process ended prematurely: osmo-stp_10.42.42.5(pid=21267) [trial-2365↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21267)] [trial-2365↪sms:trx-b200↪mo_mt_sms.py:16] 22:02:45.945217 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 22:02:45.973331 run osmo-hlr_10.42.42.2(pid=21264): ERR: Terminated: ERROR {rc=237} [trial-2365↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21264)] 22:02:46.024184 run osmo-hlr_10.42.42.2(pid=21264): stdout: | (launched: 2022-12-09_22:02:43.025365) 22:02:46.077080 run osmo-hlr_10.42.42.2(pid=21264): stderr: | 20221209220243222 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220243222 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220243222 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220243222 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220243222 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220243222 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220243235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220243243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220243243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220243243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:46.150036 run osmo-msc_10.42.42.6(pid=21270): ERR: Terminated: ERROR {rc=2} [trial-2365↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21270)] 22:02:46.200732 run osmo-msc_10.42.42.6(pid=21270): stdout: | (launched: 2022-12-09_22:02:45.010075) 22:02:46.263822 run osmo-msc_10.42.42.6(pid=21270): stderr: | 20221209220245332 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220245332 DLGLOBAL DEBUG validating counter group 0x7f7e1706dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220245333 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220245333 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220245333 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220245333 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220245335 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220245335 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220245335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220245335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:02:46.330338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21263): Terminating (SIGTERM) 22:02:46.383320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21266): Terminating (SIGTERM) 22:02:46.436806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21269): Terminating (SIGTERM) 22:02:46.492822 --- ParallelTerminationStrategy: PID 21263 died... 22:02:46.519050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21263): Terminated: ok {rc=0} 22:02:46.579612 --- ParallelTerminationStrategy: PID 21266 died... 22:02:46.602231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21266): Terminated: ok {rc=0} 22:02:46.659814 --- ParallelTerminationStrategy: PID 21269 died... 22:02:46.684506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21269): Terminated: ok {rc=0} 22:02:46.790010 bus /sierra_3: Setting Powered False 22:02:47.898062 bus /sierra_3: Setting Powered False 22:02:49.013176 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_ussd:trx-b200 --------------------------------------------------------------------- 22:02:50.239655 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:50.244383 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 22:02:50.278089 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 22:02:50.285024 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 22:02:50.321327 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 22:02:50.356080 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 22:02:50.362996 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 22:02:50.882081 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2365 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 22:02:50.889163 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 22:02:50.900251 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 22:02:50.948841 tst assert_extension.py: using LAC 23955 22:02:51.064840 tst assert_extension.py: using RAC 240 22:02:51.180814 tst assert_extension.py: using CellId 23955 22:02:51.304713 tst assert_extension.py: using BVCI 23956 22:02:51.412534 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 22:02:51.529340 tst assert_extension.py:10: start nitb and bts... 22:02:51.730428 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:02:52.334758 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21275): Launched 22:02:52.629540 run osmo-nitb_10.42.42.2(pid=21276): Launched 22:02:52.794713 run osmo-nitb_10.42.42.2(pid=21276): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21276)] 22:02:52.929136 run osmo-nitb_10.42.42.2(pid=21276): stdout: | (launched: 2022-12-09_22:02:52.576256) 22:02:53.065203 run osmo-nitb_10.42.42.2(pid=21276): stderr: | (launched: 2022-12-09_22:02:52.620020) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:02:53.200303 run osmo-nitb_10.42.42.2(pid=21276): stdout: | (launched: 2022-12-09_22:02:52.576256) 22:02:53.330363 run osmo-nitb_10.42.42.2(pid=21276): stderr: | (launched: 2022-12-09_22:02:52.620020) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21276): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21276) [trial-2365↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21276)] 22:02:53.742528 tst osmo-nitb_10.42.42.2(pid=21276): stdout: | (launched: 2022-12-09_22:02:52.576256) 22:02:53.862768 tst osmo-nitb_10.42.42.2(pid=21276): stderr: | (launched: 2022-12-09_22:02:52.620020) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:02:54.004480 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=21276): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21276) [trial-2365↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21276)] [trial-2365↪nitb_ussd:trx-b200↪assert_extension.py:12] 22:02:54.012782 tst assert_extension.py:12: Test FAILED (3.1 sec) 22:02:54.019299 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21275): Terminating (SIGTERM) 22:02:54.228566 --- ParallelTerminationStrategy: PID 21275 died... 22:02:54.248924 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21275): Terminated: ok {rc=0} 22:02:54.332583 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 ussd:trx-b200 --------------------------------------------------------------------- 22:02:55.508417 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:55.512203 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 22:02:55.545213 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 22:02:55.571393 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 22:02:55.604867 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 22:02:55.637740 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 22:02:55.664227 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 22:02:56.197143 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2365 ussd:trx-b200 assert_extension.py ---------------------------------------------- 22:02:56.203062 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:56.214599 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 22:02:56.263280 tst assert_extension.py: using LAC 23956 22:02:56.378483 tst assert_extension.py: using RAC 241 22:02:56.491745 tst assert_extension.py: using CellId 23956 22:02:56.605361 tst assert_extension.py: using BVCI 23957 22:02:56.711877 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:56.722525 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:56.732763 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:56.743400 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:56.754047 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:56.764595 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 22:02:56.882672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:57.371412 run create_hlr_db(pid=21280): Launched 22:02:57.499665 bus /sierra_2: Setting Powered False 22:02:58.562316 run create_hlr_db(pid=21280): Terminated: ok {rc=0} 22:02:58.984490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21282): Launched 22:02:59.278977 run osmo-hlr_10.42.42.2(pid=21283): Launched 22:02:59.391727 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:59.903859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21285): Launched 22:03:00.198781 run osmo-stp_10.42.42.5(pid=21286): Launched 22:03:00.311449 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:00.879184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21288): Launched 22:03:01.241315 run osmo-msc_10.42.42.6(pid=21290): Launched 22:03:01.595085 run osmo-stp_10.42.42.5(pid=21286): ERR: Terminated: ERROR {rc=1} [trial-2365↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21286)] 22:03:01.789970 run osmo-stp_10.42.42.5(pid=21286): stdout: | (launched: 2022-12-09_22:03:00.144939) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:01.954823 run osmo-stp_10.42.42.5(pid=21286): stderr: | 20221209220300317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220300317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220300318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220300318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220300319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220300319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220300319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:02.162837 run osmo-stp_10.42.42.5(pid=21286): stdout: | (launched: 2022-12-09_22:03:00.144939) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:02.299475 run osmo-stp_10.42.42.5(pid=21286): stderr: | 20221209220300317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220300317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220300318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220300318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220300319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220300319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220300319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:02.444704 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=21286): Process ended prematurely: osmo-stp_10.42.42.5(pid=21286) [trial-2365↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21286)] [trial-2365↪ussd:trx-b200↪assert_extension.py:17] 22:03:02.453768 tst assert_extension.py:17: Test FAILED (6.2 sec) 22:03:02.481848 run osmo-hlr_10.42.42.2(pid=21283): ERR: Terminated: ERROR {rc=237} [trial-2365↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21283)] 22:03:02.531358 run osmo-hlr_10.42.42.2(pid=21283): stdout: | (launched: 2022-12-09_22:02:59.225914) 22:03:02.582326 run osmo-hlr_10.42.42.2(pid=21283): stderr: | 20221209220259400 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220259400 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220259400 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220259400 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220259400 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220259400 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220259412 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220259420 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220259420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220259421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:02.652765 run osmo-msc_10.42.42.6(pid=21290): ERR: Terminated: ERROR {rc=2} [trial-2365↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21290)] 22:03:02.701946 run osmo-msc_10.42.42.6(pid=21290): stdout: | (launched: 2022-12-09_22:03:01.180211) 22:03:02.752647 run osmo-msc_10.42.42.6(pid=21290): stderr: | 20221209220301674 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220301674 DLGLOBAL DEBUG validating counter group 0x7f71287ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220301674 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220301674 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220301675 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220301675 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220301676 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220301685 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220301685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220301685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:02.803869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21282): Terminating (SIGTERM) 22:03:02.845135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21285): Terminating (SIGTERM) 22:03:02.886124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21288): Terminating (SIGTERM) 22:03:02.927303 --- ParallelTerminationStrategy: PID 21282 died... 22:03:02.946761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21282): Terminated: ok {rc=0} 22:03:02.992844 --- ParallelTerminationStrategy: PID 21285 died... 22:03:03.011937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21285): Terminated: ok {rc=0} 22:03:03.058371 --- ParallelTerminationStrategy: PID 21288 died... 22:03:03.077307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21288): Terminated: ok {rc=0} 22:03:03.163898 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:03:04.378812 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:03:04.385064 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:03:04.419409 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:03:04.445647 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:03:04.495797 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:03:04.528758 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:03:04.554612 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:03:05.108670 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:03:05.157823 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:05.168736 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:03:05.235441 tst mo_mt_call.py: using LAC 23957 22:03:05.364829 tst mo_mt_call.py: using RAC 242 22:03:05.492151 tst mo_mt_call.py: using CellId 23957 22:03:05.617390 tst mo_mt_call.py: using BVCI 23958 22:03:05.737114 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:05.748794 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:05.760173 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:05.772263 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:05.784355 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:05.796264 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:03:05.912776 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:03:06.028704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:06.493994 run create_hlr_db(pid=21295): Launched 22:03:06.611109 bus /sierra_2: Setting Powered False 22:03:07.671451 run create_hlr_db(pid=21295): Terminated: ok {rc=0} 22:03:08.112035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21297): Launched 22:03:08.432398 run osmo-hlr_10.42.42.2(pid=21298): Launched 22:03:08.555208 run osmo-stp_10.42.42.5: Starting osmo-stp 22:03:09.106161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21300): Launched 22:03:09.427231 run osmo-stp_10.42.42.5(pid=21301): Launched 22:03:09.550266 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:10.131479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21303): Launched 22:03:10.451863 run osmo-msc_10.42.42.6(pid=21304): Launched 22:03:10.631974 run osmo-stp_10.42.42.5(pid=21301): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21301)] 22:03:10.767151 run osmo-stp_10.42.42.5(pid=21301): stdout: | (launched: 2022-12-09_22:03:09.369660) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:10.904071 run osmo-stp_10.42.42.5(pid=21301): stderr: | 20221209220309564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220309564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220309564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220309564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220309565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220309565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220309565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:11.039391 run osmo-stp_10.42.42.5(pid=21301): stdout: | (launched: 2022-12-09_22:03:09.369660) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:11.167435 run osmo-stp_10.42.42.5(pid=21301): stderr: | 20221209220309564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220309564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220309564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220309564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220309565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220309565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220309565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:11.320142 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21301): Process ended prematurely: osmo-stp_10.42.42.5(pid=21301) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21301)] [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:03:11.329606 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:03:11.357231 run osmo-hlr_10.42.42.2(pid=21298): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21298)] 22:03:11.407101 run osmo-hlr_10.42.42.2(pid=21298): stdout: | (launched: 2022-12-09_22:03:08.374668) 22:03:11.458889 run osmo-hlr_10.42.42.2(pid=21298): stderr: | 20221209220308574 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220308574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220308574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220308574 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220308575 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220308575 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220308587 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220308595 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220308595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220308595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:11.531192 run osmo-msc_10.42.42.6(pid=21304): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21304)] 22:03:11.581659 run osmo-msc_10.42.42.6(pid=21304): stdout: | (launched: 2022-12-09_22:03:10.394299) 22:03:11.633295 run osmo-msc_10.42.42.6(pid=21304): stderr: | 20221209220310718 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220310719 DLGLOBAL DEBUG validating counter group 0x7f7047fefc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220310719 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220310719 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220310719 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220310719 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220310721 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220310721 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220310721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220310721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:11.685456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21297): Terminating (SIGTERM) 22:03:11.726820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21300): Terminating (SIGTERM) 22:03:11.768251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21303): Terminating (SIGTERM) 22:03:11.810121 --- ParallelTerminationStrategy: PID 21297 died... 22:03:11.830378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21297): Terminated: ok {rc=0} 22:03:11.876647 --- ParallelTerminationStrategy: PID 21300 died... 22:03:11.896400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21300): Terminated: ok {rc=0} 22:03:11.942444 --- ParallelTerminationStrategy: PID 21303 died... 22:03:11.961923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21303): Terminated: ok {rc=0} 22:03:12.050411 bus /sierra_3: Setting Powered False 22:03:13.150425 bus /sierra_3: Setting Powered False 22:03:14.269218 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:03:15.414369 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:15.426240 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:03:15.495674 tst mo_mt_call_osmux.py: using LAC 23958 22:03:15.617431 tst mo_mt_call_osmux.py: using RAC 243 22:03:15.734769 tst mo_mt_call_osmux.py: using CellId 23958 22:03:15.857303 tst mo_mt_call_osmux.py: using BVCI 23959 22:03:15.971353 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:15.983281 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:15.994928 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:16.007462 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:16.020119 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:16.033722 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:03:16.156248 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:03:16.298728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:16.814118 run create_hlr_db(pid=21306): Launched 22:03:16.978948 bus /sierra_2: Setting Powered False 22:03:18.043186 run create_hlr_db(pid=21306): Terminated: ok {rc=0} 22:03:18.490289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21308): Launched 22:03:18.810554 run osmo-hlr_10.42.42.2(pid=21309): Launched 22:03:18.932823 run osmo-stp_10.42.42.5: Starting osmo-stp 22:03:19.488281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21311): Launched 22:03:19.808738 run osmo-stp_10.42.42.5(pid=21312): Launched 22:03:19.931223 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:20.509609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21314): Launched 22:03:20.832568 run osmo-msc_10.42.42.6(pid=21315): Launched 22:03:21.011335 run osmo-stp_10.42.42.5(pid=21312): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21312)] 22:03:21.146768 run osmo-stp_10.42.42.5(pid=21312): stdout: | (launched: 2022-12-09_22:03:19.751143) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:21.283280 run osmo-stp_10.42.42.5(pid=21312): stderr: | 20221209220319943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220319943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220319943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220319944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220319944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220319944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220319944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:21.418523 run osmo-stp_10.42.42.5(pid=21312): stdout: | (launched: 2022-12-09_22:03:19.751143) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:21.545930 run osmo-stp_10.42.42.5(pid=21312): stderr: | 20221209220319943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220319943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220319943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220319944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220319944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220319944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220319944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:21.697931 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21312): Process ended prematurely: osmo-stp_10.42.42.5(pid=21312) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21312)] [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:03:21.707437 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:03:21.735150 run osmo-hlr_10.42.42.2(pid=21309): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21309)] 22:03:21.785248 run osmo-hlr_10.42.42.2(pid=21309): stdout: | (launched: 2022-12-09_22:03:18.753159) 22:03:21.837779 run osmo-hlr_10.42.42.2(pid=21309): stderr: | 20221209220318952 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220318952 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220318952 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220318952 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220318952 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220318952 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220318965 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220318974 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220318974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220318974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:21.910517 run osmo-msc_10.42.42.6(pid=21315): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21315)] 22:03:21.960642 run osmo-msc_10.42.42.6(pid=21315): stdout: | (launched: 2022-12-09_22:03:20.773992) 22:03:22.012556 run osmo-msc_10.42.42.6(pid=21315): stderr: | 20221209220321095 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220321096 DLGLOBAL DEBUG validating counter group 0x7f99efe1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220321096 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220321096 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220321096 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220321096 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220321098 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220321098 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220321098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220321098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:22.064722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21308): Terminating (SIGTERM) 22:03:22.106528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21311): Terminating (SIGTERM) 22:03:22.148243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21314): Terminating (SIGTERM) 22:03:22.190403 --- ParallelTerminationStrategy: PID 21308 died... 22:03:22.210464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21308): Terminated: ok {rc=0} 22:03:22.256817 --- ParallelTerminationStrategy: PID 21311 died... 22:03:22.276687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21311): Terminated: ok {rc=0} 22:03:22.322962 --- ParallelTerminationStrategy: PID 21314 died... 22:03:22.342508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21314): Terminated: ok {rc=0} 22:03:22.429744 bus /sierra_3: Setting Powered False 22:03:23.528465 bus /sierra_3: Setting Powered False 22:03:24.645251 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:03:25.895382 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:03:25.901790 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:03:25.935336 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:03:25.961757 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:03:26.010723 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:03:26.043638 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:03:26.070361 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:03:26.623183 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:03:26.671512 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:26.682636 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:03:26.748854 tst mo_mt_call.py: using LAC 23959 22:03:26.865293 tst mo_mt_call.py: using RAC 244 22:03:26.982138 tst mo_mt_call.py: using CellId 23959 22:03:27.099301 tst mo_mt_call.py: using BVCI 23960 22:03:27.207553 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:27.218428 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:27.229225 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:27.240175 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:27.251424 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:27.262523 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:03:27.382073 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:03:27.500007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:27.963775 run create_hlr_db(pid=21320): Launched 22:03:28.079706 bus /sierra_2: Setting Powered False 22:03:29.139321 run create_hlr_db(pid=21320): Terminated: ok {rc=0} 22:03:29.559203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21322): Launched 22:03:29.859518 run osmo-hlr_10.42.42.2(pid=21323): Launched 22:03:29.974614 run osmo-stp_10.42.42.5: Starting osmo-stp 22:03:30.503507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21325): Launched 22:03:30.803908 run osmo-stp_10.42.42.5(pid=21326): Launched 22:03:31.010072 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:31.697675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21328): Launched 22:03:32.038349 run osmo-msc_10.42.42.6(pid=21329): Launched 22:03:32.271203 run osmo-stp_10.42.42.5(pid=21326): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21326)] 22:03:32.398593 run osmo-stp_10.42.42.5(pid=21326): stdout: | (launched: 2022-12-09_22:03:30.749498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:32.527131 run osmo-stp_10.42.42.5(pid=21326): stderr: | 20221209220330957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220330957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220330958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220330958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220330958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220330959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220330959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:32.652709 run osmo-stp_10.42.42.5(pid=21326): stdout: | (launched: 2022-12-09_22:03:30.749498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:32.772164 run osmo-stp_10.42.42.5(pid=21326): stderr: | 20221209220330957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220330957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220330958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220330958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220330958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220330959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220330959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:32.915270 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21326): Process ended prematurely: osmo-stp_10.42.42.5(pid=21326) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21326)] [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:03:32.924269 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:03:32.951034 run osmo-hlr_10.42.42.2(pid=21323): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21323)] 22:03:32.999470 run osmo-hlr_10.42.42.2(pid=21323): stdout: | (launched: 2022-12-09_22:03:29.805228) 22:03:33.049463 run osmo-hlr_10.42.42.2(pid=21323): stderr: | 20221209220329982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220329982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220329982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220329982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220329982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220329982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220329994 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220330003 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220330003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220330003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:33.118655 run osmo-msc_10.42.42.6(pid=21329): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21329)] 22:03:33.166603 run osmo-msc_10.42.42.6(pid=21329): stdout: | (launched: 2022-12-09_22:03:31.975050) 22:03:33.216381 run osmo-msc_10.42.42.6(pid=21329): stderr: | 20221209220332344 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220332344 DLGLOBAL DEBUG validating counter group 0x7f3ef2965c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220332344 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220332344 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220332345 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220332345 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220332347 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220332347 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220332347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220332347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:33.266563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21322): Terminating (SIGTERM) 22:03:33.306660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21325): Terminating (SIGTERM) 22:03:33.347005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21328): Terminating (SIGTERM) 22:03:33.387403 --- ParallelTerminationStrategy: PID 21322 died... 22:03:33.406511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21322): Terminated: ok {rc=0} 22:03:33.451557 --- ParallelTerminationStrategy: PID 21325 died... 22:03:33.470401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21325): Terminated: ok {rc=0} 22:03:33.515775 --- ParallelTerminationStrategy: PID 21328 died... 22:03:33.534681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21328): Terminated: ok {rc=0} 22:03:33.619131 bus /sierra_3: Setting Powered False 22:03:34.718560 bus /sierra_3: Setting Powered False 22:03:35.835035 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:03:36.984692 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:36.996775 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:03:37.069883 tst mo_mt_call_osmux.py: using LAC 23960 22:03:37.196709 tst mo_mt_call_osmux.py: using RAC 245 22:03:37.321694 tst mo_mt_call_osmux.py: using CellId 23960 22:03:37.449123 tst mo_mt_call_osmux.py: using BVCI 23961 22:03:37.567521 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:37.579054 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:37.590283 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:37.601666 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:37.613042 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:37.624271 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:03:37.744507 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:03:37.860536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:38.325971 run create_hlr_db(pid=21331): Launched 22:03:38.443622 bus /sierra_2: Setting Powered False 22:03:39.503555 run create_hlr_db(pid=21331): Terminated: ok {rc=0} 22:03:39.923631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21333): Launched 22:03:40.225817 run osmo-hlr_10.42.42.2(pid=21334): Launched 22:03:40.342553 run osmo-stp_10.42.42.5: Starting osmo-stp 22:03:40.877043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21336): Launched 22:03:41.177936 run osmo-stp_10.42.42.5(pid=21337): Launched 22:03:41.292758 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:41.840742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21339): Launched 22:03:42.142655 run osmo-msc_10.42.42.6(pid=21340): Launched 22:03:42.312018 run osmo-stp_10.42.42.5(pid=21337): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21337)] 22:03:42.439798 run osmo-stp_10.42.42.5(pid=21337): stdout: | (launched: 2022-12-09_22:03:41.123513) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:42.568374 run osmo-stp_10.42.42.5(pid=21337): stderr: | 20221209220341293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220341293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220341293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220341294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220341296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220341296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220341296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:42.694316 run osmo-stp_10.42.42.5(pid=21337): stdout: | (launched: 2022-12-09_22:03:41.123513) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:42.814319 run osmo-stp_10.42.42.5(pid=21337): stderr: | 20221209220341293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220341293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220341293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220341294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220341296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220341296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220341296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:42.957948 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21337): Process ended prematurely: osmo-stp_10.42.42.5(pid=21337) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21337)] [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:03:42.966976 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:03:42.994093 run osmo-hlr_10.42.42.2(pid=21334): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21334)] 22:03:43.042465 run osmo-hlr_10.42.42.2(pid=21334): stdout: | (launched: 2022-12-09_22:03:40.171381) 22:03:43.092298 run osmo-hlr_10.42.42.2(pid=21334): stderr: | 20221209220340345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220340345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220340345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220340345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220340345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220340345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220340357 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220340365 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220340366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220340366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:43.161947 run osmo-msc_10.42.42.6(pid=21340): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21340)] 22:03:43.210032 run osmo-msc_10.42.42.6(pid=21340): stdout: | (launched: 2022-12-09_22:03:42.088219) 22:03:43.259687 run osmo-msc_10.42.42.6(pid=21340): stderr: | 20221209220342358 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220342358 DLGLOBAL DEBUG validating counter group 0x7f5c331a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220342358 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220342358 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220342358 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220342359 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220342360 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220342361 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220342361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220342361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:43.309934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21333): Terminating (SIGTERM) 22:03:43.350099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21336): Terminating (SIGTERM) 22:03:43.390254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21339): Terminating (SIGTERM) 22:03:43.431044 --- ParallelTerminationStrategy: PID 21333 died... 22:03:43.450339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21333): Terminated: ok {rc=0} 22:03:43.495134 --- ParallelTerminationStrategy: PID 21336 died... 22:03:43.513705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21336): Terminated: ok {rc=0} 22:03:43.558319 --- ParallelTerminationStrategy: PID 21339 died... 22:03:43.576931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21339): Terminated: ok {rc=0} 22:03:43.662872 bus /sierra_3: Setting Powered False 22:03:44.762795 bus /sierra_3: Setting Powered False 22:03:45.888732 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:03:47.154683 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:03:47.161884 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:03:47.195878 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:03:47.223651 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:03:47.276620 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:03:47.309610 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:03:47.335840 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:03:47.890255 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:03:47.941437 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:47.952770 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:03:48.023849 tst mo_mt_call.py: using LAC 23961 22:03:48.150915 tst mo_mt_call.py: using RAC 246 22:03:48.277559 tst mo_mt_call.py: using CellId 23961 22:03:48.402396 tst mo_mt_call.py: using BVCI 23962 22:03:48.518321 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:48.529847 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:48.541349 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:48.552541 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:48.563960 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:48.575272 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:03:48.692268 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:03:48.812027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:49.308068 run create_hlr_db(pid=21345): Launched 22:03:49.438144 bus /sierra_2: Setting Powered False 22:03:50.501690 run create_hlr_db(pid=21345): Terminated: ok {rc=0} 22:03:50.930387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21347): Launched 22:03:51.230559 run osmo-hlr_10.42.42.2(pid=21348): Launched 22:03:51.345889 run osmo-stp_10.42.42.5: Starting osmo-stp 22:03:51.865716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21350): Launched 22:03:52.167607 run osmo-stp_10.42.42.5(pid=21351): Launched 22:03:52.282330 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:52.826787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21353): Launched 22:03:53.128659 run osmo-msc_10.42.42.6(pid=21354): Launched 22:03:53.297909 run osmo-stp_10.42.42.5(pid=21351): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21351)] 22:03:53.425552 run osmo-stp_10.42.42.5(pid=21351): stdout: | (launched: 2022-12-09_22:03:52.113436) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:53.554217 run osmo-stp_10.42.42.5(pid=21351): stderr: | 20221209220352283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220352284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220352284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220352284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220352285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220352285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220352285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:53.679975 run osmo-stp_10.42.42.5(pid=21351): stdout: | (launched: 2022-12-09_22:03:52.113436) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:53.799693 run osmo-stp_10.42.42.5(pid=21351): stderr: | 20221209220352283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220352284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220352284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220352284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220352285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220352285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220352285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:53.943284 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21351): Process ended prematurely: osmo-stp_10.42.42.5(pid=21351) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21351)] [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:03:53.952180 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:03:53.979547 run osmo-hlr_10.42.42.2(pid=21348): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21348)] 22:03:54.027570 run osmo-hlr_10.42.42.2(pid=21348): stdout: | (launched: 2022-12-09_22:03:51.176295) 22:03:54.077537 run osmo-hlr_10.42.42.2(pid=21348): stderr: | 20221209220351352 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220351352 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220351352 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220351352 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220351352 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220351352 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220351367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220351378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220351378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220351378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:54.146831 run osmo-msc_10.42.42.6(pid=21354): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21354)] 22:03:54.194691 run osmo-msc_10.42.42.6(pid=21354): stdout: | (launched: 2022-12-09_22:03:53.073846) 22:03:54.244210 run osmo-msc_10.42.42.6(pid=21354): stderr: | 20221209220353347 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220353347 DLGLOBAL DEBUG validating counter group 0x7f195b9b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220353347 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220353347 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220353348 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220353348 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220353350 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220353350 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220353351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220353351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:54.294269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21347): Terminating (SIGTERM) 22:03:54.333922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21350): Terminating (SIGTERM) 22:03:54.373978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21353): Terminating (SIGTERM) 22:03:54.414055 --- ParallelTerminationStrategy: PID 21347 died... 22:03:54.432790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21347): Terminated: ok {rc=0} 22:03:54.477500 --- ParallelTerminationStrategy: PID 21350 died... 22:03:54.496159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21350): Terminated: ok {rc=0} 22:03:54.541046 --- ParallelTerminationStrategy: PID 21353 died... 22:03:54.559668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21353): Terminated: ok {rc=0} 22:03:54.644694 bus /sierra_3: Setting Powered False 22:03:55.742590 bus /sierra_3: Setting Powered False 22:03:56.858145 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:03:58.002647 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:58.014336 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:03:58.082862 tst mo_mt_call_osmux.py: using LAC 23962 22:03:58.201059 tst mo_mt_call_osmux.py: using RAC 247 22:03:58.328515 tst mo_mt_call_osmux.py: using CellId 23962 22:03:58.454712 tst mo_mt_call_osmux.py: using BVCI 23963 22:03:58.571052 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:58.582690 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:58.594218 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:58.605771 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:58.617122 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:58.628323 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:03:58.746413 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:03:58.865675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:59.363991 run create_hlr_db(pid=21356): Launched 22:03:59.494941 bus /sierra_2: Setting Powered False 22:04:00.558479 run create_hlr_db(pid=21356): Terminated: ok {rc=0} 22:04:01.029790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21358): Launched 22:04:01.374663 run osmo-hlr_10.42.42.2(pid=21359): Launched 22:04:01.498611 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:02.230728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21361): Launched 22:04:02.574753 run osmo-stp_10.42.42.5(pid=21362): Launched 22:04:02.698520 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:03.280165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21364): Launched 22:04:03.602619 run osmo-msc_10.42.42.6(pid=21365): Launched 22:04:03.782393 run osmo-stp_10.42.42.5(pid=21362): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21362)] 22:04:03.918381 run osmo-stp_10.42.42.5(pid=21362): stdout: | (launched: 2022-12-09_22:04:02.516862) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:04.055169 run osmo-stp_10.42.42.5(pid=21362): stderr: | 20221209220402707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220402707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220402707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220402708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220402708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220402708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220402708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:04.190427 run osmo-stp_10.42.42.5(pid=21362): stdout: | (launched: 2022-12-09_22:04:02.516862) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:04.318607 run osmo-stp_10.42.42.5(pid=21362): stderr: | 20221209220402707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220402707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220402707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220402708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220402708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220402708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220402708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:04.471847 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21362): Process ended prematurely: osmo-stp_10.42.42.5(pid=21362) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21362)] [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:04:04.481491 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:04:04.509580 run osmo-hlr_10.42.42.2(pid=21359): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21359)] 22:04:04.559944 run osmo-hlr_10.42.42.2(pid=21359): stdout: | (launched: 2022-12-09_22:04:01.310914) 22:04:04.611891 run osmo-hlr_10.42.42.2(pid=21359): stderr: | 20221209220401731 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220401731 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220401731 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220401731 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220401731 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220401734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220401755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220401780 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220401780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220401780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:04.684226 run osmo-msc_10.42.42.6(pid=21365): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21365)] 22:04:04.734369 run osmo-msc_10.42.42.6(pid=21365): stdout: | (launched: 2022-12-09_22:04:03.544297) 22:04:04.786485 run osmo-msc_10.42.42.6(pid=21365): stderr: | 20221209220403865 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220403866 DLGLOBAL DEBUG validating counter group 0x7fcb28fc9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220403866 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220403866 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220403866 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220403866 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220403868 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220403868 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220403868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220403868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:04.838876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21358): Terminating (SIGTERM) 22:04:04.881119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21361): Terminating (SIGTERM) 22:04:04.923093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21364): Terminating (SIGTERM) 22:04:04.965161 --- ParallelTerminationStrategy: PID 21358 died... 22:04:04.985343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21358): Terminated: ok {rc=0} 22:04:05.032163 --- ParallelTerminationStrategy: PID 21361 died... 22:04:05.051898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21361): Terminated: ok {rc=0} 22:04:05.098157 --- ParallelTerminationStrategy: PID 21364 died... 22:04:05.117973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21364): Terminated: ok {rc=0} 22:04:05.206346 bus /sierra_3: Setting Powered False 22:04:06.303937 bus /sierra_3: Setting Powered False 22:04:07.420305 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:04:08.667015 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:04:08.673613 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:04:08.706436 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:04:08.732934 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:04:08.785543 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:04:08.819743 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:04:08.846159 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:04:09.406236 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:04:09.455746 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:09.466800 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:04:09.542643 tst mo_mt_call.py: using LAC 23963 22:04:09.661361 tst mo_mt_call.py: using RAC 248 22:04:09.779377 tst mo_mt_call.py: using CellId 23963 22:04:09.895559 tst mo_mt_call.py: using BVCI 23964 22:04:10.003397 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:10.014417 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:10.025209 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:10.036173 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:10.047253 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:10.058634 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:04:10.173721 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:04:10.289507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:04:10.754343 run create_hlr_db(pid=21370): Launched 22:04:10.869482 bus /sierra_2: Setting Powered False 22:04:11.929832 run create_hlr_db(pid=21370): Terminated: ok {rc=0} 22:04:12.350229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21372): Launched 22:04:12.650965 run osmo-hlr_10.42.42.2(pid=21373): Launched 22:04:12.766517 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:13.283485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21375): Launched 22:04:13.585220 run osmo-stp_10.42.42.5(pid=21376): Launched 22:04:13.701154 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:14.247985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21378): Launched 22:04:14.550115 run osmo-msc_10.42.42.6(pid=21379): Launched 22:04:14.719112 run osmo-stp_10.42.42.5(pid=21376): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21376)] 22:04:14.846619 run osmo-stp_10.42.42.5(pid=21376): stdout: | (launched: 2022-12-09_22:04:13.530282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:14.974383 run osmo-stp_10.42.42.5(pid=21376): stderr: | 20221209220413701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220413702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220413702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220413702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220413703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220413703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220413703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:15.100266 run osmo-stp_10.42.42.5(pid=21376): stdout: | (launched: 2022-12-09_22:04:13.530282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:15.219576 run osmo-stp_10.42.42.5(pid=21376): stderr: | 20221209220413701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220413702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220413702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220413702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220413703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220413703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220413703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:15.362838 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21376): Process ended prematurely: osmo-stp_10.42.42.5(pid=21376) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21376)] [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:04:15.371821 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:04:15.398904 run osmo-hlr_10.42.42.2(pid=21373): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21373)] 22:04:15.446850 run osmo-hlr_10.42.42.2(pid=21373): stdout: | (launched: 2022-12-09_22:04:12.596452) 22:04:15.496628 run osmo-hlr_10.42.42.2(pid=21373): stderr: | 20221209220412773 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220412773 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220412773 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220412773 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220412773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220412773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220412786 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220412795 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220412795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220412795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:15.565429 run osmo-msc_10.42.42.6(pid=21379): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21379)] 22:04:15.613275 run osmo-msc_10.42.42.6(pid=21379): stdout: | (launched: 2022-12-09_22:04:14.495445) 22:04:15.663184 run osmo-msc_10.42.42.6(pid=21379): stderr: | 20221209220414768 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220414768 DLGLOBAL DEBUG validating counter group 0x7f77b7c1bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220414768 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220414768 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220414769 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220414769 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220414771 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220414771 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220414772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220414772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:15.713343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21372): Terminating (SIGTERM) 22:04:15.753263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21375): Terminating (SIGTERM) 22:04:15.793078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21378): Terminating (SIGTERM) 22:04:15.837736 --- ParallelTerminationStrategy: PID 21372 died... 22:04:15.862562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21372): Terminated: ok {rc=0} 22:04:15.919502 --- ParallelTerminationStrategy: PID 21375 died... 22:04:15.939346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21375): Terminated: ok {rc=0} 22:04:15.986069 --- ParallelTerminationStrategy: PID 21378 died... 22:04:16.005639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21378): Terminated: ok {rc=0} 22:04:16.093094 bus /sierra_3: Setting Powered False 22:04:17.196120 bus /sierra_3: Setting Powered False 22:04:18.317523 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:04:19.469706 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:19.481871 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:04:19.553367 tst mo_mt_call_osmux.py: using LAC 23964 22:04:19.683228 tst mo_mt_call_osmux.py: using RAC 249 22:04:19.800887 tst mo_mt_call_osmux.py: using CellId 23964 22:04:19.918253 tst mo_mt_call_osmux.py: using BVCI 23965 22:04:20.035466 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:20.046969 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:20.058379 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:20.069849 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:20.081161 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:20.092489 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:04:20.209891 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:04:20.327238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:04:20.792054 run create_hlr_db(pid=21381): Launched 22:04:20.908038 bus /sierra_2: Setting Powered False 22:04:21.969078 run create_hlr_db(pid=21381): Terminated: ok {rc=0} 22:04:22.387662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21383): Launched 22:04:22.688170 run osmo-hlr_10.42.42.2(pid=21384): Launched 22:04:22.805099 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:23.335290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21386): Launched 22:04:23.635950 run osmo-stp_10.42.42.5(pid=21387): Launched 22:04:23.752176 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:24.294998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21389): Launched 22:04:24.595141 run osmo-msc_10.42.42.6(pid=21390): Launched 22:04:24.763784 run osmo-stp_10.42.42.5(pid=21387): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21387)] 22:04:24.891282 run osmo-stp_10.42.42.5(pid=21387): stdout: | (launched: 2022-12-09_22:04:23.581235) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:25.019520 run osmo-stp_10.42.42.5(pid=21387): stderr: | 20221209220423751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220423751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220423751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220423752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220423752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220423752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220423752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:25.145242 run osmo-stp_10.42.42.5(pid=21387): stdout: | (launched: 2022-12-09_22:04:23.581235) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:25.264784 run osmo-stp_10.42.42.5(pid=21387): stderr: | 20221209220423751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220423751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220423751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220423752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220423752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220423752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220423752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:25.407946 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21387): Process ended prematurely: osmo-stp_10.42.42.5(pid=21387) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21387)] [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:04:25.417019 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:04:25.443872 run osmo-hlr_10.42.42.2(pid=21384): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21384)] 22:04:25.492252 run osmo-hlr_10.42.42.2(pid=21384): stdout: | (launched: 2022-12-09_22:04:22.633633) 22:04:25.542458 run osmo-hlr_10.42.42.2(pid=21384): stderr: | 20221209220422809 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220422809 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220422809 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220422809 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220422809 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220422809 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220422821 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220422829 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220422830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220422830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:25.611696 run osmo-msc_10.42.42.6(pid=21390): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21390)] 22:04:25.659654 run osmo-msc_10.42.42.6(pid=21390): stdout: | (launched: 2022-12-09_22:04:24.540854) 22:04:25.709592 run osmo-msc_10.42.42.6(pid=21390): stderr: | 20221209220424814 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220424814 DLGLOBAL DEBUG validating counter group 0x7f1db32d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220424814 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220424814 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220424814 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220424814 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220424816 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220424817 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220424817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220424817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:25.760390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21383): Terminating (SIGTERM) 22:04:25.800447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21386): Terminating (SIGTERM) 22:04:25.840475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21389): Terminating (SIGTERM) 22:04:25.880813 --- ParallelTerminationStrategy: PID 21383 died... 22:04:25.900039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21383): Terminated: ok {rc=0} 22:04:25.945084 --- ParallelTerminationStrategy: PID 21386 died... 22:04:25.963817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21386): Terminated: ok {rc=0} 22:04:26.008457 --- ParallelTerminationStrategy: PID 21389 died... 22:04:26.027135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21389): Terminated: ok {rc=0} 22:04:26.114567 bus /sierra_3: Setting Powered False 22:04:27.213742 bus /sierra_3: Setting Powered False 22:04:28.326931 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:04:29.570543 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:04:29.576777 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:04:29.610050 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:04:29.636531 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:04:29.690599 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:04:29.726038 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:04:29.753295 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:04:30.298444 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:04:30.347614 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:30.358571 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:04:30.426801 tst mo_mt_call.py: using LAC 23965 22:04:30.543856 tst mo_mt_call.py: using RAC 250 22:04:30.662081 tst mo_mt_call.py: using CellId 23965 22:04:30.779582 tst mo_mt_call.py: using BVCI 23966 22:04:30.900367 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:30.919690 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:30.935413 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:30.948067 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:30.962338 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:30.974643 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:04:31.105391 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:04:31.233050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:04:31.712759 run create_hlr_db(pid=21395): Launched 22:04:31.862633 bus /sierra_2: Setting Powered False 22:04:32.922558 run create_hlr_db(pid=21395): Terminated: ok {rc=0} 22:04:33.360508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21397): Launched 22:04:33.681628 run osmo-hlr_10.42.42.2(pid=21398): Launched 22:04:33.806089 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:34.362628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21400): Launched 22:04:34.683636 run osmo-stp_10.42.42.5(pid=21401): Launched 22:04:34.806295 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:35.384719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21403): Launched 22:04:35.704729 run osmo-msc_10.42.42.6(pid=21404): Launched 22:04:35.885242 run osmo-stp_10.42.42.5(pid=21401): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21401)] 22:04:36.021132 run osmo-stp_10.42.42.5(pid=21401): stdout: | (launched: 2022-12-09_22:04:34.625905) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:36.157396 run osmo-stp_10.42.42.5(pid=21401): stderr: | 20221209220434818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220434818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220434818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220434819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220434819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220434819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220434819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:36.292761 run osmo-stp_10.42.42.5(pid=21401): stdout: | (launched: 2022-12-09_22:04:34.625905) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:36.420516 run osmo-stp_10.42.42.5(pid=21401): stderr: | 20221209220434818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220434818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220434818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220434819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220434819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220434819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220434819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:36.573432 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21401): Process ended prematurely: osmo-stp_10.42.42.5(pid=21401) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21401)] [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:04:36.583156 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:04:36.610996 run osmo-hlr_10.42.42.2(pid=21398): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21398)] 22:04:36.661100 run osmo-hlr_10.42.42.2(pid=21398): stdout: | (launched: 2022-12-09_22:04:33.623909) 22:04:36.712663 run osmo-hlr_10.42.42.2(pid=21398): stderr: | 20221209220433821 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220433822 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220433822 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220433822 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220433822 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220433822 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220433849 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220433860 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220433861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220433861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:36.784383 run osmo-msc_10.42.42.6(pid=21404): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21404)] 22:04:36.834159 run osmo-msc_10.42.42.6(pid=21404): stdout: | (launched: 2022-12-09_22:04:35.646669) 22:04:36.886059 run osmo-msc_10.42.42.6(pid=21404): stderr: | 20221209220435969 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220435969 DLGLOBAL DEBUG validating counter group 0x7f5907220c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220435969 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220435969 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220435969 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220435969 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220435971 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220435971 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220435972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220435972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:36.937974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21397): Terminating (SIGTERM) 22:04:36.979448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21400): Terminating (SIGTERM) 22:04:37.021034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21403): Terminating (SIGTERM) 22:04:37.062780 --- ParallelTerminationStrategy: PID 21397 died... 22:04:37.082662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21397): Terminated: ok {rc=0} 22:04:37.128921 --- ParallelTerminationStrategy: PID 21400 died... 22:04:37.148505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21400): Terminated: ok {rc=0} 22:04:37.194518 --- ParallelTerminationStrategy: PID 21403 died... 22:04:37.214131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21403): Terminated: ok {rc=0} 22:04:37.302151 bus /sierra_3: Setting Powered False 22:04:38.403428 bus /sierra_3: Setting Powered False 22:04:39.520893 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:04:40.667076 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:40.678904 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:04:40.748760 tst mo_mt_call_osmux.py: using LAC 23966 22:04:40.868849 tst mo_mt_call_osmux.py: using RAC 251 22:04:40.987087 tst mo_mt_call_osmux.py: using CellId 23966 22:04:41.107316 tst mo_mt_call_osmux.py: using BVCI 23967 22:04:41.217646 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:41.228558 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:41.239379 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:41.250507 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:41.261890 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:41.272806 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:04:41.388239 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:04:41.507681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:04:42.007038 run create_hlr_db(pid=21406): Launched 22:04:42.138228 bus /sierra_2: Setting Powered False 22:04:43.202426 run create_hlr_db(pid=21406): Terminated: ok {rc=0} 22:04:43.634444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21408): Launched 22:04:43.936679 run osmo-hlr_10.42.42.2(pid=21409): Launched 22:04:44.052083 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:44.571184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21411): Launched 22:04:44.873078 run osmo-stp_10.42.42.5(pid=21412): Launched 22:04:44.987976 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:45.534353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21414): Launched 22:04:45.843084 run osmo-msc_10.42.42.6(pid=21415): Launched 22:04:46.140218 run osmo-stp_10.42.42.5(pid=21412): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21412)] 22:04:46.311290 run osmo-stp_10.42.42.5(pid=21412): stdout: | (launched: 2022-12-09_22:04:44.818111) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:46.603524 run osmo-stp_10.42.42.5(pid=21412): stderr: | 20221209220444987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220444987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220444988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220444988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220444988 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220444989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220444989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:46.795903 run osmo-stp_10.42.42.5(pid=21412): stdout: | (launched: 2022-12-09_22:04:44.818111) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:46.919761 run osmo-stp_10.42.42.5(pid=21412): stderr: | 20221209220444987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220444987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220444988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220444988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220444988 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220444989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220444989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:47.067973 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21412): Process ended prematurely: osmo-stp_10.42.42.5(pid=21412) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21412)] [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:04:47.078091 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:04:47.108214 run osmo-hlr_10.42.42.2(pid=21409): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21409)] 22:04:47.159228 run osmo-hlr_10.42.42.2(pid=21409): stdout: | (launched: 2022-12-09_22:04:43.881913) 22:04:47.212086 run osmo-hlr_10.42.42.2(pid=21409): stderr: | 20221209220444060 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220444060 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220444060 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220444060 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220444060 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220444060 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220444073 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220444084 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220444084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220444084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:47.284465 run osmo-msc_10.42.42.6(pid=21415): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21415)] 22:04:47.334761 run osmo-msc_10.42.42.6(pid=21415): stdout: | (launched: 2022-12-09_22:04:45.780680) 22:04:47.385555 run osmo-msc_10.42.42.6(pid=21415): stderr: | 20221209220446387 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220446387 DLGLOBAL DEBUG validating counter group 0x7f1971943c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220446387 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220446387 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220446387 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220446387 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220446397 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220446398 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220446398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220446398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:47.435862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21408): Terminating (SIGTERM) 22:04:47.476307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21411): Terminating (SIGTERM) 22:04:47.516800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21414): Terminating (SIGTERM) 22:04:47.557690 --- ParallelTerminationStrategy: PID 21408 died... 22:04:47.576866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21408): Terminated: ok {rc=0} 22:04:47.622110 --- ParallelTerminationStrategy: PID 21411 died... 22:04:47.640855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21411): Terminated: ok {rc=0} 22:04:47.686382 --- ParallelTerminationStrategy: PID 21414 died... 22:04:47.705430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21414): Terminated: ok {rc=0} 22:04:47.793455 bus /sierra_3: Setting Powered False 22:04:48.891965 bus /sierra_3: Setting Powered False 22:04:50.005342 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:04:51.257541 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:04:51.264735 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:04:51.299007 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:04:51.326650 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:04:51.379936 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:04:51.413927 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:04:51.441387 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:04:51.997948 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:04:52.049534 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:52.061289 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:04:52.136926 tst mo_mt_call.py: using LAC 23967 22:04:52.264104 tst mo_mt_call.py: using RAC 252 22:04:52.383342 tst mo_mt_call.py: using CellId 23967 22:04:52.500392 tst mo_mt_call.py: using BVCI 23968 22:04:52.609582 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:52.620729 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:52.631805 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:52.642970 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:52.654533 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:52.665852 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:04:52.786220 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:04:52.902905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:04:53.368758 run create_hlr_db(pid=21420): Launched 22:04:53.483750 bus /sierra_2: Setting Powered False 22:04:54.548424 run create_hlr_db(pid=21420): Terminated: ok {rc=0} 22:04:54.979047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21422): Launched 22:04:55.278676 run osmo-hlr_10.42.42.2(pid=21423): Launched 22:04:55.393178 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:55.921311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21425): Launched 22:04:56.222114 run osmo-stp_10.42.42.5(pid=21426): Launched 22:04:56.336612 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:56.879064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21428): Launched 22:04:57.179505 run osmo-msc_10.42.42.6(pid=21429): Launched 22:04:57.347734 run osmo-stp_10.42.42.5(pid=21426): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21426)] 22:04:57.474843 run osmo-stp_10.42.42.5(pid=21426): stdout: | (launched: 2022-12-09_22:04:56.167625) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:57.602725 run osmo-stp_10.42.42.5(pid=21426): stderr: | 20221209220456336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220456336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220456336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220456337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220456339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220456339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220456339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:57.728356 run osmo-stp_10.42.42.5(pid=21426): stdout: | (launched: 2022-12-09_22:04:56.167625) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:57.848057 run osmo-stp_10.42.42.5(pid=21426): stderr: | 20221209220456336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220456336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220456336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220456337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220456339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220456339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220456339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:57.991308 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21426): Process ended prematurely: osmo-stp_10.42.42.5(pid=21426) [trial-2365↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21426)] [trial-2365↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:04:58.000682 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:04:58.027756 run osmo-hlr_10.42.42.2(pid=21423): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21423)] 22:04:58.075533 run osmo-hlr_10.42.42.2(pid=21423): stdout: | (launched: 2022-12-09_22:04:55.224584) 22:04:58.124831 run osmo-hlr_10.42.42.2(pid=21423): stderr: | 20221209220455398 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220455398 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220455398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220455398 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220455398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220455398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220455411 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220455421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220455421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220455421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:58.193523 run osmo-msc_10.42.42.6(pid=21429): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21429)] 22:04:58.241193 run osmo-msc_10.42.42.6(pid=21429): stdout: | (launched: 2022-12-09_22:04:57.124938) 22:04:58.290709 run osmo-msc_10.42.42.6(pid=21429): stderr: | 20221209220457397 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220457397 DLGLOBAL DEBUG validating counter group 0x7f467033bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220457397 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220457397 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220457398 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220457398 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220457400 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220457400 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220457400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220457400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:58.340607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21422): Terminating (SIGTERM) 22:04:58.380226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21425): Terminating (SIGTERM) 22:04:58.420018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21428): Terminating (SIGTERM) 22:04:58.460007 --- ParallelTerminationStrategy: PID 21422 died... 22:04:58.479181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21422): Terminated: ok {rc=0} 22:04:58.523976 --- ParallelTerminationStrategy: PID 21425 died... 22:04:58.542710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21425): Terminated: ok {rc=0} 22:04:58.587143 --- ParallelTerminationStrategy: PID 21428 died... 22:04:58.605897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21428): Terminated: ok {rc=0} 22:04:58.693104 bus /sierra_3: Setting Powered False 22:04:59.796272 bus /sierra_3: Setting Powered False 22:05:00.920444 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:05:02.098336 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:05:02.115395 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:05:02.198373 tst mo_mt_call_osmux.py: using LAC 23968 22:05:02.329715 tst mo_mt_call_osmux.py: using RAC 253 22:05:02.447200 tst mo_mt_call_osmux.py: using CellId 23968 22:05:02.565159 tst mo_mt_call_osmux.py: using BVCI 23969 22:05:02.675689 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:05:02.687018 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:05:02.698102 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:05:02.709729 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:05:02.721273 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:05:02.732714 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:05:02.854019 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:05:02.977986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:03.477167 run create_hlr_db(pid=21434): Launched 22:05:03.609486 bus /sierra_2: Setting Powered False 22:05:04.674026 run create_hlr_db(pid=21434): Terminated: ok {rc=0} 22:05:05.122586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21436): Launched 22:05:05.445221 run osmo-hlr_10.42.42.2(pid=21437): Launched 22:05:05.568199 run osmo-stp_10.42.42.5: Starting osmo-stp 22:05:06.129694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21439): Launched 22:05:06.453494 run osmo-stp_10.42.42.5(pid=21440): Launched 22:05:06.576900 run osmo-msc_10.42.42.6: Starting osmo-msc 22:05:07.161721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21442): Launched 22:05:07.485562 run osmo-msc_10.42.42.6(pid=21443): Launched 22:05:07.666808 run osmo-stp_10.42.42.5(pid=21440): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21440)] 22:05:07.803156 run osmo-stp_10.42.42.5(pid=21440): stdout: | (launched: 2022-12-09_22:05:06.395305) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:07.941532 run osmo-stp_10.42.42.5(pid=21440): stderr: | 20221209220506588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220506588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220506589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220506589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220506589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220506590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220506590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:08.077955 run osmo-stp_10.42.42.5(pid=21440): stdout: | (launched: 2022-12-09_22:05:06.395305) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:08.207034 run osmo-stp_10.42.42.5(pid=21440): stderr: | 20221209220506588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220506588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220506589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220506589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220506589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220506590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220506590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:08.361417 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21440): Process ended prematurely: osmo-stp_10.42.42.5(pid=21440) [trial-2365↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21440)] [trial-2365↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:05:08.371066 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:05:08.398699 run osmo-hlr_10.42.42.2(pid=21437): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21437)] 22:05:08.448877 run osmo-hlr_10.42.42.2(pid=21437): stdout: | (launched: 2022-12-09_22:05:05.387272) 22:05:08.500927 run osmo-hlr_10.42.42.2(pid=21437): stderr: | 20221209220505585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220505585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220505585 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220505585 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220505585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220505585 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220505597 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220505606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220505606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220505606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:05:08.573297 run osmo-msc_10.42.42.6(pid=21443): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21443)] 22:05:08.623121 run osmo-msc_10.42.42.6(pid=21443): stdout: | (launched: 2022-12-09_22:05:07.427282) 22:05:08.674564 run osmo-msc_10.42.42.6(pid=21443): stderr: | 20221209220507751 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220507751 DLGLOBAL DEBUG validating counter group 0x7f2559329c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220507751 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220507751 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220507752 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220507752 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220507753 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220507754 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220507754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220507754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:05:08.726342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21436): Terminating (SIGTERM) 22:05:08.767602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21439): Terminating (SIGTERM) 22:05:08.809160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21442): Terminating (SIGTERM) 22:05:08.850811 --- ParallelTerminationStrategy: PID 21436 died... 22:05:08.870882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21436): Terminated: ok {rc=0} 22:05:08.917375 --- ParallelTerminationStrategy: PID 21439 died... 22:05:08.937075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21439): Terminated: ok {rc=0} 22:05:08.982848 --- ParallelTerminationStrategy: PID 21442 died... 22:05:09.002362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21442): Terminated: ok {rc=0} 22:05:09.090059 bus /sierra_3: Setting Powered False 22:05:10.189584 bus /sierra_3: Setting Powered False 22:05:11.305230 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:05:12.563429 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:05:12.570413 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:05:12.604727 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:05:12.631172 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:05:12.681126 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:05:12.714354 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:05:12.740861 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:05:13.296119 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:05:13.347559 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:13.358615 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:05:13.427388 tst mo_mt_call.py: using LAC 23969 22:05:13.545719 tst mo_mt_call.py: using RAC 254 22:05:13.662153 tst mo_mt_call.py: using CellId 23969 22:05:13.778291 tst mo_mt_call.py: using BVCI 23970 22:05:13.887733 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:13.898621 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:13.909289 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:13.920282 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:13.931481 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:13.942562 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:05:14.061382 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:05:14.181579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:14.679823 run create_hlr_db(pid=21449): Launched 22:05:14.810700 bus /sierra_2: Setting Powered False 22:05:15.891291 run create_hlr_db(pid=21449): Terminated: ok {rc=0} 22:05:16.344237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21451): Launched 22:05:16.678734 run osmo-hlr_10.42.42.2(pid=21452): Launched 22:05:17.015035 run osmo-stp_10.42.42.5: Starting osmo-stp 22:05:17.588594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21454): Launched 22:05:17.890897 run osmo-stp_10.42.42.5(pid=21455): Launched 22:05:18.006250 run osmo-msc_10.42.42.6: Starting osmo-msc 22:05:18.551064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21457): Launched 22:05:18.853764 run osmo-msc_10.42.42.6(pid=21458): Launched 22:05:19.024511 run osmo-stp_10.42.42.5(pid=21455): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21455)] 22:05:19.154184 run osmo-stp_10.42.42.5(pid=21455): stdout: | (launched: 2022-12-09_22:05:17.836357) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:19.283898 run osmo-stp_10.42.42.5(pid=21455): stderr: | 20221209220518005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220518005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220518006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220518006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220518008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220518009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220518009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:19.411492 run osmo-stp_10.42.42.5(pid=21455): stdout: | (launched: 2022-12-09_22:05:17.836357) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:19.532898 run osmo-stp_10.42.42.5(pid=21455): stderr: | 20221209220518005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220518005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220518006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220518006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220518008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220518009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220518009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:19.678337 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21455): Process ended prematurely: osmo-stp_10.42.42.5(pid=21455) [trial-2365↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21455)] [trial-2365↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:05:19.687329 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:05:19.714257 run osmo-hlr_10.42.42.2(pid=21452): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21452)] 22:05:19.763093 run osmo-hlr_10.42.42.2(pid=21452): stdout: | (launched: 2022-12-09_22:05:16.612155) 22:05:19.813188 run osmo-hlr_10.42.42.2(pid=21452): stderr: | 20221209220516831 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220516831 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220516831 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220516831 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220516831 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220516831 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220516847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220516858 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220516858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220516858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:05:19.882744 run osmo-msc_10.42.42.6(pid=21458): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21458)] 22:05:19.931089 run osmo-msc_10.42.42.6(pid=21458): stdout: | (launched: 2022-12-09_22:05:18.798769) 22:05:19.980893 run osmo-msc_10.42.42.6(pid=21458): stderr: | 20221209220519068 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220519069 DLGLOBAL DEBUG validating counter group 0x7fbbcffe7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220519069 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220519069 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220519069 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220519069 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220519071 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220519071 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220519071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220519071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:05:20.031186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21451): Terminating (SIGTERM) 22:05:20.071462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21454): Terminating (SIGTERM) 22:05:20.111838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21457): Terminating (SIGTERM) 22:05:20.152662 --- ParallelTerminationStrategy: PID 21451 died... 22:05:20.172053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21451): Terminated: ok {rc=0} 22:05:20.217202 --- ParallelTerminationStrategy: PID 21454 died... 22:05:20.235719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21454): Terminated: ok {rc=0} 22:05:20.279943 --- ParallelTerminationStrategy: PID 21457 died... 22:05:20.298560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21457): Terminated: ok {rc=0} 22:05:20.384716 bus /sierra_3: Setting Powered False 22:05:21.484659 bus /sierra_3: Setting Powered False 22:05:22.601353 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:05:23.747903 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:23.759636 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:05:23.830204 tst mo_mt_call_osmux.py: using LAC 23970 22:05:23.948881 tst mo_mt_call_osmux.py: using RAC 255 22:05:24.077093 tst mo_mt_call_osmux.py: using CellId 23970 22:05:24.207134 tst mo_mt_call_osmux.py: using BVCI 23971 22:05:24.318227 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:24.329267 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:24.343648 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:24.355157 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:24.366884 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:24.378058 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:05:24.495268 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:05:24.614673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:25.082492 run create_hlr_db(pid=21461): Launched 22:05:25.198833 bus /sierra_2: Setting Powered False 22:05:26.259193 run create_hlr_db(pid=21461): Terminated: ok {rc=0} 22:05:26.679213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21463): Launched 22:05:26.981068 run osmo-hlr_10.42.42.2(pid=21464): Launched 22:05:27.097249 run osmo-stp_10.42.42.5: Starting osmo-stp 22:05:27.628806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21466): Launched 22:05:27.931371 run osmo-stp_10.42.42.5(pid=21467): Launched 22:05:28.047288 run osmo-msc_10.42.42.6: Starting osmo-msc 22:05:28.594035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21469): Launched 22:05:28.895919 run osmo-msc_10.42.42.6(pid=21470): Launched 22:05:29.066302 run osmo-stp_10.42.42.5(pid=21467): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21467)] 22:05:29.195310 run osmo-stp_10.42.42.5(pid=21467): stdout: | (launched: 2022-12-09_22:05:27.875666) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:29.323841 run osmo-stp_10.42.42.5(pid=21467): stderr: | 20221209220528046 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220528046 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220528046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220528047 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220528047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220528047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220528047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:29.449967 run osmo-stp_10.42.42.5(pid=21467): stdout: | (launched: 2022-12-09_22:05:27.875666) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:29.570463 run osmo-stp_10.42.42.5(pid=21467): stderr: | 20221209220528046 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220528046 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220528046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220528047 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220528047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220528047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220528047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:29.714890 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21467): Process ended prematurely: osmo-stp_10.42.42.5(pid=21467) [trial-2365↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21467)] [trial-2365↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:05:29.723882 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:05:29.751628 run osmo-hlr_10.42.42.2(pid=21464): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21464)] 22:05:29.799788 run osmo-hlr_10.42.42.2(pid=21464): stdout: | (launched: 2022-12-09_22:05:26.926092) 22:05:29.849620 run osmo-hlr_10.42.42.2(pid=21464): stderr: | 20221209220527102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220527102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220527102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220527102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220527102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220527102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220527117 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220527125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220527126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220527126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:05:29.918534 run osmo-msc_10.42.42.6(pid=21470): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21470)] 22:05:29.966239 run osmo-msc_10.42.42.6(pid=21470): stdout: | (launched: 2022-12-09_22:05:28.841282) 22:05:30.015601 run osmo-msc_10.42.42.6(pid=21470): stderr: | 20221209220529110 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220529111 DLGLOBAL DEBUG validating counter group 0x7f1398897c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220529111 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220529111 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220529111 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220529111 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220529114 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220529115 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220529115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220529115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:05:30.065392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21463): Terminating (SIGTERM) 22:05:30.105122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21466): Terminating (SIGTERM) 22:05:30.144731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21469): Terminating (SIGTERM) 22:05:30.184565 --- ParallelTerminationStrategy: PID 21463 died... 22:05:30.203657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21463): Terminated: ok {rc=0} 22:05:30.248094 --- ParallelTerminationStrategy: PID 21466 died... 22:05:30.266769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21466): Terminated: ok {rc=0} 22:05:30.311361 --- ParallelTerminationStrategy: PID 21469 died... 22:05:30.330106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21469): Terminated: ok {rc=0} 22:05:30.416267 bus /sierra_3: Setting Powered False 22:05:31.521402 bus /sierra_3: Setting Powered False 22:05:32.639453 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 22:05:33.891961 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:05:33.896717 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 22:05:33.930003 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 22:05:33.956839 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 22:05:34.008294 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 22:05:34.040776 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 22:05:34.066890 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 22:05:34.616508 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 22:05:34.665215 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:34.675949 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 22:05:34.729278 tst mo_mt_call.py: using LAC 23971 22:05:34.848087 tst mo_mt_call.py: using RAC 1 22:05:34.965046 tst mo_mt_call.py: using CellId 23971 22:05:35.081191 tst mo_mt_call.py: using BVCI 23972 22:05:35.190339 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:35.201223 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:35.211848 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:35.222747 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:35.233742 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:35.244635 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 22:05:35.364634 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 22:05:35.485136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:35.983521 run create_hlr_db(pid=21475): Launched 22:05:36.115038 bus /sierra_2: Setting Powered False 22:05:37.178700 run create_hlr_db(pid=21475): Terminated: ok {rc=0} 22:05:37.626550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21477): Launched 22:05:37.947868 run osmo-hlr_10.42.42.2(pid=21478): Launched 22:05:38.070123 run osmo-stp_10.42.42.5: Starting osmo-stp 22:05:38.621640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21480): Launched 22:05:38.945608 run osmo-stp_10.42.42.5(pid=21481): Launched 22:05:39.070219 run osmo-msc_10.42.42.6: Starting osmo-msc 22:05:39.655635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21483): Launched 22:05:39.977121 run osmo-msc_10.42.42.6(pid=21484): Launched 22:05:40.156437 run osmo-stp_10.42.42.5(pid=21481): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21481)] 22:05:40.291502 run osmo-stp_10.42.42.5(pid=21481): stdout: | (launched: 2022-12-09_22:05:38.887152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:40.428118 run osmo-stp_10.42.42.5(pid=21481): stderr: | 20221209220539079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220539080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220539080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220539080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220539081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220539081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220539081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:40.563573 run osmo-stp_10.42.42.5(pid=21481): stdout: | (launched: 2022-12-09_22:05:38.887152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:40.691383 run osmo-stp_10.42.42.5(pid=21481): stderr: | 20221209220539079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220539080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220539080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220539080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220539081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220539081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220539081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:40.844616 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21481): Process ended prematurely: osmo-stp_10.42.42.5(pid=21481) [trial-2365↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21481)] [trial-2365↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 22:05:40.854341 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:05:40.882306 run osmo-hlr_10.42.42.2(pid=21478): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21478)] 22:05:40.933105 run osmo-hlr_10.42.42.2(pid=21478): stdout: | (launched: 2022-12-09_22:05:37.889730) 22:05:40.985188 run osmo-hlr_10.42.42.2(pid=21478): stderr: | 20221209220538089 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220538089 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220538089 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220538089 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220538089 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220538089 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220538100 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220538108 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220538109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220538109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:05:41.057376 run osmo-msc_10.42.42.6(pid=21484): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21484)] 22:05:41.107449 run osmo-msc_10.42.42.6(pid=21484): stdout: | (launched: 2022-12-09_22:05:39.919087) 22:05:41.159011 run osmo-msc_10.42.42.6(pid=21484): stderr: | 20221209220540242 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220540243 DLGLOBAL DEBUG validating counter group 0x7ff4afd30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220540243 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220540243 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220540243 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220540243 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220540245 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220540245 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220540245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220540246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:05:41.211082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21477): Terminating (SIGTERM) 22:05:41.252744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21480): Terminating (SIGTERM) 22:05:41.294732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21483): Terminating (SIGTERM) 22:05:41.336795 --- ParallelTerminationStrategy: PID 21477 died... 22:05:41.356838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21477): Terminated: ok {rc=0} 22:05:41.403489 --- ParallelTerminationStrategy: PID 21480 died... 22:05:41.423096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21480): Terminated: ok {rc=0} 22:05:41.469689 --- ParallelTerminationStrategy: PID 21483 died... 22:05:41.489370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21483): Terminated: ok {rc=0} 22:05:41.577875 bus /sierra_3: Setting Powered False 22:05:42.676510 bus /sierra_3: Setting Powered False 22:05:43.793650 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 22:05:44.945871 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:44.958015 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 22:05:45.011600 tst mo_mt_call_osmux.py: using LAC 23972 22:05:45.139526 tst mo_mt_call_osmux.py: using RAC 2 22:05:45.265315 tst mo_mt_call_osmux.py: using CellId 23972 22:05:45.396431 tst mo_mt_call_osmux.py: using BVCI 23973 22:05:45.514544 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:45.526202 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:45.537628 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:45.549297 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:45.560836 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:45.572476 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 22:05:45.693724 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 22:05:45.815278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:46.328177 run create_hlr_db(pid=21486): Launched 22:05:46.486980 bus /sierra_2: Setting Powered False 22:05:47.550726 run create_hlr_db(pid=21486): Terminated: ok {rc=0} 22:05:48.000047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21488): Launched 22:05:48.321426 run osmo-hlr_10.42.42.2(pid=21489): Launched 22:05:48.446410 run osmo-stp_10.42.42.5: Starting osmo-stp 22:05:49.008189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21491): Launched 22:05:49.330647 run osmo-stp_10.42.42.5(pid=21492): Launched 22:05:49.453576 run osmo-msc_10.42.42.6: Starting osmo-msc 22:05:50.035602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21494): Launched 22:05:50.357389 run osmo-msc_10.42.42.6(pid=21495): Launched 22:05:50.539624 run osmo-stp_10.42.42.5(pid=21492): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21492)] 22:05:50.676803 run osmo-stp_10.42.42.5(pid=21492): stdout: | (launched: 2022-12-09_22:05:49.272672) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:50.814853 run osmo-stp_10.42.42.5(pid=21492): stderr: | 20221209220549466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220549466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220549466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220549467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220549467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220549467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220549467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:50.952279 run osmo-stp_10.42.42.5(pid=21492): stdout: | (launched: 2022-12-09_22:05:49.272672) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:51.082002 run osmo-stp_10.42.42.5(pid=21492): stderr: | 20221209220549466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220549466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220549466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220549467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220549467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220549467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220549467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:51.236748 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21492): Process ended prematurely: osmo-stp_10.42.42.5(pid=21492) [trial-2365↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21492)] [trial-2365↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 22:05:51.246451 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:05:51.274838 run osmo-hlr_10.42.42.2(pid=21489): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21489)] 22:05:51.325496 run osmo-hlr_10.42.42.2(pid=21489): stdout: | (launched: 2022-12-09_22:05:48.263623) 22:05:51.377829 run osmo-hlr_10.42.42.2(pid=21489): stderr: | 20221209220548463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220548463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220548463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220548463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220548463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220548464 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220548476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220548484 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220548484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220548484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:05:51.450288 run osmo-msc_10.42.42.6(pid=21495): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21495)] 22:05:51.500590 run osmo-msc_10.42.42.6(pid=21495): stdout: | (launched: 2022-12-09_22:05:50.299280) 22:05:51.552375 run osmo-msc_10.42.42.6(pid=21495): stderr: | 20221209220550623 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220550623 DLGLOBAL DEBUG validating counter group 0x7f66ad8a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220550623 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220550623 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220550623 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220550623 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220550625 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220550625 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220550626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220550626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:05:51.604470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21488): Terminating (SIGTERM) 22:05:51.646362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21491): Terminating (SIGTERM) 22:05:51.688342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21494): Terminating (SIGTERM) 22:05:51.730678 --- ParallelTerminationStrategy: PID 21488 died... 22:05:51.750867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21488): Terminated: ok {rc=0} 22:05:51.797480 --- ParallelTerminationStrategy: PID 21491 died... 22:05:51.817237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21491): Terminated: ok {rc=0} 22:05:51.863517 --- ParallelTerminationStrategy: PID 21494 died... 22:05:51.883294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21494): Terminated: ok {rc=0} 22:05:51.971281 bus /sierra_3: Setting Powered False 22:05:53.069905 bus /sierra_3: Setting Powered False 22:05:54.184554 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:05:55.428294 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:05:55.434305 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:05:55.468124 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 22:05:55.494724 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 22:05:55.547278 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:05:55.580205 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 22:05:55.606600 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 22:05:56.157794 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 22:05:56.206156 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:56.217297 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:05:56.268838 tst mo_mt_call.py: using LAC 23973 22:05:56.389148 tst mo_mt_call.py: using RAC 3 22:05:56.508567 tst mo_mt_call.py: using CellId 23973 22:05:56.638638 tst mo_mt_call.py: using BVCI 23974 22:05:56.757899 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:56.769764 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:56.781468 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:56.793894 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:56.806212 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:56.818405 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:05:56.937117 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:05:57.056656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:57.556665 run create_hlr_db(pid=21500): Launched 22:05:57.688141 bus /sierra_2: Setting Powered False 22:05:58.752656 run create_hlr_db(pid=21500): Terminated: ok {rc=0} 22:05:59.183441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21502): Launched 22:05:59.485334 run osmo-hlr_10.42.42.2(pid=21503): Launched 22:05:59.601991 run osmo-stp_10.42.42.5: Starting osmo-stp 22:06:00.123616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21505): Launched 22:06:00.425761 run osmo-stp_10.42.42.5(pid=21506): Launched 22:06:00.543364 run osmo-msc_10.42.42.6: Starting osmo-msc 22:06:01.116887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21508): Launched 22:06:01.441819 run osmo-msc_10.42.42.6(pid=21509): Launched 22:06:01.710305 run osmo-stp_10.42.42.5(pid=21506): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21506)] 22:06:02.004896 run osmo-stp_10.42.42.5(pid=21506): stdout: | (launched: 2022-12-09_22:06:00.371014) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:02.297979 run osmo-stp_10.42.42.5(pid=21506): stderr: | 20221209220600541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220600541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220600541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220600542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220600542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220600542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220600542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:02.426436 run osmo-stp_10.42.42.5(pid=21506): stdout: | (launched: 2022-12-09_22:06:00.371014) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:02.548362 run osmo-stp_10.42.42.5(pid=21506): stderr: | 20221209220600541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220600541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220600541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220600542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220600542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220600542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220600542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:02.694067 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21506): Process ended prematurely: osmo-stp_10.42.42.5(pid=21506) [trial-2365↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21506)] [trial-2365↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 22:06:02.703246 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 22:06:02.730797 run osmo-hlr_10.42.42.2(pid=21503): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21503)] 22:06:02.779112 run osmo-hlr_10.42.42.2(pid=21503): stdout: | (launched: 2022-12-09_22:05:59.430693) 22:06:02.829443 run osmo-hlr_10.42.42.2(pid=21503): stderr: | 20221209220559608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220559608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220559608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220559608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220559608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220559608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220559621 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220559632 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220559632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220559632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:06:02.899149 run osmo-msc_10.42.42.6(pid=21509): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21509)] 22:06:02.947027 run osmo-msc_10.42.42.6(pid=21509): stdout: | (launched: 2022-12-09_22:06:01.380432) 22:06:02.997196 run osmo-msc_10.42.42.6(pid=21509): stderr: | 20221209220602093 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220602094 DLGLOBAL DEBUG validating counter group 0x7f5190fe2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220602094 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220602094 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220602094 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220602094 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220602096 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220602098 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220602098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220602098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:06:03.047740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21502): Terminating (SIGTERM) 22:06:03.087893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21505): Terminating (SIGTERM) 22:06:03.128286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21508): Terminating (SIGTERM) 22:06:03.168878 --- ParallelTerminationStrategy: PID 21502 died... 22:06:03.188177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21502): Terminated: ok {rc=0} 22:06:03.233357 --- ParallelTerminationStrategy: PID 21505 died... 22:06:03.252131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21505): Terminated: ok {rc=0} 22:06:03.296892 --- ParallelTerminationStrategy: PID 21508 died... 22:06:03.316066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21508): Terminated: ok {rc=0} 22:06:03.403881 bus /sierra_3: Setting Powered False 22:06:04.503872 bus /sierra_3: Setting Powered False 22:06:05.620540 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 22:06:06.767598 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:06.779787 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:06:06.832659 tst mo_mt_call_osmux.py: using LAC 23974 22:06:06.952594 tst mo_mt_call_osmux.py: using RAC 4 22:06:07.070911 tst mo_mt_call_osmux.py: using CellId 23974 22:06:07.190930 tst mo_mt_call_osmux.py: using BVCI 23975 22:06:07.300199 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:07.311681 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:07.322798 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:07.334321 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:07.345901 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:07.357430 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:06:07.476495 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:06:07.603521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:06:08.102341 run create_hlr_db(pid=21511): Launched 22:06:08.233841 bus /sierra_2: Setting Powered False 22:06:09.297931 run create_hlr_db(pid=21511): Terminated: ok {rc=0} 22:06:09.730650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21513): Launched 22:06:10.031961 run osmo-hlr_10.42.42.2(pid=21514): Launched 22:06:10.147353 run osmo-stp_10.42.42.5: Starting osmo-stp 22:06:10.677894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21516): Launched 22:06:10.978332 run osmo-stp_10.42.42.5(pid=21517): Launched 22:06:11.093428 run osmo-msc_10.42.42.6: Starting osmo-msc 22:06:11.636933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21519): Launched 22:06:11.939123 run osmo-msc_10.42.42.6(pid=21520): Launched 22:06:12.108154 run osmo-stp_10.42.42.5(pid=21517): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21517)] 22:06:12.236380 run osmo-stp_10.42.42.5(pid=21517): stdout: | (launched: 2022-12-09_22:06:10.923867) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:12.365130 run osmo-stp_10.42.42.5(pid=21517): stderr: | 20221209220611094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220611095 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220611095 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220611095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220611096 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220611096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220611096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:12.490817 run osmo-stp_10.42.42.5(pid=21517): stdout: | (launched: 2022-12-09_22:06:10.923867) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:12.611333 run osmo-stp_10.42.42.5(pid=21517): stderr: | 20221209220611094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220611095 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220611095 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220611095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220611096 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220611096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220611096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:12.754782 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21517): Process ended prematurely: osmo-stp_10.42.42.5(pid=21517) [trial-2365↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21517)] [trial-2365↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 22:06:12.763861 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:06:12.790572 run osmo-hlr_10.42.42.2(pid=21514): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21514)] 22:06:12.838577 run osmo-hlr_10.42.42.2(pid=21514): stdout: | (launched: 2022-12-09_22:06:09.977753) 22:06:12.887985 run osmo-hlr_10.42.42.2(pid=21514): stderr: | 20221209220610155 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220610155 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220610155 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220610155 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220610155 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220610155 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220610168 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220610178 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220610179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220610179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:06:12.956861 run osmo-msc_10.42.42.6(pid=21520): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21520)] 22:06:13.004214 run osmo-msc_10.42.42.6(pid=21520): stdout: | (launched: 2022-12-09_22:06:11.884354) 22:06:13.053257 run osmo-msc_10.42.42.6(pid=21520): stderr: | 20221209220612156 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220612156 DLGLOBAL DEBUG validating counter group 0x7eff09442c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220612156 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220612156 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220612156 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220612157 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220612159 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220612159 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220612160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220612160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:06:13.102625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21513): Terminating (SIGTERM) 22:06:13.141929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21516): Terminating (SIGTERM) 22:06:13.181199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21519): Terminating (SIGTERM) 22:06:13.220699 --- ParallelTerminationStrategy: PID 21513 died... 22:06:13.239804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21513): Terminated: ok {rc=0} 22:06:13.283993 --- ParallelTerminationStrategy: PID 21516 died... 22:06:13.302459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21516): Terminated: ok {rc=0} 22:06:13.346326 --- ParallelTerminationStrategy: PID 21519 died... 22:06:13.364783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21519): Terminated: ok {rc=0} 22:06:13.448219 bus /sierra_3: Setting Powered False 22:06:14.546922 bus /sierra_3: Setting Powered False 22:06:15.662872 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 emergency:trx-b200 --------------------------------------------------------------------- 22:06:16.945183 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:06:16.953036 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 22:06:16.989576 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 22:06:17.018266 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 22:06:17.103412 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 22:06:17.139513 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 22:06:17.168365 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 22:06:17.747694 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2365 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 22:06:17.753662 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:17.764628 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 22:06:17.817418 tst emergency_mo_mt_call.py: using LAC 23975 22:06:17.935462 tst emergency_mo_mt_call.py: using RAC 5 22:06:18.061693 tst emergency_mo_mt_call.py: using CellId 23975 22:06:18.180392 tst emergency_mo_mt_call.py: using BVCI 23976 22:06:18.297192 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:18.308417 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:18.319276 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:18.330345 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:18.341523 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:18.352397 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:18.465961 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:18.582938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:06:19.077105 run create_hlr_db(pid=21525): Launched 22:06:19.207368 bus /sierra_2: Setting Powered False 22:06:20.270743 run create_hlr_db(pid=21525): Terminated: ok {rc=0} 22:06:20.696420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21527): Launched 22:06:20.992615 run osmo-hlr_10.42.42.2(pid=21528): Launched 22:06:21.106125 run osmo-stp_10.42.42.5: Starting osmo-stp 22:06:21.633914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21530): Launched 22:06:21.937811 run osmo-stp_10.42.42.5(pid=21531): Launched 22:06:22.063433 tst emergency_mo_mt_call.py: using MSISDN 7401 22:06:22.214530 run osmo-msc_10.42.42.6: Starting osmo-msc 22:06:22.747191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21533): Launched 22:06:23.043098 run osmo-msc_10.42.42.6(pid=21534): Launched 22:06:23.208192 run osmo-stp_10.42.42.5(pid=21531): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21531)] 22:06:23.332745 run osmo-stp_10.42.42.5(pid=21531): stdout: | (launched: 2022-12-09_22:06:21.875932) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:23.458407 run osmo-stp_10.42.42.5(pid=21531): stderr: | 20221209220622056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220622057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220622057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220622057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220622058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220622058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220622058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:23.582173 run osmo-stp_10.42.42.5(pid=21531): stdout: | (launched: 2022-12-09_22:06:21.875932) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:23.699912 run osmo-stp_10.42.42.5(pid=21531): stderr: | 20221209220622056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220622057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220622057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220622057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220622058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220622058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220622058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:23.840924 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=21531): Process ended prematurely: osmo-stp_10.42.42.5(pid=21531) [trial-2365↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21531)] [trial-2365↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 22:06:23.849447 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 22:06:23.876001 run osmo-hlr_10.42.42.2(pid=21528): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21528)] 22:06:23.923695 run osmo-hlr_10.42.42.2(pid=21528): stdout: | (launched: 2022-12-09_22:06:20.938534) 22:06:23.973267 run osmo-hlr_10.42.42.2(pid=21528): stderr: | 20221209220621112 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220621112 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220621112 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220621112 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220621112 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220621112 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220621125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220621136 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220621136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220621137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:06:24.042065 run osmo-msc_10.42.42.6(pid=21534): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21534)] 22:06:24.089737 run osmo-msc_10.42.42.6(pid=21534): stdout: | (launched: 2022-12-09_22:06:22.989628) 22:06:24.139251 run osmo-msc_10.42.42.6(pid=21534): stderr: | 20221209220623262 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220623262 DLGLOBAL DEBUG validating counter group 0x7f1371150c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220623263 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220623263 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220623263 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220623263 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220623265 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220623265 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220623265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220623266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:06:24.188865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21527): Terminating (SIGTERM) 22:06:24.228207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21530): Terminating (SIGTERM) 22:06:24.267869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21533): Terminating (SIGTERM) 22:06:24.307627 --- ParallelTerminationStrategy: PID 21527 died... 22:06:24.326703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21527): Terminated: ok {rc=0} 22:06:24.371479 --- ParallelTerminationStrategy: PID 21530 died... 22:06:24.390100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21530): Terminated: ok {rc=0} 22:06:24.434351 --- ParallelTerminationStrategy: PID 21533 died... 22:06:24.453043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21533): Terminated: ok {rc=0} 22:06:24.539916 bus /sierra_3: Setting Powered False 22:06:25.639976 bus /sierra_3: Setting Powered False 22:06:26.756360 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 22:06:27.844163 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:27.855657 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 22:06:27.908099 tst emergency_preemptive_call.py: using LAC 23976 22:06:28.033345 tst emergency_preemptive_call.py: using RAC 6 22:06:28.157165 tst emergency_preemptive_call.py: using CellId 23976 22:06:28.280401 tst emergency_preemptive_call.py: using BVCI 23977 22:06:28.394579 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:28.405660 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:28.416522 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:28.427420 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:28.438341 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:28.449254 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:28.565032 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:28.685926 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:28.801117 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:28.916267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:06:29.375034 run create_hlr_db(pid=21536): Launched 22:06:29.488601 bus /sierra_2: Setting Powered False 22:06:30.548447 run create_hlr_db(pid=21536): Terminated: ok {rc=0} 22:06:31.006438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21538): Launched 22:06:31.357986 run osmo-hlr_10.42.42.2(pid=21539): Launched 22:06:31.566060 run osmo-stp_10.42.42.5: Starting osmo-stp 22:06:32.334342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21541): Launched 22:06:32.651847 run osmo-stp_10.42.42.5(pid=21542): Launched 22:06:32.782204 tst emergency_preemptive_call.py: using MSISDN 7402 22:06:32.943578 run osmo-msc_10.42.42.6: Starting osmo-msc 22:06:33.508754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21544): Launched 22:06:33.823599 run osmo-msc_10.42.42.6(pid=21545): Launched 22:06:34.001385 run osmo-stp_10.42.42.5(pid=21542): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21542)] 22:06:34.135358 run osmo-stp_10.42.42.5(pid=21542): stdout: | (launched: 2022-12-09_22:06:32.594762) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:34.269912 run osmo-stp_10.42.42.5(pid=21542): stderr: | 20221209220632788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220632788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220632788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220632789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220632789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220632789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220632789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:34.403327 run osmo-stp_10.42.42.5(pid=21542): stdout: | (launched: 2022-12-09_22:06:32.594762) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:34.528844 run osmo-stp_10.42.42.5(pid=21542): stderr: | 20221209220632788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220632788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220632788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220632789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220632789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220632789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220632789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:34.679337 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=21542): Process ended prematurely: osmo-stp_10.42.42.5(pid=21542) [trial-2365↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21542)] [trial-2365↪emergency:trx-b200↪emergency_preemptive_call.py:32] 22:06:34.688284 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 22:06:34.715763 run osmo-hlr_10.42.42.2(pid=21539): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21539)] 22:06:34.766394 run osmo-hlr_10.42.42.2(pid=21539): stdout: | (launched: 2022-12-09_22:06:31.297337) 22:06:34.818850 run osmo-hlr_10.42.42.2(pid=21539): stderr: | 20221209220631547 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220631547 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220631547 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220631547 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220631547 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220631547 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220631563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220631578 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220631580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220631580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:06:34.891609 run osmo-msc_10.42.42.6(pid=21545): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21545)] 22:06:34.942130 run osmo-msc_10.42.42.6(pid=21545): stdout: | (launched: 2022-12-09_22:06:33.766601) 22:06:34.994244 run osmo-msc_10.42.42.6(pid=21545): stderr: | 20221209220634086 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209220634087 DLGLOBAL DEBUG validating counter group 0x7f15768e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209220634087 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209220634087 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209220634087 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209220634087 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209220634089 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209220634089 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209220634090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209220634090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:06:35.046433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21538): Terminating (SIGTERM) 22:06:35.088374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21541): Terminating (SIGTERM) 22:06:35.130467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21544): Terminating (SIGTERM) 22:06:35.172810 --- ParallelTerminationStrategy: PID 21538 died... 22:06:35.192876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21538): Terminated: ok {rc=0} 22:06:35.239507 --- ParallelTerminationStrategy: PID 21541 died... 22:06:35.259085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21541): Terminated: ok {rc=0} 22:06:35.305287 --- ParallelTerminationStrategy: PID 21544 died... 22:06:35.325460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21544): Terminated: ok {rc=0} 22:06:35.413916 bus /sierra_9: Setting Powered False 22:06:36.514321 bus /sierra_9: Setting Powered False 22:06:37.632329 bus /sierra_8: Setting Powered False 22:06:38.731712 bus /sierra_8: Setting Powered False 22:06:39.849382 bus /sierra_3: Setting Powered False 22:06:40.949531 bus /sierra_3: Setting Powered False 22:06:42.066403 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-b200 --------------------------------------------------------------------- 22:06:43.350287 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:06:43.354884 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 22:06:43.388396 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 22:06:43.427460 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 22:06:43.516459 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 22:06:43.550281 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 22:06:43.589557 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 22:06:44.181806 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 22:06:44.234156 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:44.245198 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:06:44.295186 tst cs_paging_gprs_active.py: using LAC 23977 22:06:44.423789 tst cs_paging_gprs_active.py: using RAC 7 22:06:44.552203 tst cs_paging_gprs_active.py: using CellId 23977 22:06:44.681087 tst cs_paging_gprs_active.py: using BVCI 23978 22:06:44.799347 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:44.810378 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:44.821234 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:44.831997 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:44.842919 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:44.853660 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:44.864727 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:44.875604 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:44.886582 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:06:45.002813 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:06:45.122663 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:06:45.341023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:06:45.665168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21553): Launched 22:06:45.954160 run iperf3-srv_10.42.42.10(pid=21554): Launched 22:06:46.085903 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:06:46.307466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:06:46.640289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21555): Launched 22:06:46.949450 run iperf3-srv_10.42.42.10(pid=21556): Launched 22:06:47.117251 tst cs_paging_gprs_active.py:38: start network... 22:06:47.334725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:06:47.836547 run create_hlr_db(pid=21557): Launched 22:06:47.969339 bus /sierra_2: Setting Powered False 22:06:49.033139 run create_hlr_db(pid=21557): Terminated: ok {rc=0} 22:06:49.464832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21559): Launched 22:06:49.768425 run osmo-hlr_10.42.42.2(pid=21560): Launched 22:06:49.884867 run osmo-stp_10.42.42.5: Starting osmo-stp 22:06:50.424838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21562): Launched 22:06:50.728479 run osmo-stp_10.42.42.5(pid=21563): Launched 22:06:50.844511 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:06:51.366733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21565): Launched 22:06:51.483567 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:06:51.740874 run patchelf(pid=21566): Launched 22:06:51.922953 run osmo-stp_10.42.42.5(pid=21563): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21563)] 22:06:52.061311 run osmo-stp_10.42.42.5(pid=21563): stdout: | (launched: 2022-12-09_22:06:50.673504) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:52.199972 run osmo-stp_10.42.42.5(pid=21563): stderr: | 20221209220650844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220650845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220650845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220650845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220650846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220650846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220650846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:52.338680 run osmo-stp_10.42.42.5(pid=21563): stdout: | (launched: 2022-12-09_22:06:50.673504) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:52.471638 run osmo-stp_10.42.42.5(pid=21563): stderr: | 20221209220650844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220650845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220650845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220650845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220650846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220650846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220650846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:52.629020 run patchelf(pid=21566): Terminating (SIGINT) 22:06:52.811372 run patchelf(pid=21566): Terminated: ok {rc=0} 22:06:52.943814 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21563): Process ended prematurely: osmo-stp_10.42.42.5(pid=21563) [trial-2365↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21563)] [trial-2365↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 22:06:52.954180 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 22:06:52.982868 run osmo-hlr_10.42.42.2(pid=21560): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21560)] 22:06:53.032823 run osmo-hlr_10.42.42.2(pid=21560): stdout: | (launched: 2022-12-09_22:06:49.713536) 22:06:53.084662 run osmo-hlr_10.42.42.2(pid=21560): stderr: | 20221209220649889 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220649889 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220649889 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220649889 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220649889 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220649889 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220649905 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220649916 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220649916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220649916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:06:53.137265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21553): Terminating (SIGTERM) 22:06:53.179143 run iperf3-srv_10.42.42.10(pid=21554): Terminating (SIGTERM) 22:06:53.222573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21555): Terminating (SIGTERM) 22:06:53.264769 run iperf3-srv_10.42.42.10(pid=21556): Terminating (SIGTERM) 22:06:53.306357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21559): Terminating (SIGTERM) 22:06:53.348353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21562): Terminating (SIGTERM) 22:06:53.390111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21565): Terminating (SIGTERM) 22:06:53.432123 --- ParallelTerminationStrategy: PID 21553 died... 22:06:53.452106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21553): Terminated: ok {rc=0} 22:06:53.498617 --- ParallelTerminationStrategy: PID 21554 died... 22:06:53.518183 run iperf3-srv_10.42.42.10(pid=21554): Terminated {rc=256} 22:06:53.563904 --- ParallelTerminationStrategy: PID 21555 died... 22:06:53.583415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21555): Terminated: ok {rc=0} 22:06:53.629361 --- ParallelTerminationStrategy: PID 21556 died... 22:06:53.648799 run iperf3-srv_10.42.42.10(pid=21556): Terminated {rc=256} 22:06:53.694696 --- ParallelTerminationStrategy: PID 21559 died... 22:06:53.714361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21559): Terminated: ok {rc=0} 22:06:53.760318 --- ParallelTerminationStrategy: PID 21562 died... 22:06:53.779870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21562): Terminated: ok {rc=0} 22:06:53.825790 --- ParallelTerminationStrategy: PID 21565 died... 22:06:53.845393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21565): Terminated: ok {rc=0} 22:06:53.933317 bus /gobi_0: Setting Powered False 22:06:55.031976 bus /gobi_0: Setting Powered False 22:06:56.149068 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200 iperf3.py ---------------------------------------------- 22:06:57.293191 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:57.304401 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:06:57.359111 tst iperf3.py: using LAC 23978 22:06:57.480856 tst iperf3.py: using RAC 8 22:06:57.600341 tst iperf3.py: using CellId 23978 22:06:57.727797 tst iperf3.py: using BVCI 23979 22:06:57.846746 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:57.858050 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:57.868908 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:57.880446 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:57.891847 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:57.903247 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:57.914696 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:57.926058 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:57.937770 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:06:58.059365 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:06:58.278814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:06:58.603166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21567): Launched 22:06:58.884499 run iperf3-srv_10.42.42.10(pid=21568): Launched 22:06:59.007446 tst iperf3.py:8: start network... 22:06:59.225603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:06:59.724192 run create_hlr_db(pid=21569): Launched 22:06:59.854417 bus /gobi_6: Setting Powered False 22:07:00.931826 run create_hlr_db(pid=21569): Terminated: ok {rc=0} 22:07:01.387930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21571): Launched 22:07:01.727266 run osmo-hlr_10.42.42.2(pid=21572): Launched 22:07:01.971209 run osmo-stp_10.42.42.5: Starting osmo-stp 22:07:02.610586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21574): Launched 22:07:02.913780 run osmo-stp_10.42.42.5(pid=21575): Launched 22:07:03.029713 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:07:03.550604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21577): Launched 22:07:03.666855 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:07:03.922349 run patchelf(pid=21578): Launched 22:07:04.091278 run osmo-stp_10.42.42.5(pid=21575): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21575)] 22:07:04.219998 run osmo-stp_10.42.42.5(pid=21575): stdout: | (launched: 2022-12-09_22:07:02.859032) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:04.350204 run osmo-stp_10.42.42.5(pid=21575): stderr: | 20221209220703031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220703031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220703031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220703032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220703032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220703032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220703032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:04.480302 run osmo-stp_10.42.42.5(pid=21575): stdout: | (launched: 2022-12-09_22:07:02.859032) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:04.604438 run osmo-stp_10.42.42.5(pid=21575): stderr: | 20221209220703031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220703031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220703031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220703032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220703032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220703032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220703032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:04.751134 run patchelf(pid=21578): Terminating (SIGINT) 22:07:04.923245 run patchelf(pid=21578): Terminated: ok {rc=0} 22:07:05.047589 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21575): Process ended prematurely: osmo-stp_10.42.42.5(pid=21575) [trial-2365↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21575)] [trial-2365↪gprs:trx-b200↪iperf3.py:8] 22:07:05.057086 tst iperf3.py:8: Test FAILED (7.8 sec) 22:07:05.084576 run osmo-hlr_10.42.42.2(pid=21572): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21572)] 22:07:05.132558 run osmo-hlr_10.42.42.2(pid=21572): stdout: | (launched: 2022-12-09_22:07:01.664484) 22:07:05.182313 run osmo-hlr_10.42.42.2(pid=21572): stderr: | 20221209220701974 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220701975 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220701975 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220701975 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220701975 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220701975 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220701991 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220702008 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220702008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220702008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:07:05.232083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21567): Terminating (SIGTERM) 22:07:05.272021 run iperf3-srv_10.42.42.10(pid=21568): Terminating (SIGTERM) 22:07:05.311648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21571): Terminating (SIGTERM) 22:07:05.351373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21574): Terminating (SIGTERM) 22:07:05.390956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21577): Terminating (SIGTERM) 22:07:05.430925 --- ParallelTerminationStrategy: PID 21567 died... 22:07:05.450060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21567): Terminated: ok {rc=0} 22:07:05.494432 --- ParallelTerminationStrategy: PID 21568 died... 22:07:05.513194 run iperf3-srv_10.42.42.10(pid=21568): Terminated {rc=256} 22:07:05.557331 --- ParallelTerminationStrategy: PID 21571 died... 22:07:05.575807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21571): Terminated: ok {rc=0} 22:07:05.619996 --- ParallelTerminationStrategy: PID 21574 died... 22:07:05.638595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21574): Terminated: ok {rc=0} 22:07:05.682831 --- ParallelTerminationStrategy: PID 21577 died... 22:07:05.701231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21577): Terminated: ok {rc=0} 22:07:05.785437 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 22:07:06.929440 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:06.940488 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:07:06.989908 tst iperf3m4.py: using LAC 23979 22:07:07.109397 tst iperf3m4.py: using RAC 9 22:07:07.227385 tst iperf3m4.py: using CellId 23979 22:07:07.345064 tst iperf3m4.py: using BVCI 23980 22:07:07.463662 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.475064 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.486283 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.497992 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.509611 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.521222 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.533203 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.544844 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.556348 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:07.673690 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:07.796455 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:07.917469 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:08.031556 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:07:08.235315 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:08.539408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21579): Launched 22:07:08.805020 run iperf3-srv_10.42.42.10(pid=21580): Launched 22:07:08.919473 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:07:09.122849 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:09.427347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21581): Launched 22:07:09.692212 run iperf3-srv_10.42.42.10(pid=21582): Launched 22:07:09.806911 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:07:10.010031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:10.314215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21583): Launched 22:07:10.578359 run iperf3-srv_10.42.42.10(pid=21584): Launched 22:07:10.692290 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:07:10.894775 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:11.199379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21585): Launched 22:07:11.463808 run iperf3-srv_10.42.42.10(pid=21586): Launched 22:07:11.578095 tst iperf3m4.py:8: start network... 22:07:11.781225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:07:12.249208 run create_hlr_db(pid=21587): Launched 22:07:12.382342 bus /gobi_6: Setting Powered False 22:07:13.446679 run create_hlr_db(pid=21587): Terminated: ok {rc=0} 22:07:13.896271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21589): Launched 22:07:14.220090 run osmo-hlr_10.42.42.2(pid=21590): Launched 22:07:14.343256 run osmo-stp_10.42.42.5: Starting osmo-stp 22:07:14.898659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21592): Launched 22:07:15.223389 run osmo-stp_10.42.42.5(pid=21593): Launched 22:07:15.346514 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:07:15.910548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21595): Launched 22:07:16.049984 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:07:16.332597 run patchelf(pid=21596): Launched 22:07:16.527954 run osmo-stp_10.42.42.5(pid=21593): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21593)] 22:07:16.669264 run osmo-stp_10.42.42.5(pid=21593): stdout: | (launched: 2022-12-09_22:07:15.164758) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:16.811136 run osmo-stp_10.42.42.5(pid=21593): stderr: | 20221209220715357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220715357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220715357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220715357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220715358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220715358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220715358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:16.953625 run osmo-stp_10.42.42.5(pid=21593): stdout: | (launched: 2022-12-09_22:07:15.164758) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:17.089110 run osmo-stp_10.42.42.5(pid=21593): stderr: | 20221209220715357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220715357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220715357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220715357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220715358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220715358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220715358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:17.250366 run patchelf(pid=21596): Terminating (SIGINT) 22:07:17.434157 run patchelf(pid=21596): Terminated: ok {rc=0} 22:07:17.566488 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21593): Process ended prematurely: osmo-stp_10.42.42.5(pid=21593) [trial-2365↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21593)] [trial-2365↪gprs:trx-b200↪iperf3m4.py:8] 22:07:17.576719 tst iperf3m4.py:8: Test FAILED (10.7 sec) 22:07:17.606118 run osmo-hlr_10.42.42.2(pid=21590): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21590)] 22:07:17.656279 run osmo-hlr_10.42.42.2(pid=21590): stdout: | (launched: 2022-12-09_22:07:14.161766) 22:07:17.708400 run osmo-hlr_10.42.42.2(pid=21590): stderr: | 20221209220714363 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220714363 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220714363 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220714363 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220714363 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220714363 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220714383 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220714393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220714394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220714394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:07:17.760563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21579): Terminating (SIGTERM) 22:07:17.802364 run iperf3-srv_10.42.42.10(pid=21580): Terminating (SIGTERM) 22:07:17.844081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21581): Terminating (SIGTERM) 22:07:17.886088 run iperf3-srv_10.42.42.10(pid=21582): Terminating (SIGTERM) 22:07:17.927928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21583): Terminating (SIGTERM) 22:07:17.970301 run iperf3-srv_10.42.42.10(pid=21584): Terminating (SIGTERM) 22:07:18.012076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21585): Terminating (SIGTERM) 22:07:18.053942 run iperf3-srv_10.42.42.10(pid=21586): Terminating (SIGTERM) 22:07:18.095713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21589): Terminating (SIGTERM) 22:07:18.137641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21592): Terminating (SIGTERM) 22:07:18.179655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21595): Terminating (SIGTERM) 22:07:18.221845 --- ParallelTerminationStrategy: PID 21579 died... 22:07:18.241943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21579): Terminated: ok {rc=0} 22:07:18.288317 --- ParallelTerminationStrategy: PID 21580 died... 22:07:18.307832 run iperf3-srv_10.42.42.10(pid=21580): Terminated {rc=256} 22:07:18.354316 --- ParallelTerminationStrategy: PID 21581 died... 22:07:18.373970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21581): Terminated: ok {rc=0} 22:07:18.420506 --- ParallelTerminationStrategy: PID 21582 died... 22:07:18.440135 run iperf3-srv_10.42.42.10(pid=21582): Terminated {rc=256} 22:07:18.486282 --- ParallelTerminationStrategy: PID 21583 died... 22:07:18.505870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21583): Terminated: ok {rc=0} 22:07:18.551923 --- ParallelTerminationStrategy: PID 21584 died... 22:07:18.571495 run iperf3-srv_10.42.42.10(pid=21584): Terminated {rc=256} 22:07:18.617679 --- ParallelTerminationStrategy: PID 21585 died... 22:07:18.637323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21585): Terminated: ok {rc=0} 22:07:18.683313 --- ParallelTerminationStrategy: PID 21586 died... 22:07:18.702812 run iperf3-srv_10.42.42.10(pid=21586): Terminated {rc=256} 22:07:18.749068 --- ParallelTerminationStrategy: PID 21589 died... 22:07:18.768792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21589): Terminated: ok {rc=0} 22:07:18.814765 --- ParallelTerminationStrategy: PID 21592 died... 22:07:18.834506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21592): Terminated: ok {rc=0} 22:07:18.880760 --- ParallelTerminationStrategy: PID 21595 died... 22:07:18.900452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21595): Terminated: ok {rc=0} 22:07:18.988418 bus /gobi_4: Setting Powered False 22:07:20.089546 bus /gobi_4: Setting Powered False 22:07:21.206351 bus /gobi_1: Setting Powered False 22:07:22.305791 bus /gobi_1: Setting Powered False 22:07:23.424214 bus /gobi_0: Setting Powered False 22:07:24.523141 bus /gobi_0: Setting Powered False 22:07:25.639187 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200 ping.py ---------------------------------------------- 22:07:26.742421 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:26.753730 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:07:26.803369 tst ping.py: using LAC 23980 22:07:26.920733 tst ping.py: using RAC 10 22:07:27.040069 tst ping.py: using CellId 23980 22:07:27.156712 tst ping.py: using BVCI 23981 22:07:27.264474 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:27.275065 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:27.285571 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:27.296230 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:27.306849 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:27.317556 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:27.328198 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:27.338842 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:27.459690 tst ping.py:19: start network... 22:07:27.674350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:07:28.163934 run create_hlr_db(pid=21597): Launched 22:07:28.292554 bus /gobi_6: Setting Powered False 22:07:29.355921 run create_hlr_db(pid=21597): Terminated: ok {rc=0} 22:07:29.781522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21599): Launched 22:07:30.081965 run osmo-hlr_10.42.42.2(pid=21600): Launched 22:07:30.195329 run osmo-stp_10.42.42.5: Starting osmo-stp 22:07:30.708147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21602): Launched 22:07:31.054693 run osmo-stp_10.42.42.5(pid=21603): Launched 22:07:31.304790 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:07:31.919419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21605): Launched 22:07:32.055233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:07:32.327731 run patchelf(pid=21606): Launched 22:07:32.505232 run osmo-stp_10.42.42.5(pid=21603): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21603)] 22:07:32.640474 run osmo-stp_10.42.42.5(pid=21603): stdout: | (launched: 2022-12-09_22:07:30.991577) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:32.777085 run osmo-stp_10.42.42.5(pid=21603): stderr: | 20221209220731279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220731279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220731280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220731280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220731280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220731281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220731281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:32.913678 run osmo-stp_10.42.42.5(pid=21603): stdout: | (launched: 2022-12-09_22:07:30.991577) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:33.044399 run osmo-stp_10.42.42.5(pid=21603): stderr: | 20221209220731279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220731279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220731280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220731280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220731280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220731281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220731281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:33.198814 run patchelf(pid=21606): Terminating (SIGINT) 22:07:33.379273 run patchelf(pid=21606): Terminated: ok {rc=0} 22:07:33.508599 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21603): Process ended prematurely: osmo-stp_10.42.42.5(pid=21603) [trial-2365↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21603)] [trial-2365↪gprs:trx-b200↪ping.py:22] 22:07:33.517992 tst ping.py:22: Test FAILED (6.8 sec) 22:07:33.545948 run osmo-hlr_10.42.42.2(pid=21600): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21600)] 22:07:33.596010 run osmo-hlr_10.42.42.2(pid=21600): stdout: | (launched: 2022-12-09_22:07:30.027578) 22:07:33.647559 run osmo-hlr_10.42.42.2(pid=21600): stderr: | 20221209220730202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220730202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220730202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220730202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220730202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220730202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220730267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220730277 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220730277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220730277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:07:33.699504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21599): Terminating (SIGTERM) 22:07:33.741224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21602): Terminating (SIGTERM) 22:07:33.783107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21605): Terminating (SIGTERM) 22:07:33.825165 --- ParallelTerminationStrategy: PID 21599 died... 22:07:33.845094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21599): Terminated: ok {rc=0} 22:07:33.891513 --- ParallelTerminationStrategy: PID 21602 died... 22:07:33.911351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21602): Terminated: ok {rc=0} 22:07:33.957713 --- ParallelTerminationStrategy: PID 21605 died... 22:07:33.977155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21605): Terminated: ok {rc=0} 22:07:34.064663 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 22:07:35.151872 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:35.162958 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:07:35.213637 tst ping_idle_ping.py: using LAC 23981 22:07:35.340840 tst ping_idle_ping.py: using RAC 11 22:07:35.465094 tst ping_idle_ping.py: using CellId 23981 22:07:35.590338 tst ping_idle_ping.py: using BVCI 23982 22:07:35.706738 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:35.717813 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:35.728734 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:35.739644 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:35.750448 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:35.761355 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:35.772258 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:35.783124 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:35.901916 tst ping_idle_ping.py:24: start network... 22:07:36.115956 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:07:36.609031 run create_hlr_db(pid=21608): Launched 22:07:36.737843 bus /gobi_6: Setting Powered False 22:07:37.798732 run create_hlr_db(pid=21608): Terminated: ok {rc=0} 22:07:38.223989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21610): Launched 22:07:38.522521 run osmo-hlr_10.42.42.2(pid=21611): Launched 22:07:38.637198 run osmo-stp_10.42.42.5: Starting osmo-stp 22:07:39.163946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21613): Launched 22:07:39.462724 run osmo-stp_10.42.42.5(pid=21614): Launched 22:07:39.577954 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:07:40.092481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21616): Launched 22:07:40.207297 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:07:40.459120 run patchelf(pid=21617): Launched 22:07:40.625943 run osmo-stp_10.42.42.5(pid=21614): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21614)] 22:07:40.752677 run osmo-stp_10.42.42.5(pid=21614): stdout: | (launched: 2022-12-09_22:07:39.408684) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:40.881304 run osmo-stp_10.42.42.5(pid=21614): stderr: | 20221209220739576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220739576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220739577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220739577 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220739579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220739579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220739580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:41.010059 run osmo-stp_10.42.42.5(pid=21614): stdout: | (launched: 2022-12-09_22:07:39.408684) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:41.132260 run osmo-stp_10.42.42.5(pid=21614): stderr: | 20221209220739576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220739576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220739577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220739577 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220739579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220739579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220739580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:41.276937 run patchelf(pid=21617): Terminating (SIGINT) 22:07:41.446473 run patchelf(pid=21617): Terminated: ok {rc=0} 22:07:41.567871 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21614): Process ended prematurely: osmo-stp_10.42.42.5(pid=21614) [trial-2365↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21614)] [trial-2365↪gprs:trx-b200↪ping_idle_ping.py:27] 22:07:41.576732 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:07:41.603706 run osmo-hlr_10.42.42.2(pid=21611): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21611)] 22:07:41.651735 run osmo-hlr_10.42.42.2(pid=21611): stdout: | (launched: 2022-12-09_22:07:38.467930) 22:07:41.701220 run osmo-hlr_10.42.42.2(pid=21611): stderr: | 20221209220738642 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220738642 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220738642 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220738642 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220738642 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220738642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220738654 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220738663 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220738663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220738663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:07:41.750950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21610): Terminating (SIGTERM) 22:07:41.790554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21613): Terminating (SIGTERM) 22:07:41.830141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21616): Terminating (SIGTERM) 22:07:41.871099 --- ParallelTerminationStrategy: PID 21610 died... 22:07:41.890344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21610): Terminated: ok {rc=0} 22:07:41.934590 --- ParallelTerminationStrategy: PID 21613 died... 22:07:41.952919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21613): Terminated: ok {rc=0} 22:07:41.997293 --- ParallelTerminationStrategy: PID 21616 died... 22:07:42.015791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21616): Terminated: ok {rc=0} 22:07:42.099774 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 22:07:43.404234 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:07:43.409400 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:07:43.442522 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:07:43.480532 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:07:43.565523 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:07:43.598009 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:07:43.635653 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:07:44.236237 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:07:44.290122 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:44.301463 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:07:44.353833 tst cs_paging_gprs_active.py: using LAC 23982 22:07:44.483482 tst cs_paging_gprs_active.py: using RAC 12 22:07:44.604749 tst cs_paging_gprs_active.py: using CellId 23982 22:07:44.722591 tst cs_paging_gprs_active.py: using BVCI 23983 22:07:44.832355 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:44.843070 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:44.853622 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:44.864292 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:44.875019 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:44.885735 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:44.896502 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:44.907111 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:44.917972 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:07:45.038930 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:07:45.161252 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:07:45.380698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:45.705158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21621): Launched 22:07:46.005688 run iperf3-srv_10.42.42.10(pid=21622): Launched 22:07:46.137506 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:07:46.359445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:46.694631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21623): Launched 22:07:47.000165 run iperf3-srv_10.42.42.10(pid=21624): Launched 22:07:47.132186 tst cs_paging_gprs_active.py:38: start network... 22:07:47.351858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:07:47.852941 run create_hlr_db(pid=21625): Launched 22:07:47.987123 bus /gobi_6: Setting Powered False 22:07:49.050735 run create_hlr_db(pid=21625): Terminated: ok {rc=0} 22:07:49.500717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21627): Launched 22:07:49.823479 run osmo-hlr_10.42.42.2(pid=21628): Launched 22:07:49.947339 run osmo-stp_10.42.42.5: Starting osmo-stp 22:07:50.504021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21630): Launched 22:07:50.826679 run osmo-stp_10.42.42.5(pid=21631): Launched 22:07:50.950511 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:07:51.508631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21633): Launched 22:07:51.633065 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:07:51.905142 run patchelf(pid=21634): Launched 22:07:52.086771 run osmo-stp_10.42.42.5(pid=21631): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21631)] 22:07:52.224330 run osmo-stp_10.42.42.5(pid=21631): stdout: | (launched: 2022-12-09_22:07:50.768237) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:52.362785 run osmo-stp_10.42.42.5(pid=21631): stderr: | 20221209220750960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220750960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220750960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220750960 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220750963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220750963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220750963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:52.501464 run osmo-stp_10.42.42.5(pid=21631): stdout: | (launched: 2022-12-09_22:07:50.768237) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:52.634268 run osmo-stp_10.42.42.5(pid=21631): stderr: | 20221209220750960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220750960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220750960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220750960 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220750963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220750963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220750963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:52.791818 run patchelf(pid=21634): Terminating (SIGINT) 22:07:52.975168 run patchelf(pid=21634): Terminated: ok {rc=0} 22:07:53.107131 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21631): Process ended prematurely: osmo-stp_10.42.42.5(pid=21631) [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21631)] [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:07:53.117416 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 22:07:53.145953 run osmo-hlr_10.42.42.2(pid=21628): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21628)] 22:07:53.195999 run osmo-hlr_10.42.42.2(pid=21628): stdout: | (launched: 2022-12-09_22:07:49.765357) 22:07:53.247797 run osmo-hlr_10.42.42.2(pid=21628): stderr: | 20221209220749964 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220749964 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220749964 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220749964 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220749964 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220749964 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220749976 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220749985 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220749985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220749985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:07:53.299765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21621): Terminating (SIGTERM) 22:07:53.341615 run iperf3-srv_10.42.42.10(pid=21622): Terminating (SIGTERM) 22:07:53.383205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21623): Terminating (SIGTERM) 22:07:53.425274 run iperf3-srv_10.42.42.10(pid=21624): Terminating (SIGTERM) 22:07:53.466785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21627): Terminating (SIGTERM) 22:07:53.508288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21630): Terminating (SIGTERM) 22:07:53.550012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21633): Terminating (SIGTERM) 22:07:53.591873 --- ParallelTerminationStrategy: PID 21621 died... 22:07:53.611913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21621): Terminated: ok {rc=0} 22:07:53.657894 --- ParallelTerminationStrategy: PID 21622 died... 22:07:53.677280 run iperf3-srv_10.42.42.10(pid=21622): Terminated {rc=256} 22:07:53.722846 --- ParallelTerminationStrategy: PID 21623 died... 22:07:53.742302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21623): Terminated: ok {rc=0} 22:07:53.788091 --- ParallelTerminationStrategy: PID 21624 died... 22:07:53.807472 run iperf3-srv_10.42.42.10(pid=21624): Terminated {rc=256} 22:07:53.853259 --- ParallelTerminationStrategy: PID 21627 died... 22:07:53.872476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21627): Terminated: ok {rc=0} 22:07:53.918388 --- ParallelTerminationStrategy: PID 21630 died... 22:07:53.937800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21630): Terminated: ok {rc=0} 22:07:53.983945 --- ParallelTerminationStrategy: PID 21633 died... 22:07:54.003339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21633): Terminated: ok {rc=0} 22:07:54.091327 bus /gobi_0: Setting Powered False 22:07:55.191567 bus /gobi_0: Setting Powered False 22:07:56.307438 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:07:57.457655 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:57.469431 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:07:57.522850 tst iperf3.py: using LAC 23983 22:07:57.648910 tst iperf3.py: using RAC 13 22:07:57.774464 tst iperf3.py: using CellId 23983 22:07:57.901112 tst iperf3.py: using BVCI 23984 22:07:58.018665 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:58.029928 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:58.040917 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:58.051984 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:58.063021 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:58.073973 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:58.085080 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:58.095991 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:58.107100 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:07:58.225688 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:07:58.430341 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:58.734955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21635): Launched 22:07:58.999330 run iperf3-srv_10.42.42.10(pid=21636): Launched 22:07:59.114215 tst iperf3.py:8: start network... 22:07:59.317483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:07:59.786292 run create_hlr_db(pid=21637): Launched 22:07:59.903749 bus /gobi_6: Setting Powered False 22:08:00.970139 run create_hlr_db(pid=21637): Terminated: ok {rc=0} 22:08:01.461644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21639): Launched 22:08:01.918031 run osmo-hlr_10.42.42.2(pid=21640): Launched 22:08:02.208035 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:02.901819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21653): Launched 22:08:03.225716 run osmo-stp_10.42.42.5(pid=21654): Launched 22:08:03.463695 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:08:04.117683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21656): Launched 22:08:04.249441 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:08:04.533907 run patchelf(pid=21657): Launched 22:08:04.733175 run osmo-stp_10.42.42.5(pid=21654): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21654)] 22:08:04.874740 run osmo-stp_10.42.42.5(pid=21654): stdout: | (launched: 2022-12-09_22:08:03.157311) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:05.018179 run osmo-stp_10.42.42.5(pid=21654): stderr: | 20221209220803448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220803448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220803449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220803449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220803449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220803450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220803450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:05.160602 run osmo-stp_10.42.42.5(pid=21654): stdout: | (launched: 2022-12-09_22:08:03.157311) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:05.296675 run osmo-stp_10.42.42.5(pid=21654): stderr: | 20221209220803448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220803448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220803449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220803449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220803449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220803450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220803450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:05.458748 run patchelf(pid=21657): Terminating (SIGINT) 22:08:05.647830 run patchelf(pid=21657): Terminated: ok {rc=0} 22:08:05.782709 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21654): Process ended prematurely: osmo-stp_10.42.42.5(pid=21654) [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21654)] [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 22:08:05.794062 tst iperf3.py:8: Test FAILED (8.4 sec) 22:08:05.823549 run osmo-hlr_10.42.42.2(pid=21640): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21640)] 22:08:05.874724 run osmo-hlr_10.42.42.2(pid=21640): stdout: | (launched: 2022-12-09_22:08:01.837509) 22:08:05.927879 run osmo-hlr_10.42.42.2(pid=21640): stderr: | 20221209220802170 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220802170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220802170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220802170 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220802170 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220802170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220802189 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220802207 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220802207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220802207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:05.982978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21635): Terminating (SIGTERM) 22:08:06.026449 run iperf3-srv_10.42.42.10(pid=21636): Terminating (SIGTERM) 22:08:06.072394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21639): Terminating (SIGTERM) 22:08:06.116192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21653): Terminating (SIGTERM) 22:08:06.162505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21656): Terminating (SIGTERM) 22:08:06.208110 --- ParallelTerminationStrategy: PID 21635 died... 22:08:06.228662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21635): Terminated: ok {rc=0} 22:08:06.278501 --- ParallelTerminationStrategy: PID 21636 died... 22:08:06.299702 run iperf3-srv_10.42.42.10(pid=21636): Terminated {rc=256} 22:08:06.348206 --- ParallelTerminationStrategy: PID 21639 died... 22:08:06.369184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21639): Terminated: ok {rc=0} 22:08:06.417234 --- ParallelTerminationStrategy: PID 21653 died... 22:08:06.437535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21653): Terminated: ok {rc=0} 22:08:06.484797 --- ParallelTerminationStrategy: PID 21656 died... 22:08:06.505264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21656): Terminated: ok {rc=0} 22:08:06.597751 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:08:07.751137 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:07.763899 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:08:07.816757 tst iperf3m4.py: using LAC 23984 22:08:07.942365 tst iperf3m4.py: using RAC 14 22:08:08.070185 tst iperf3m4.py: using CellId 23984 22:08:08.198315 tst iperf3m4.py: using BVCI 23985 22:08:08.318321 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:08.330763 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:08.342949 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:08.355967 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:08.368607 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:08.381376 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:08.395196 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:08.407340 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:08.420103 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:08.547825 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:08.673386 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:08.792378 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:08.909755 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:08:09.133828 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:09.529761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21686): Launched 22:08:09.853676 run iperf3-srv_10.42.42.10(pid=21699): Launched 22:08:09.997032 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:08:10.246307 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:10.651151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21769): Launched 22:08:11.055139 run iperf3-srv_10.42.42.10(pid=21824): Launched 22:08:11.217691 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:08:11.485902 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:11.885661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21922): Launched 22:08:12.205765 run iperf3-srv_10.42.42.10(pid=21924): Launched 22:08:12.329689 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:08:12.537073 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:12.861725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21925): Launched 22:08:13.153731 run iperf3-srv_10.42.42.10(pid=21926): Launched 22:08:13.280714 tst iperf3m4.py:8: start network... 22:08:13.488093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:13.974827 run create_hlr_db(pid=21927): Launched 22:08:14.095078 bus /gobi_6: Setting Powered False 22:08:15.157664 run create_hlr_db(pid=21927): Terminated: ok {rc=0} 22:08:15.605753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21929): Launched 22:08:15.977822 run osmo-hlr_10.42.42.2(pid=21930): Launched 22:08:16.233989 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:16.977631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21932): Launched 22:08:17.391373 run osmo-stp_10.42.42.5(pid=21933): Launched 22:08:17.683067 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:08:18.442584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21935): Launched 22:08:18.584561 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:08:18.867396 run patchelf(pid=21936): Launched 22:08:19.083508 run osmo-stp_10.42.42.5(pid=21933): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21933)] 22:08:19.223745 run osmo-stp_10.42.42.5(pid=21933): stdout: | (launched: 2022-12-09_22:08:17.315122) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:19.366359 run osmo-stp_10.42.42.5(pid=21933): stderr: | 20221209220817656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220817657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220817657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220817657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220817660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220817660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220817660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:19.508913 run osmo-stp_10.42.42.5(pid=21933): stdout: | (launched: 2022-12-09_22:08:17.315122) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:19.645054 run osmo-stp_10.42.42.5(pid=21933): stderr: | 20221209220817656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220817657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220817657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220817657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220817660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220817660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220817660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:19.808065 run patchelf(pid=21936): Terminating (SIGINT) 22:08:19.996687 run patchelf(pid=21936): Terminated: ok {rc=0} 22:08:20.131796 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21933): Process ended prematurely: osmo-stp_10.42.42.5(pid=21933) [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21933)] [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 22:08:20.143022 tst iperf3m4.py:8: Test FAILED (12.4 sec) 22:08:20.173308 run osmo-hlr_10.42.42.2(pid=21930): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21930)] 22:08:20.225444 run osmo-hlr_10.42.42.2(pid=21930): stdout: | (launched: 2022-12-09_22:08:15.879256) 22:08:20.279174 run osmo-hlr_10.42.42.2(pid=21930): stderr: | 20221209220816152 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220816152 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220816152 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220816152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220816152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220816153 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220816167 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220816175 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220816175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220816175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:20.333708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21686): Terminating (SIGTERM) 22:08:20.377632 run iperf3-srv_10.42.42.10(pid=21699): Terminating (SIGTERM) 22:08:20.424429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21769): Terminating (SIGTERM) 22:08:20.468785 run iperf3-srv_10.42.42.10(pid=21824): Terminating (SIGTERM) 22:08:20.514190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21922): Terminating (SIGTERM) 22:08:20.558620 run iperf3-srv_10.42.42.10(pid=21924): Terminating (SIGTERM) 22:08:20.605404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21925): Terminating (SIGTERM) 22:08:20.650138 run iperf3-srv_10.42.42.10(pid=21926): Terminating (SIGTERM) 22:08:20.697420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21929): Terminating (SIGTERM) 22:08:20.741674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21932): Terminating (SIGTERM) 22:08:20.787822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21935): Terminating (SIGTERM) 22:08:20.835056 --- ParallelTerminationStrategy: PID 21686 died... 22:08:20.856130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21686): Terminated: ok {rc=0} 22:08:20.906175 --- ParallelTerminationStrategy: PID 21699 died... 22:08:20.927169 run iperf3-srv_10.42.42.10(pid=21699): Terminated {rc=256} 22:08:20.975906 --- ParallelTerminationStrategy: PID 21769 died... 22:08:20.996748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21769): Terminated: ok {rc=0} 22:08:21.045500 --- ParallelTerminationStrategy: PID 21824 died... 22:08:21.066284 run iperf3-srv_10.42.42.10(pid=21824): Terminated {rc=256} 22:08:21.115147 --- ParallelTerminationStrategy: PID 21922 died... 22:08:21.135869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21922): Terminated: ok {rc=0} 22:08:21.187283 --- ParallelTerminationStrategy: PID 21924 died... 22:08:21.207933 run iperf3-srv_10.42.42.10(pid=21924): Terminated {rc=256} 22:08:21.255501 --- ParallelTerminationStrategy: PID 21925 died... 22:08:21.276441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21925): Terminated: ok {rc=0} 22:08:21.324604 --- ParallelTerminationStrategy: PID 21926 died... 22:08:21.345612 run iperf3-srv_10.42.42.10(pid=21926): Terminated {rc=256} 22:08:21.393468 --- ParallelTerminationStrategy: PID 21929 died... 22:08:21.414202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21929): Terminated: ok {rc=0} 22:08:21.462107 --- ParallelTerminationStrategy: PID 21932 died... 22:08:21.482835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21932): Terminated: ok {rc=0} 22:08:21.531060 --- ParallelTerminationStrategy: PID 21935 died... 22:08:21.551784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21935): Terminated: ok {rc=0} 22:08:21.643185 bus /gobi_4: Setting Powered False 22:08:22.747090 bus /gobi_4: Setting Powered False 22:08:23.870036 bus /gobi_1: Setting Powered False 22:08:24.971946 bus /gobi_1: Setting Powered False 22:08:26.090841 bus /gobi_0: Setting Powered False 22:08:27.189172 bus /gobi_0: Setting Powered False 22:08:28.304704 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 22:08:29.407949 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:29.419518 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:08:29.473861 tst ping.py: using LAC 23985 22:08:29.590736 tst ping.py: using RAC 15 22:08:29.706631 tst ping.py: using CellId 23985 22:08:29.821901 tst ping.py: using BVCI 23986 22:08:29.931314 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:29.942077 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:29.952550 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:29.963898 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:29.974799 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:29.986126 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:29.997399 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:30.008155 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:30.126446 tst ping.py:19: start network... 22:08:30.340377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:30.838960 run create_hlr_db(pid=21939): Launched 22:08:30.997866 bus /gobi_6: Setting Powered False 22:08:32.072638 run create_hlr_db(pid=21939): Terminated: ok {rc=0} 22:08:32.542847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21941): Launched 22:08:32.859604 run osmo-hlr_10.42.42.2(pid=21942): Launched 22:08:32.980324 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:33.529785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21944): Launched 22:08:33.848785 run osmo-stp_10.42.42.5(pid=21945): Launched 22:08:33.969827 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:08:34.516548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21947): Launched 22:08:34.638619 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:08:34.906105 run patchelf(pid=21948): Launched 22:08:35.084237 run osmo-stp_10.42.42.5(pid=21945): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21945)] 22:08:35.219407 run osmo-stp_10.42.42.5(pid=21945): stdout: | (launched: 2022-12-09_22:08:33.791354) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:35.356384 run osmo-stp_10.42.42.5(pid=21945): stderr: | 20221209220833983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220833983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220833983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220833984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220833984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220833984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220833985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:35.493137 run osmo-stp_10.42.42.5(pid=21945): stdout: | (launched: 2022-12-09_22:08:33.791354) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:35.623184 run osmo-stp_10.42.42.5(pid=21945): stderr: | 20221209220833983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220833983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220833983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220833984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220833984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220833984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220833985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:35.777816 run patchelf(pid=21948): Terminating (SIGINT) 22:08:35.958288 run patchelf(pid=21948): Terminated: ok {rc=0} 22:08:36.087805 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21945): Process ended prematurely: osmo-stp_10.42.42.5(pid=21945) [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21945)] [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 22:08:36.097305 tst ping.py:22: Test FAILED (6.7 sec) 22:08:36.125475 run osmo-hlr_10.42.42.2(pid=21942): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21942)] 22:08:36.175591 run osmo-hlr_10.42.42.2(pid=21942): stdout: | (launched: 2022-12-09_22:08:32.802474) 22:08:36.227440 run osmo-hlr_10.42.42.2(pid=21942): stderr: | 20221209220833000 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220833000 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220833000 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220833000 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220833000 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220833000 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220833014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220833022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220833023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220833023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:36.279538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21941): Terminating (SIGTERM) 22:08:36.321675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21944): Terminating (SIGTERM) 22:08:36.363827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21947): Terminating (SIGTERM) 22:08:36.406394 --- ParallelTerminationStrategy: PID 21941 died... 22:08:36.426600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21941): Terminated: ok {rc=0} 22:08:36.473272 --- ParallelTerminationStrategy: PID 21944 died... 22:08:36.492913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21944): Terminated: ok {rc=0} 22:08:36.539189 --- ParallelTerminationStrategy: PID 21947 died... 22:08:36.558902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21947): Terminated: ok {rc=0} 22:08:36.646753 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:08:37.734573 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:37.746776 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:08:37.800938 tst ping_idle_ping.py: using LAC 23986 22:08:37.929014 tst ping_idle_ping.py: using RAC 16 22:08:38.053799 tst ping_idle_ping.py: using CellId 23986 22:08:38.175973 tst ping_idle_ping.py: using BVCI 23987 22:08:38.290960 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:38.302366 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:38.313512 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:38.324549 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:38.335685 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:38.346764 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:38.357996 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:38.369014 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:38.485681 tst ping_idle_ping.py:24: start network... 22:08:38.686521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:39.148763 run create_hlr_db(pid=21949): Launched 22:08:39.262608 bus /gobi_6: Setting Powered False 22:08:40.323433 run create_hlr_db(pid=21949): Terminated: ok {rc=0} 22:08:40.760475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21951): Launched 22:08:41.079457 run osmo-hlr_10.42.42.2(pid=21952): Launched 22:08:41.201435 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:41.748058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21954): Launched 22:08:42.067215 run osmo-stp_10.42.42.5(pid=21955): Launched 22:08:42.188597 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:08:42.737393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21957): Launched 22:08:42.860615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:08:43.131747 run patchelf(pid=21958): Launched 22:08:43.309520 run osmo-stp_10.42.42.5(pid=21955): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21955)] 22:08:43.445156 run osmo-stp_10.42.42.5(pid=21955): stdout: | (launched: 2022-12-09_22:08:42.009582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:43.581935 run osmo-stp_10.42.42.5(pid=21955): stderr: | 20221209220842199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220842199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220842199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220842200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220842202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220842202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220842202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:43.719179 run osmo-stp_10.42.42.5(pid=21955): stdout: | (launched: 2022-12-09_22:08:42.009582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:43.850118 run osmo-stp_10.42.42.5(pid=21955): stderr: | 20221209220842199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220842199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220842199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220842200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220842202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220842202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220842202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:44.005482 run patchelf(pid=21958): Terminating (SIGINT) 22:08:44.186275 run patchelf(pid=21958): Terminated: ok {rc=0} 22:08:44.315783 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21955): Process ended prematurely: osmo-stp_10.42.42.5(pid=21955) [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21955)] [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 22:08:44.325341 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:08:44.353570 run osmo-hlr_10.42.42.2(pid=21952): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21952)] 22:08:44.403465 run osmo-hlr_10.42.42.2(pid=21952): stdout: | (launched: 2022-12-09_22:08:41.022056) 22:08:44.454957 run osmo-hlr_10.42.42.2(pid=21952): stderr: | 20221209220841220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220841220 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220841220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220841220 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220841220 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220841221 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220841233 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220841241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220841241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220841241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:44.506754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21951): Terminating (SIGTERM) 22:08:44.548293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21954): Terminating (SIGTERM) 22:08:44.590327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21957): Terminating (SIGTERM) 22:08:44.632609 --- ParallelTerminationStrategy: PID 21951 died... 22:08:44.652840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21951): Terminated: ok {rc=0} 22:08:44.699697 --- ParallelTerminationStrategy: PID 21954 died... 22:08:44.719430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21954): Terminated: ok {rc=0} 22:08:44.765764 --- ParallelTerminationStrategy: PID 21957 died... 22:08:44.785531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21957): Terminated: ok {rc=0} 22:08:44.873836 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:08:46.199103 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:08:46.209765 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:08:46.254590 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:08:46.306225 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:08:46.417998 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:08:46.455421 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:08:46.495370 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:08:47.127233 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:08:47.179935 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:47.191911 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:08:47.265033 tst cs_paging_gprs_active.py: using LAC 23987 22:08:47.385072 tst cs_paging_gprs_active.py: using RAC 17 22:08:47.502522 tst cs_paging_gprs_active.py: using CellId 23987 22:08:47.620094 tst cs_paging_gprs_active.py: using BVCI 23988 22:08:47.729877 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:47.740596 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:47.751146 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:47.762013 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:47.772741 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:47.783709 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:47.794627 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:47.805393 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:47.816112 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:08:47.932063 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:08:48.047727 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:08:48.251298 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:48.555049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21962): Launched 22:08:48.819028 run iperf3-srv_10.42.42.10(pid=21963): Launched 22:08:48.933276 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:08:49.136011 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:49.439749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21964): Launched 22:08:49.703478 run iperf3-srv_10.42.42.10(pid=21965): Launched 22:08:49.817251 tst cs_paging_gprs_active.py:38: start network... 22:08:50.020471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:50.487855 run create_hlr_db(pid=21966): Launched 22:08:50.603613 bus /gobi_6: Setting Powered False 22:08:51.663331 run create_hlr_db(pid=21966): Terminated: ok {rc=0} 22:08:52.085113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21968): Launched 22:08:52.387999 run osmo-hlr_10.42.42.2(pid=21969): Launched 22:08:52.504062 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:53.034576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21971): Launched 22:08:53.337188 run osmo-stp_10.42.42.5(pid=21972): Launched 22:08:53.453250 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:08:53.976308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21974): Launched 22:08:54.093502 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:08:54.349509 run patchelf(pid=21975): Launched 22:08:54.520639 run osmo-stp_10.42.42.5(pid=21972): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21972)] 22:08:54.650679 run osmo-stp_10.42.42.5(pid=21972): stdout: | (launched: 2022-12-09_22:08:53.282440) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:54.781595 run osmo-stp_10.42.42.5(pid=21972): stderr: | 20221209220853452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220853452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220853452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220853453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220853455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220853455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220853455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:54.912766 run osmo-stp_10.42.42.5(pid=21972): stdout: | (launched: 2022-12-09_22:08:53.282440) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:55.038901 run osmo-stp_10.42.42.5(pid=21972): stderr: | 20221209220853452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220853452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220853452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220853453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220853455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220853455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220853455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:55.187723 run patchelf(pid=21975): Terminating (SIGINT) 22:08:55.360824 run patchelf(pid=21975): Terminated: ok {rc=0} 22:08:55.485942 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21972): Process ended prematurely: osmo-stp_10.42.42.5(pid=21972) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21972)] [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:08:55.495331 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 22:08:55.522676 run osmo-hlr_10.42.42.2(pid=21969): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21969)] 22:08:55.570782 run osmo-hlr_10.42.42.2(pid=21969): stdout: | (launched: 2022-12-09_22:08:52.333354) 22:08:55.620355 run osmo-hlr_10.42.42.2(pid=21969): stderr: | 20221209220852506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220852506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220852506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220852506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220852507 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220852507 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220852519 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220852528 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220852528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220852528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:55.670328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21962): Terminating (SIGTERM) 22:08:55.710420 run iperf3-srv_10.42.42.10(pid=21963): Terminating (SIGTERM) 22:08:55.750392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21964): Terminating (SIGTERM) 22:08:55.790330 run iperf3-srv_10.42.42.10(pid=21965): Terminating (SIGTERM) 22:08:55.830120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21968): Terminating (SIGTERM) 22:08:55.869943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21971): Terminating (SIGTERM) 22:08:55.910319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21974): Terminating (SIGTERM) 22:08:55.950474 --- ParallelTerminationStrategy: PID 21962 died... 22:08:55.969572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21962): Terminated: ok {rc=0} 22:08:56.014290 --- ParallelTerminationStrategy: PID 21963 died... 22:08:56.032904 run iperf3-srv_10.42.42.10(pid=21963): Terminated {rc=256} 22:08:56.077256 --- ParallelTerminationStrategy: PID 21964 died... 22:08:56.095944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21964): Terminated: ok {rc=0} 22:08:56.140206 --- ParallelTerminationStrategy: PID 21965 died... 22:08:56.158695 run iperf3-srv_10.42.42.10(pid=21965): Terminated {rc=256} 22:08:56.202741 --- ParallelTerminationStrategy: PID 21968 died... 22:08:56.221214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21968): Terminated: ok {rc=0} 22:08:56.265220 --- ParallelTerminationStrategy: PID 21971 died... 22:08:56.283505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21971): Terminated: ok {rc=0} 22:08:56.327706 --- ParallelTerminationStrategy: PID 21974 died... 22:08:56.346287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21974): Terminated: ok {rc=0} 22:08:56.432379 bus /gobi_0: Setting Powered False 22:08:57.530996 bus /gobi_0: Setting Powered False 22:08:58.643916 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:08:59.793315 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:59.805417 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:08:59.880119 tst iperf3.py: using LAC 23988 22:09:00.006666 tst iperf3.py: using RAC 18 22:09:00.132170 tst iperf3.py: using CellId 23988 22:09:00.258419 tst iperf3.py: using BVCI 23989 22:09:00.375802 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:00.387054 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:00.398145 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:00.409293 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:00.420260 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:00.431377 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:00.442533 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:00.453617 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:00.464759 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:00.584363 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:09:00.802374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:01.143514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21976): Launched 22:09:01.439071 run iperf3-srv_10.42.42.10(pid=21977): Launched 22:09:01.565070 tst iperf3.py:8: start network... 22:09:01.786765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:02.272896 run create_hlr_db(pid=21978): Launched 22:09:02.391059 bus /gobi_6: Setting Powered False 22:09:03.451462 run create_hlr_db(pid=21978): Terminated: ok {rc=0} 22:09:03.871447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21980): Launched 22:09:04.173868 run osmo-hlr_10.42.42.2(pid=21981): Launched 22:09:04.289211 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:04.824537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21983): Launched 22:09:05.127426 run osmo-stp_10.42.42.5(pid=21984): Launched 22:09:05.243060 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:09:05.764282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21986): Launched 22:09:05.881396 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:09:06.136877 run patchelf(pid=21987): Launched 22:09:06.305769 run osmo-stp_10.42.42.5(pid=21984): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21984)] 22:09:06.434944 run osmo-stp_10.42.42.5(pid=21984): stdout: | (launched: 2022-12-09_22:09:05.072565) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:06.564876 run osmo-stp_10.42.42.5(pid=21984): stderr: | 20221209220905243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220905243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220905244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220905244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220905245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220905245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220905245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:06.695071 run osmo-stp_10.42.42.5(pid=21984): stdout: | (launched: 2022-12-09_22:09:05.072565) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:06.818744 run osmo-stp_10.42.42.5(pid=21984): stderr: | 20221209220905243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220905243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220905244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220905244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220905245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220905245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220905245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:06.966166 run patchelf(pid=21987): Terminating (SIGINT) 22:09:07.137920 run patchelf(pid=21987): Terminated: ok {rc=0} 22:09:07.261279 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21984): Process ended prematurely: osmo-stp_10.42.42.5(pid=21984) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21984)] [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 22:09:07.270615 tst iperf3.py:8: Test FAILED (7.5 sec) 22:09:07.298462 run osmo-hlr_10.42.42.2(pid=21981): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21981)] 22:09:07.346413 run osmo-hlr_10.42.42.2(pid=21981): stdout: | (launched: 2022-12-09_22:09:04.118916) 22:09:07.395991 run osmo-hlr_10.42.42.2(pid=21981): stderr: | 20221209220904294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220904294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220904294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220904294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220904294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220904295 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220904307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220904316 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220904316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220904316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:07.446080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21976): Terminating (SIGTERM) 22:09:07.485973 run iperf3-srv_10.42.42.10(pid=21977): Terminating (SIGTERM) 22:09:07.526203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21980): Terminating (SIGTERM) 22:09:07.566557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21983): Terminating (SIGTERM) 22:09:07.606689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21986): Terminating (SIGTERM) 22:09:07.647394 --- ParallelTerminationStrategy: PID 21976 died... 22:09:07.666773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21976): Terminated: ok {rc=0} 22:09:07.711454 --- ParallelTerminationStrategy: PID 21977 died... 22:09:07.730079 run iperf3-srv_10.42.42.10(pid=21977): Terminated {rc=256} 22:09:07.774480 --- ParallelTerminationStrategy: PID 21980 died... 22:09:07.793213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21980): Terminated: ok {rc=0} 22:09:07.837689 --- ParallelTerminationStrategy: PID 21983 died... 22:09:07.856247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21983): Terminated: ok {rc=0} 22:09:07.900484 --- ParallelTerminationStrategy: PID 21986 died... 22:09:07.919202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21986): Terminated: ok {rc=0} 22:09:08.005874 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:09:09.153787 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.165216 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:09:09.233405 tst iperf3m4.py: using LAC 23989 22:09:09.352395 tst iperf3m4.py: using RAC 19 22:09:09.468872 tst iperf3m4.py: using CellId 23989 22:09:09.585464 tst iperf3m4.py: using BVCI 23990 22:09:09.696701 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.708049 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.718750 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.729649 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.740357 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.751226 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.762265 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.773042 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.783963 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:09.904058 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:10.022635 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:10.144510 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:10.263347 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:09:10.466919 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:10.770892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21988): Launched 22:09:11.035026 run iperf3-srv_10.42.42.10(pid=21989): Launched 22:09:11.148941 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:09:11.350954 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:11.654148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21990): Launched 22:09:11.918395 run iperf3-srv_10.42.42.10(pid=21991): Launched 22:09:12.032875 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:09:12.235478 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:12.538897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21992): Launched 22:09:12.802498 run iperf3-srv_10.42.42.10(pid=21993): Launched 22:09:12.917230 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:09:13.119852 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:13.423453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21994): Launched 22:09:13.688141 run iperf3-srv_10.42.42.10(pid=21995): Launched 22:09:13.802336 tst iperf3m4.py:8: start network... 22:09:14.004737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:14.474480 run create_hlr_db(pid=21996): Launched 22:09:14.590565 bus /gobi_6: Setting Powered False 22:09:15.650505 run create_hlr_db(pid=21996): Terminated: ok {rc=0} 22:09:16.139299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21998): Launched 22:09:16.489362 run osmo-hlr_10.42.42.2(pid=21999): Launched 22:09:16.773474 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:17.505402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22001): Launched 22:09:17.830309 run osmo-stp_10.42.42.5(pid=22002): Launched 22:09:17.953876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:09:18.512356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22004): Launched 22:09:18.636194 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:09:18.908763 run patchelf(pid=22005): Launched 22:09:19.089989 run osmo-stp_10.42.42.5(pid=22002): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22002)] 22:09:19.227928 run osmo-stp_10.42.42.5(pid=22002): stdout: | (launched: 2022-12-09_22:09:17.771367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:19.367382 run osmo-stp_10.42.42.5(pid=22002): stderr: | 20221209220917966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220917966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220917966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220917966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220917967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220917967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220917967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:19.506282 run osmo-stp_10.42.42.5(pid=22002): stdout: | (launched: 2022-12-09_22:09:17.771367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:19.638576 run osmo-stp_10.42.42.5(pid=22002): stderr: | 20221209220917966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220917966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220917966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220917966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220917967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220917967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220917967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:19.795891 run patchelf(pid=22005): Terminating (SIGINT) 22:09:19.979318 run patchelf(pid=22005): Terminated: ok {rc=0} 22:09:20.112466 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22002): Process ended prematurely: osmo-stp_10.42.42.5(pid=22002) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22002)] [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:09:20.122649 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:09:20.151712 run osmo-hlr_10.42.42.2(pid=21999): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21999)] 22:09:20.201852 run osmo-hlr_10.42.42.2(pid=21999): stdout: | (launched: 2022-12-09_22:09:16.423480) 22:09:20.254041 run osmo-hlr_10.42.42.2(pid=21999): stderr: | 20221209220916673 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220916673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220916673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220916673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220916673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220916674 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220916689 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220916713 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220916714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220916714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:20.306270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21988): Terminating (SIGTERM) 22:09:20.348465 run iperf3-srv_10.42.42.10(pid=21989): Terminating (SIGTERM) 22:09:20.390241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21990): Terminating (SIGTERM) 22:09:20.432364 run iperf3-srv_10.42.42.10(pid=21991): Terminating (SIGTERM) 22:09:20.473938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21992): Terminating (SIGTERM) 22:09:20.516228 run iperf3-srv_10.42.42.10(pid=21993): Terminating (SIGTERM) 22:09:20.558140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21994): Terminating (SIGTERM) 22:09:20.600021 run iperf3-srv_10.42.42.10(pid=21995): Terminating (SIGTERM) 22:09:20.641896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21998): Terminating (SIGTERM) 22:09:20.683781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22001): Terminating (SIGTERM) 22:09:20.725695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22004): Terminating (SIGTERM) 22:09:20.768032 --- ParallelTerminationStrategy: PID 21988 died... 22:09:20.788186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21988): Terminated: ok {rc=0} 22:09:20.835487 --- ParallelTerminationStrategy: PID 21989 died... 22:09:20.855156 run iperf3-srv_10.42.42.10(pid=21989): Terminated {rc=256} 22:09:20.901678 --- ParallelTerminationStrategy: PID 21990 died... 22:09:20.921638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21990): Terminated: ok {rc=0} 22:09:20.968302 --- ParallelTerminationStrategy: PID 21991 died... 22:09:20.988084 run iperf3-srv_10.42.42.10(pid=21991): Terminated {rc=256} 22:09:21.034915 --- ParallelTerminationStrategy: PID 21992 died... 22:09:21.054852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21992): Terminated: ok {rc=0} 22:09:21.101286 --- ParallelTerminationStrategy: PID 21993 died... 22:09:21.120770 run iperf3-srv_10.42.42.10(pid=21993): Terminated {rc=256} 22:09:21.167101 --- ParallelTerminationStrategy: PID 21994 died... 22:09:21.186843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21994): Terminated: ok {rc=0} 22:09:21.233405 --- ParallelTerminationStrategy: PID 21995 died... 22:09:21.252746 run iperf3-srv_10.42.42.10(pid=21995): Terminated {rc=256} 22:09:21.299236 --- ParallelTerminationStrategy: PID 21998 died... 22:09:21.319052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21998): Terminated: ok {rc=0} 22:09:21.365735 --- ParallelTerminationStrategy: PID 22001 died... 22:09:21.385668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22001): Terminated: ok {rc=0} 22:09:21.432083 --- ParallelTerminationStrategy: PID 22004 died... 22:09:21.451826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22004): Terminated: ok {rc=0} 22:09:21.540011 bus /gobi_4: Setting Powered False 22:09:22.639798 bus /gobi_4: Setting Powered False 22:09:23.757149 bus /gobi_1: Setting Powered False 22:09:24.856989 bus /gobi_1: Setting Powered False 22:09:25.975176 bus /gobi_0: Setting Powered False 22:09:27.073167 bus /gobi_0: Setting Powered False 22:09:28.190596 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:09:29.294807 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:29.306305 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:09:29.376094 tst ping.py: using LAC 23990 22:09:29.504466 tst ping.py: using RAC 20 22:09:29.629384 tst ping.py: using CellId 23990 22:09:29.753387 tst ping.py: using BVCI 23991 22:09:29.869273 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:29.880813 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:29.892058 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:29.903828 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:29.915430 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:29.927022 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:29.938777 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:29.950326 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:30.067478 tst ping.py:19: start network... 22:09:30.268027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:30.728376 run create_hlr_db(pid=22006): Launched 22:09:30.852244 bus /gobi_6: Setting Powered False 22:09:31.928523 run create_hlr_db(pid=22006): Terminated: ok {rc=0} 22:09:32.396471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22008): Launched 22:09:32.713688 run osmo-hlr_10.42.42.2(pid=22009): Launched 22:09:32.834991 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:33.389215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22011): Launched 22:09:33.705476 run osmo-stp_10.42.42.5(pid=22012): Launched 22:09:33.826888 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:09:34.379715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22014): Launched 22:09:34.501863 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:09:34.770792 run patchelf(pid=22015): Launched 22:09:34.947931 run osmo-stp_10.42.42.5(pid=22012): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22012)] 22:09:35.083979 run osmo-stp_10.42.42.5(pid=22012): stdout: | (launched: 2022-12-09_22:09:33.648018) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:35.221244 run osmo-stp_10.42.42.5(pid=22012): stderr: | 20221209220933838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220933838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220933838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220933839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220933841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220933841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220933841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:35.357907 run osmo-stp_10.42.42.5(pid=22012): stdout: | (launched: 2022-12-09_22:09:33.648018) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:35.488117 run osmo-stp_10.42.42.5(pid=22012): stderr: | 20221209220933838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220933838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220933838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220933839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220933841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220933841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220933841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:35.642701 run patchelf(pid=22015): Terminating (SIGINT) 22:09:35.822981 run patchelf(pid=22015): Terminated: ok {rc=0} 22:09:35.952292 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22012): Process ended prematurely: osmo-stp_10.42.42.5(pid=22012) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22012)] [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 22:09:35.962299 tst ping.py:22: Test FAILED (6.7 sec) 22:09:35.990835 run osmo-hlr_10.42.42.2(pid=22009): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22009)] 22:09:36.041606 run osmo-hlr_10.42.42.2(pid=22009): stdout: | (launched: 2022-12-09_22:09:32.656220) 22:09:36.094068 run osmo-hlr_10.42.42.2(pid=22009): stderr: | 20221209220932855 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220932855 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220932855 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220932855 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220932855 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220932855 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220932869 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220932877 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220932878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220932878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:36.146800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22008): Terminating (SIGTERM) 22:09:36.189132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22011): Terminating (SIGTERM) 22:09:36.231610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22014): Terminating (SIGTERM) 22:09:36.274192 --- ParallelTerminationStrategy: PID 22008 died... 22:09:36.294473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22008): Terminated: ok {rc=0} 22:09:36.341711 --- ParallelTerminationStrategy: PID 22011 died... 22:09:36.361630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22011): Terminated: ok {rc=0} 22:09:36.408203 --- ParallelTerminationStrategy: PID 22014 died... 22:09:36.428059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22014): Terminated: ok {rc=0} 22:09:36.516492 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:09:37.604105 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:37.616005 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:09:37.687382 tst ping_idle_ping.py: using LAC 23991 22:09:37.805834 tst ping_idle_ping.py: using RAC 21 22:09:37.922104 tst ping_idle_ping.py: using CellId 23991 22:09:38.040476 tst ping_idle_ping.py: using BVCI 23992 22:09:38.148307 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:38.159314 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:38.170015 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:38.181064 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:38.191794 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:38.202756 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:38.213819 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:38.224895 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:38.342354 tst ping_idle_ping.py:24: start network... 22:09:38.543234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:39.010329 run create_hlr_db(pid=22017): Launched 22:09:39.123224 bus /gobi_6: Setting Powered False 22:09:40.183703 run create_hlr_db(pid=22017): Terminated: ok {rc=0} 22:09:40.618263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22019): Launched 22:09:40.935006 run osmo-hlr_10.42.42.2(pid=22020): Launched 22:09:41.056721 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:41.606320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22022): Launched 22:09:41.924189 run osmo-stp_10.42.42.5(pid=22023): Launched 22:09:42.046678 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:09:42.593731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22025): Launched 22:09:42.714824 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:09:42.982015 run patchelf(pid=22026): Launched 22:09:43.159852 run osmo-stp_10.42.42.5(pid=22023): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22023)] 22:09:43.295323 run osmo-stp_10.42.42.5(pid=22023): stdout: | (launched: 2022-12-09_22:09:41.866497) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:43.432328 run osmo-stp_10.42.42.5(pid=22023): stderr: | 20221209220942058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220942058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220942058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220942059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220942061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220942061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220942061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:43.569327 run osmo-stp_10.42.42.5(pid=22023): stdout: | (launched: 2022-12-09_22:09:41.866497) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:43.699218 run osmo-stp_10.42.42.5(pid=22023): stderr: | 20221209220942058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220942058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220942058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220942059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220942061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220942061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220942061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:43.853355 run patchelf(pid=22026): Terminating (SIGINT) 22:09:44.033546 run patchelf(pid=22026): Terminated: ok {rc=0} 22:09:44.162813 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22023): Process ended prematurely: osmo-stp_10.42.42.5(pid=22023) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22023)] [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:09:44.172321 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:09:44.200330 run osmo-hlr_10.42.42.2(pid=22020): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22020)] 22:09:44.250470 run osmo-hlr_10.42.42.2(pid=22020): stdout: | (launched: 2022-12-09_22:09:40.878045) 22:09:44.302645 run osmo-hlr_10.42.42.2(pid=22020): stderr: | 20221209220941076 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220941076 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220941076 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220941076 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220941076 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220941076 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220941089 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220941097 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220941097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220941097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:44.355355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22019): Terminating (SIGTERM) 22:09:44.397193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22022): Terminating (SIGTERM) 22:09:44.439106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22025): Terminating (SIGTERM) 22:09:44.481356 --- ParallelTerminationStrategy: PID 22019 died... 22:09:44.501321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22019): Terminated: ok {rc=0} 22:09:44.547687 --- ParallelTerminationStrategy: PID 22022 died... 22:09:44.567264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22022): Terminated: ok {rc=0} 22:09:44.613258 --- ParallelTerminationStrategy: PID 22025 died... 22:09:44.632436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22025): Terminated: ok {rc=0} 22:09:44.720197 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:09:46.047200 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:09:46.053998 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:09:46.089231 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:09:46.129255 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:09:46.216581 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:09:46.258459 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:09:46.307765 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:09:46.890871 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:09:46.966520 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:46.983859 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:09:47.075546 tst cs_paging_gprs_active.py: using LAC 23992 22:09:47.196454 tst cs_paging_gprs_active.py: using RAC 22 22:09:47.315375 tst cs_paging_gprs_active.py: using CellId 23992 22:09:47.438707 tst cs_paging_gprs_active.py: using BVCI 23993 22:09:47.550853 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:47.561880 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:47.572695 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:47.584335 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:47.595708 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:47.607027 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:47.618651 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:47.630181 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:47.641719 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:09:47.765601 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:09:47.884528 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:09:48.088630 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:48.392439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22030): Launched 22:09:48.656825 run iperf3-srv_10.42.42.10(pid=22031): Launched 22:09:48.771080 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:09:48.973643 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:49.276497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22032): Launched 22:09:49.541044 run iperf3-srv_10.42.42.10(pid=22033): Launched 22:09:49.655259 tst cs_paging_gprs_active.py:38: start network... 22:09:49.857931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:50.327830 run create_hlr_db(pid=22034): Launched 22:09:50.444884 bus /gobi_6: Setting Powered False 22:09:51.505172 run create_hlr_db(pid=22034): Terminated: ok {rc=0} 22:09:51.946025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22036): Launched 22:09:52.271316 run osmo-hlr_10.42.42.2(pid=22037): Launched 22:09:52.396167 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:52.950573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22039): Launched 22:09:53.273677 run osmo-stp_10.42.42.5(pid=22040): Launched 22:09:53.397494 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:09:53.954058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22042): Launched 22:09:54.078895 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:09:54.351837 run patchelf(pid=22043): Launched 22:09:54.532288 run osmo-stp_10.42.42.5(pid=22040): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22040)] 22:09:54.669618 run osmo-stp_10.42.42.5(pid=22040): stdout: | (launched: 2022-12-09_22:09:53.215712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:54.807726 run osmo-stp_10.42.42.5(pid=22040): stderr: | 20221209220953409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220953409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220953409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220953409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220953410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220953410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220953410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:54.946343 run osmo-stp_10.42.42.5(pid=22040): stdout: | (launched: 2022-12-09_22:09:53.215712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:55.079753 run osmo-stp_10.42.42.5(pid=22040): stderr: | 20221209220953409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209220953409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209220953409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209220953409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209220953410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209220953410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209220953410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:55.236937 run patchelf(pid=22043): Terminating (SIGINT) 22:09:55.419420 run patchelf(pid=22043): Terminated: ok {rc=0} 22:09:55.551043 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22040): Process ended prematurely: osmo-stp_10.42.42.5(pid=22040) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22040)] [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:09:55.561212 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:09:55.589570 run osmo-hlr_10.42.42.2(pid=22037): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22037)] 22:09:55.639472 run osmo-hlr_10.42.42.2(pid=22037): stdout: | (launched: 2022-12-09_22:09:52.213036) 22:09:55.691095 run osmo-hlr_10.42.42.2(pid=22037): stderr: | 20221209220952413 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209220952413 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209220952413 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209220952413 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209220952413 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209220952413 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209220952424 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209220952433 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209220952433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209220952433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:55.743174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22030): Terminating (SIGTERM) 22:09:55.784892 run iperf3-srv_10.42.42.10(pid=22031): Terminating (SIGTERM) 22:09:55.826522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22032): Terminating (SIGTERM) 22:09:55.868313 run iperf3-srv_10.42.42.10(pid=22033): Terminating (SIGTERM) 22:09:55.909893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22036): Terminating (SIGTERM) 22:09:55.951605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22039): Terminating (SIGTERM) 22:09:55.993473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22042): Terminating (SIGTERM) 22:09:56.035744 --- ParallelTerminationStrategy: PID 22030 died... 22:09:56.055751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22030): Terminated: ok {rc=0} 22:09:56.102071 --- ParallelTerminationStrategy: PID 22031 died... 22:09:56.121490 run iperf3-srv_10.42.42.10(pid=22031): Terminated {rc=256} 22:09:56.167311 --- ParallelTerminationStrategy: PID 22032 died... 22:09:56.186857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22032): Terminated: ok {rc=0} 22:09:56.232527 --- ParallelTerminationStrategy: PID 22033 died... 22:09:56.251835 run iperf3-srv_10.42.42.10(pid=22033): Terminated {rc=256} 22:09:56.297454 --- ParallelTerminationStrategy: PID 22036 died... 22:09:56.316794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22036): Terminated: ok {rc=0} 22:09:56.362952 --- ParallelTerminationStrategy: PID 22039 died... 22:09:56.382614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22039): Terminated: ok {rc=0} 22:09:56.428579 --- ParallelTerminationStrategy: PID 22042 died... 22:09:56.448115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22042): Terminated: ok {rc=0} 22:09:56.535725 bus /gobi_0: Setting Powered False 22:09:57.635826 bus /gobi_0: Setting Powered False 22:09:58.753731 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:09:59.902538 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:59.914886 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:09:59.989331 tst iperf3.py: using LAC 23993 22:10:00.116914 tst iperf3.py: using RAC 23 22:10:00.242161 tst iperf3.py: using CellId 23993 22:10:00.368126 tst iperf3.py: using BVCI 23994 22:10:00.485770 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:00.497039 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:00.508058 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:00.519117 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:00.530151 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:00.541369 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:00.552502 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:00.563592 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:00.574824 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:00.696619 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:10:00.945874 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:01.262617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22048): Launched 22:10:01.555180 run iperf3-srv_10.42.42.10(pid=22049): Launched 22:10:01.679576 tst iperf3.py:8: start network... 22:10:01.932153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:02.481593 run create_hlr_db(pid=22056): Launched 22:10:02.637438 bus /gobi_6: Setting Powered False 22:10:03.697481 run create_hlr_db(pid=22056): Terminated: ok {rc=0} 22:10:04.137315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22062): Launched 22:10:04.460526 run osmo-hlr_10.42.42.2(pid=22063): Launched 22:10:04.584519 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:05.143953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22065): Launched 22:10:05.466298 run osmo-stp_10.42.42.5(pid=22066): Launched 22:10:05.589232 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:10:06.143722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22068): Launched 22:10:06.267604 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:10:06.540331 run patchelf(pid=22069): Launched 22:10:06.720890 run osmo-stp_10.42.42.5(pid=22066): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22066)] 22:10:06.858229 run osmo-stp_10.42.42.5(pid=22066): stdout: | (launched: 2022-12-09_22:10:05.408277) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:06.996423 run osmo-stp_10.42.42.5(pid=22066): stderr: | 20221209221005600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221005600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221005600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221005600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221005603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221005603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221005603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:07.135573 run osmo-stp_10.42.42.5(pid=22066): stdout: | (launched: 2022-12-09_22:10:05.408277) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:07.275752 run osmo-stp_10.42.42.5(pid=22066): stderr: | 20221209221005600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221005600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221005600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221005600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221005603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221005603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221005603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:07.448836 run patchelf(pid=22069): Terminating (SIGINT) 22:10:07.622578 run patchelf(pid=22069): Terminated: ok {rc=0} 22:10:07.747473 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22066): Process ended prematurely: osmo-stp_10.42.42.5(pid=22066) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22066)] [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 22:10:07.756881 tst iperf3.py:8: Test FAILED (7.9 sec) 22:10:07.784330 run osmo-hlr_10.42.42.2(pid=22063): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22063)] 22:10:07.832548 run osmo-hlr_10.42.42.2(pid=22063): stdout: | (launched: 2022-12-09_22:10:04.401845) 22:10:07.882217 run osmo-hlr_10.42.42.2(pid=22063): stderr: | 20221209221004603 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221004603 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221004603 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221004603 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221004603 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221004603 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221004615 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221004623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221004624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221004624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:07.932084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22048): Terminating (SIGTERM) 22:10:07.971887 run iperf3-srv_10.42.42.10(pid=22049): Terminating (SIGTERM) 22:10:08.011731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22062): Terminating (SIGTERM) 22:10:08.051870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22065): Terminating (SIGTERM) 22:10:08.092066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22068): Terminating (SIGTERM) 22:10:08.132614 --- ParallelTerminationStrategy: PID 22048 died... 22:10:08.151858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22048): Terminated: ok {rc=0} 22:10:08.196641 --- ParallelTerminationStrategy: PID 22049 died... 22:10:08.215263 run iperf3-srv_10.42.42.10(pid=22049): Terminated {rc=256} 22:10:08.259821 --- ParallelTerminationStrategy: PID 22062 died... 22:10:08.278476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22062): Terminated: ok {rc=0} 22:10:08.323065 --- ParallelTerminationStrategy: PID 22065 died... 22:10:08.341760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22065): Terminated: ok {rc=0} 22:10:08.386560 --- ParallelTerminationStrategy: PID 22068 died... 22:10:08.405294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22068): Terminated: ok {rc=0} 22:10:08.489761 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:10:09.640363 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:09.652483 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:10:09.725986 tst iperf3m4.py: using LAC 23994 22:10:09.853252 tst iperf3m4.py: using RAC 24 22:10:09.981819 tst iperf3m4.py: using CellId 23994 22:10:10.108408 tst iperf3m4.py: using BVCI 23995 22:10:10.227313 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:10.238819 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:10.249891 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:10.261535 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:10.273119 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:10.284643 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:10.296235 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:10.307714 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:10.319523 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:10.439126 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:10.564062 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:10.681471 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:10.797646 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:10:11.001160 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:11.304565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22071): Launched 22:10:11.569242 run iperf3-srv_10.42.42.10(pid=22072): Launched 22:10:11.683200 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:10:11.886239 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:12.189369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22073): Launched 22:10:12.455015 run iperf3-srv_10.42.42.10(pid=22074): Launched 22:10:12.569478 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:10:12.787041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:13.109697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22103): Launched 22:10:13.405729 run iperf3-srv_10.42.42.10(pid=22171): Launched 22:10:13.542980 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:10:13.767964 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:14.111919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22272): Launched 22:10:14.403764 run iperf3-srv_10.42.42.10(pid=22347): Launched 22:10:14.540819 tst iperf3m4.py:8: start network... 22:10:14.764595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:15.271135 run create_hlr_db(pid=22431): Launched 22:10:15.402711 bus /gobi_6: Setting Powered False 22:10:16.478170 run create_hlr_db(pid=22431): Terminated: ok {rc=0} 22:10:16.979390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22433): Launched 22:10:17.309263 run osmo-hlr_10.42.42.2(pid=22434): Launched 22:10:17.433992 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:17.992844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22436): Launched 22:10:18.316259 run osmo-stp_10.42.42.5(pid=22437): Launched 22:10:18.440079 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:10:18.998701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22439): Launched 22:10:19.123655 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:10:19.396321 run patchelf(pid=22440): Launched 22:10:19.576214 run osmo-stp_10.42.42.5(pid=22437): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22437)] 22:10:19.713759 run osmo-stp_10.42.42.5(pid=22437): stdout: | (launched: 2022-12-09_22:10:18.257814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:19.852202 run osmo-stp_10.42.42.5(pid=22437): stderr: | 20221209221018453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221018453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221018453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221018454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221018454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221018454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221018454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:19.990811 run osmo-stp_10.42.42.5(pid=22437): stdout: | (launched: 2022-12-09_22:10:18.257814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:20.123861 run osmo-stp_10.42.42.5(pid=22437): stderr: | 20221209221018453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221018453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221018453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221018454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221018454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221018454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221018454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:20.280352 run patchelf(pid=22440): Terminating (SIGINT) 22:10:20.463536 run patchelf(pid=22440): Terminated: ok {rc=0} 22:10:20.595508 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22437): Process ended prematurely: osmo-stp_10.42.42.5(pid=22437) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22437)] [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:10:20.605674 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:10:20.634599 run osmo-hlr_10.42.42.2(pid=22434): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22434)] 22:10:20.684690 run osmo-hlr_10.42.42.2(pid=22434): stdout: | (launched: 2022-12-09_22:10:17.251049) 22:10:20.736512 run osmo-hlr_10.42.42.2(pid=22434): stderr: | 20221209221017448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221017448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221017448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221017448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221017448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221017448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221017460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221017469 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221017469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221017469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:20.788591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22071): Terminating (SIGTERM) 22:10:20.830472 run iperf3-srv_10.42.42.10(pid=22072): Terminating (SIGTERM) 22:10:20.872247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22073): Terminating (SIGTERM) 22:10:20.914218 run iperf3-srv_10.42.42.10(pid=22074): Terminating (SIGTERM) 22:10:20.955777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22103): Terminating (SIGTERM) 22:10:20.997309 run iperf3-srv_10.42.42.10(pid=22171): Terminating (SIGTERM) 22:10:21.039100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22272): Terminating (SIGTERM) 22:10:21.080814 run iperf3-srv_10.42.42.10(pid=22347): Terminating (SIGTERM) 22:10:21.122257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22433): Terminating (SIGTERM) 22:10:21.163930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22436): Terminating (SIGTERM) 22:10:21.205431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22439): Terminating (SIGTERM) 22:10:21.247245 --- ParallelTerminationStrategy: PID 22071 died... 22:10:21.267344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22071): Terminated: ok {rc=0} 22:10:21.313626 --- ParallelTerminationStrategy: PID 22072 died... 22:10:21.333194 run iperf3-srv_10.42.42.10(pid=22072): Terminated {rc=256} 22:10:21.379271 --- ParallelTerminationStrategy: PID 22073 died... 22:10:21.398792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22073): Terminated: ok {rc=0} 22:10:21.445236 --- ParallelTerminationStrategy: PID 22074 died... 22:10:21.464740 run iperf3-srv_10.42.42.10(pid=22074): Terminated {rc=256} 22:10:21.510998 --- ParallelTerminationStrategy: PID 22103 died... 22:10:21.530680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22103): Terminated: ok {rc=0} 22:10:21.576839 --- ParallelTerminationStrategy: PID 22171 died... 22:10:21.596720 run iperf3-srv_10.42.42.10(pid=22171): Terminated {rc=256} 22:10:21.642826 --- ParallelTerminationStrategy: PID 22272 died... 22:10:21.662422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22272): Terminated: ok {rc=0} 22:10:21.708595 --- ParallelTerminationStrategy: PID 22347 died... 22:10:21.727992 run iperf3-srv_10.42.42.10(pid=22347): Terminated {rc=256} 22:10:21.774401 --- ParallelTerminationStrategy: PID 22433 died... 22:10:21.793995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22433): Terminated: ok {rc=0} 22:10:21.840079 --- ParallelTerminationStrategy: PID 22436 died... 22:10:21.859715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22436): Terminated: ok {rc=0} 22:10:21.905943 --- ParallelTerminationStrategy: PID 22439 died... 22:10:21.925649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22439): Terminated: ok {rc=0} 22:10:22.013866 bus /gobi_4: Setting Powered False 22:10:23.112858 bus /gobi_4: Setting Powered False 22:10:24.239039 bus /gobi_1: Setting Powered False 22:10:25.342586 bus /gobi_1: Setting Powered False 22:10:26.463279 bus /gobi_0: Setting Powered False 22:10:27.565380 bus /gobi_0: Setting Powered False 22:10:28.698966 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:10:29.802435 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:29.813881 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:10:29.885781 tst ping.py: using LAC 23995 22:10:30.007827 tst ping.py: using RAC 25 22:10:30.125120 tst ping.py: using CellId 23995 22:10:30.240441 tst ping.py: using BVCI 23996 22:10:30.347734 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:30.358737 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:30.369447 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:30.380626 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:30.391544 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:30.402505 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:30.413631 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:30.424329 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:30.538648 tst ping.py:19: start network... 22:10:30.750579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:31.240225 run create_hlr_db(pid=22617): Launched 22:10:31.393067 bus /gobi_6: Setting Powered False 22:10:32.451966 run create_hlr_db(pid=22617): Terminated: ok {rc=0} 22:10:32.887439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22619): Launched 22:10:33.205753 run osmo-hlr_10.42.42.2(pid=22620): Launched 22:10:33.326371 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:33.885298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22622): Launched 22:10:34.203013 run osmo-stp_10.42.42.5(pid=22623): Launched 22:10:34.323433 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:10:34.869651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22625): Launched 22:10:34.991906 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:10:35.261621 run patchelf(pid=22626): Launched 22:10:35.440719 run osmo-stp_10.42.42.5(pid=22623): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22623)] 22:10:35.576869 run osmo-stp_10.42.42.5(pid=22623): stdout: | (launched: 2022-12-09_22:10:34.145823) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:35.714701 run osmo-stp_10.42.42.5(pid=22623): stderr: | 20221209221034336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221034336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221034336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221034337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221034337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221034337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221034337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:35.852166 run osmo-stp_10.42.42.5(pid=22623): stdout: | (launched: 2022-12-09_22:10:34.145823) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:35.983691 run osmo-stp_10.42.42.5(pid=22623): stderr: | 20221209221034336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221034336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221034336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221034337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221034337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221034337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221034337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:36.139491 run patchelf(pid=22626): Terminating (SIGINT) 22:10:36.321026 run patchelf(pid=22626): Terminated: ok {rc=0} 22:10:36.451609 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22623): Process ended prematurely: osmo-stp_10.42.42.5(pid=22623) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22623)] [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 22:10:36.461278 tst ping.py:22: Test FAILED (6.7 sec) 22:10:36.489161 run osmo-hlr_10.42.42.2(pid=22620): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22620)] 22:10:36.538927 run osmo-hlr_10.42.42.2(pid=22620): stdout: | (launched: 2022-12-09_22:10:33.148213) 22:10:36.590795 run osmo-hlr_10.42.42.2(pid=22620): stderr: | 20221209221033347 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221033347 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221033347 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221033347 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221033347 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221033347 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221033361 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221033371 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221033371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221033371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:36.642841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22619): Terminating (SIGTERM) 22:10:36.684546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22622): Terminating (SIGTERM) 22:10:36.726777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22625): Terminating (SIGTERM) 22:10:36.768715 --- ParallelTerminationStrategy: PID 22619 died... 22:10:36.788777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22619): Terminated: ok {rc=0} 22:10:36.835004 --- ParallelTerminationStrategy: PID 22622 died... 22:10:36.854423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22622): Terminated: ok {rc=0} 22:10:36.900431 --- ParallelTerminationStrategy: PID 22625 died... 22:10:36.919894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22625): Terminated: ok {rc=0} 22:10:37.008674 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:10:38.095953 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:38.107761 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:10:38.180799 tst ping_idle_ping.py: using LAC 23996 22:10:38.304926 tst ping_idle_ping.py: using RAC 26 22:10:38.430532 tst ping_idle_ping.py: using CellId 23996 22:10:38.557386 tst ping_idle_ping.py: using BVCI 23997 22:10:38.674517 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:38.685791 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:38.696731 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:38.708127 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:38.719271 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:38.730477 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:38.741827 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:38.752689 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:38.872834 tst ping_idle_ping.py:24: start network... 22:10:39.088997 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:39.584555 run create_hlr_db(pid=22627): Launched 22:10:39.714647 bus /gobi_6: Setting Powered False 22:10:40.778185 run create_hlr_db(pid=22627): Terminated: ok {rc=0} 22:10:41.204709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22629): Launched 22:10:41.502739 run osmo-hlr_10.42.42.2(pid=22630): Launched 22:10:41.617860 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:42.137158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22632): Launched 22:10:42.433753 run osmo-stp_10.42.42.5(pid=22633): Launched 22:10:42.548222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:10:43.061855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22635): Launched 22:10:43.176376 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:10:43.427882 run patchelf(pid=22636): Launched 22:10:43.595006 run osmo-stp_10.42.42.5(pid=22633): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22633)] 22:10:43.721591 run osmo-stp_10.42.42.5(pid=22633): stdout: | (launched: 2022-12-09_22:10:42.379834) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:43.849545 run osmo-stp_10.42.42.5(pid=22633): stderr: | 20221209221042548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221042548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221042548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221042548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221042549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221042549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221042549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:43.977579 run osmo-stp_10.42.42.5(pid=22633): stdout: | (launched: 2022-12-09_22:10:42.379834) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:44.099623 run osmo-stp_10.42.42.5(pid=22633): stderr: | 20221209221042548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221042548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221042548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221042548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221042549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221042549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221042549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:44.243582 run patchelf(pid=22636): Terminating (SIGINT) 22:10:44.412363 run patchelf(pid=22636): Terminated: ok {rc=0} 22:10:44.533858 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22633): Process ended prematurely: osmo-stp_10.42.42.5(pid=22633) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22633)] [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:10:44.542563 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:10:44.569572 run osmo-hlr_10.42.42.2(pid=22630): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22630)] 22:10:44.617211 run osmo-hlr_10.42.42.2(pid=22630): stdout: | (launched: 2022-12-09_22:10:41.448354) 22:10:44.666114 run osmo-hlr_10.42.42.2(pid=22630): stderr: | 20221209221041624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221041624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221041624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221041624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221041624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221041624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221041637 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221041645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221041645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221041646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:44.715703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22629): Terminating (SIGTERM) 22:10:44.755581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22632): Terminating (SIGTERM) 22:10:44.795195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22635): Terminating (SIGTERM) 22:10:44.834971 --- ParallelTerminationStrategy: PID 22629 died... 22:10:44.853824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22629): Terminated: ok {rc=0} 22:10:44.898424 --- ParallelTerminationStrategy: PID 22632 died... 22:10:44.916707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22632): Terminated: ok {rc=0} 22:10:44.960671 --- ParallelTerminationStrategy: PID 22635 died... 22:10:44.979079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22635): Terminated: ok {rc=0} 22:10:45.062095 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:10:46.378363 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:10:46.389597 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:10:46.433905 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 22:10:46.485390 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 22:10:46.592395 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:10:46.636563 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 22:10:46.685799 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 22:10:47.267350 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 22:10:47.319472 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:47.331341 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:10:47.388641 tst cs_paging_gprs_active.py: using LAC 23997 22:10:47.515801 tst cs_paging_gprs_active.py: using RAC 27 22:10:47.644932 tst cs_paging_gprs_active.py: using CellId 23997 22:10:47.770093 tst cs_paging_gprs_active.py: using BVCI 23998 22:10:47.887014 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:47.898793 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:47.910301 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:47.921781 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:47.933204 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:47.944643 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:47.956218 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:47.967555 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:47.979224 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:10:48.097943 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:10:48.216687 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:10:48.421444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:48.726067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22640): Launched 22:10:48.991524 run iperf3-srv_10.42.42.10(pid=22641): Launched 22:10:49.106684 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:10:49.310492 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:49.614971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22642): Launched 22:10:49.881444 run iperf3-srv_10.42.42.10(pid=22643): Launched 22:10:49.996882 tst cs_paging_gprs_active.py:38: start network... 22:10:50.203207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:50.678255 run create_hlr_db(pid=22644): Launched 22:10:50.795772 bus /gobi_6: Setting Powered False 22:10:51.856066 run create_hlr_db(pid=22644): Terminated: ok {rc=0} 22:10:52.297637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22646): Launched 22:10:52.623669 run osmo-hlr_10.42.42.2(pid=22647): Launched 22:10:52.747327 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:53.302592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22649): Launched 22:10:53.626712 run osmo-stp_10.42.42.5(pid=22650): Launched 22:10:53.750170 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:10:54.308734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22652): Launched 22:10:54.433689 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:10:54.706223 run patchelf(pid=22653): Launched 22:10:54.887899 run osmo-stp_10.42.42.5(pid=22650): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22650)] 22:10:55.025425 run osmo-stp_10.42.42.5(pid=22650): stdout: | (launched: 2022-12-09_22:10:53.568273) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:55.164839 run osmo-stp_10.42.42.5(pid=22650): stderr: | 20221209221053760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221053761 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221053761 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221053761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221053762 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221053762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221053762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:55.303419 run osmo-stp_10.42.42.5(pid=22650): stdout: | (launched: 2022-12-09_22:10:53.568273) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:55.436508 run osmo-stp_10.42.42.5(pid=22650): stderr: | 20221209221053760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221053761 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221053761 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221053761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221053762 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221053762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221053762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:55.594121 run patchelf(pid=22653): Terminating (SIGINT) 22:10:55.776575 run patchelf(pid=22653): Terminated: ok {rc=0} 22:10:55.908243 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22650): Process ended prematurely: osmo-stp_10.42.42.5(pid=22650) [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22650)] [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 22:10:55.918357 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:10:55.946840 run osmo-hlr_10.42.42.2(pid=22647): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22647)] 22:10:55.996922 run osmo-hlr_10.42.42.2(pid=22647): stdout: | (launched: 2022-12-09_22:10:52.564840) 22:10:56.049126 run osmo-hlr_10.42.42.2(pid=22647): stderr: | 20221209221052765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221052765 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221052765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221052765 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221052765 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221052765 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221052778 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221052786 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221052787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221052787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:56.101437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22640): Terminating (SIGTERM) 22:10:56.143509 run iperf3-srv_10.42.42.10(pid=22641): Terminating (SIGTERM) 22:10:56.185669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22642): Terminating (SIGTERM) 22:10:56.227802 run iperf3-srv_10.42.42.10(pid=22643): Terminating (SIGTERM) 22:10:56.269894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22646): Terminating (SIGTERM) 22:10:56.312040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22649): Terminating (SIGTERM) 22:10:56.353881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22652): Terminating (SIGTERM) 22:10:56.396100 --- ParallelTerminationStrategy: PID 22640 died... 22:10:56.416256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22640): Terminated: ok {rc=0} 22:10:56.463359 --- ParallelTerminationStrategy: PID 22641 died... 22:10:56.483094 run iperf3-srv_10.42.42.10(pid=22641): Terminated {rc=256} 22:10:56.529203 --- ParallelTerminationStrategy: PID 22642 died... 22:10:56.548906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22642): Terminated: ok {rc=0} 22:10:56.595066 --- ParallelTerminationStrategy: PID 22643 died... 22:10:56.614470 run iperf3-srv_10.42.42.10(pid=22643): Terminated {rc=256} 22:10:56.660316 --- ParallelTerminationStrategy: PID 22646 died... 22:10:56.679930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22646): Terminated: ok {rc=0} 22:10:56.726567 --- ParallelTerminationStrategy: PID 22649 died... 22:10:56.746280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22649): Terminated: ok {rc=0} 22:10:56.792060 --- ParallelTerminationStrategy: PID 22652 died... 22:10:56.811851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22652): Terminated: ok {rc=0} 22:10:56.899694 bus /gobi_0: Setting Powered False 22:10:57.999911 bus /gobi_0: Setting Powered False 22:10:59.117085 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 22:11:00.264942 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:00.277544 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:11:00.333756 tst iperf3.py: using LAC 23998 22:11:00.454861 tst iperf3.py: using RAC 28 22:11:00.575407 tst iperf3.py: using CellId 23998 22:11:00.696051 tst iperf3.py: using BVCI 23999 22:11:00.807736 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:00.818986 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:00.831758 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:00.860178 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:00.883789 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:00.897519 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:00.922117 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:00.934310 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:00.955471 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:01.096061 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:11:01.329718 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:01.727690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22654): Launched 22:11:02.079591 run iperf3-srv_10.42.42.10(pid=22655): Launched 22:11:02.230803 tst iperf3.py:8: start network... 22:11:02.438868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:02.909832 run create_hlr_db(pid=22656): Launched 22:11:03.026635 bus /gobi_6: Setting Powered False 22:11:04.086866 run create_hlr_db(pid=22656): Terminated: ok {rc=0} 22:11:04.507765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22658): Launched 22:11:04.810708 run osmo-hlr_10.42.42.2(pid=22659): Launched 22:11:04.926462 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:05.458448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22661): Launched 22:11:05.761218 run osmo-stp_10.42.42.5(pid=22662): Launched 22:11:05.877214 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:06.398608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22664): Launched 22:11:06.515463 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:06.771269 run patchelf(pid=22665): Launched 22:11:06.940737 run osmo-stp_10.42.42.5(pid=22662): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22662)] 22:11:07.070590 run osmo-stp_10.42.42.5(pid=22662): stdout: | (launched: 2022-12-09_22:11:05.706278) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:07.200919 run osmo-stp_10.42.42.5(pid=22662): stderr: | 20221209221105878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221105878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221105878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221105879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221105879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221105879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221105879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:07.332677 run osmo-stp_10.42.42.5(pid=22662): stdout: | (launched: 2022-12-09_22:11:05.706278) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:07.456611 run osmo-stp_10.42.42.5(pid=22662): stderr: | 20221209221105878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221105878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221105878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221105879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221105879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221105879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221105879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:07.604109 run patchelf(pid=22665): Terminating (SIGINT) 22:11:07.776072 run patchelf(pid=22665): Terminated: ok {rc=0} 22:11:07.899725 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22662): Process ended prematurely: osmo-stp_10.42.42.5(pid=22662) [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22662)] [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 22:11:07.909242 tst iperf3.py:8: Test FAILED (7.7 sec) 22:11:07.937149 run osmo-hlr_10.42.42.2(pid=22659): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22659)] 22:11:07.984907 run osmo-hlr_10.42.42.2(pid=22659): stdout: | (launched: 2022-12-09_22:11:04.755581) 22:11:08.034401 run osmo-hlr_10.42.42.2(pid=22659): stderr: | 20221209221104930 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221104930 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221104930 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221104930 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221104930 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221104930 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221104942 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221104954 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221104954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221104954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:08.084275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22654): Terminating (SIGTERM) 22:11:08.124196 run iperf3-srv_10.42.42.10(pid=22655): Terminating (SIGTERM) 22:11:08.163848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22658): Terminating (SIGTERM) 22:11:08.203736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22661): Terminating (SIGTERM) 22:11:08.243691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22664): Terminating (SIGTERM) 22:11:08.283685 --- ParallelTerminationStrategy: PID 22654 died... 22:11:08.302780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22654): Terminated: ok {rc=0} 22:11:08.347262 --- ParallelTerminationStrategy: PID 22655 died... 22:11:08.365927 run iperf3-srv_10.42.42.10(pid=22655): Terminated {rc=256} 22:11:08.409999 --- ParallelTerminationStrategy: PID 22658 died... 22:11:08.428577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22658): Terminated: ok {rc=0} 22:11:08.472813 --- ParallelTerminationStrategy: PID 22661 died... 22:11:08.491822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22661): Terminated: ok {rc=0} 22:11:08.536029 --- ParallelTerminationStrategy: PID 22664 died... 22:11:08.554469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22664): Terminated: ok {rc=0} 22:11:08.640875 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 22:11:09.788690 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:09.800558 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:11:09.857124 tst iperf3m4.py: using LAC 23999 22:11:09.975297 tst iperf3m4.py: using RAC 29 22:11:10.091782 tst iperf3m4.py: using CellId 23999 22:11:10.209291 tst iperf3m4.py: using BVCI 24000 22:11:10.318922 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:10.330232 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:10.341253 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:10.352546 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:10.363851 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:10.375063 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:10.386447 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:10.397675 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:10.408893 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:10.531230 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:10.652807 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:10.774885 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:10.897347 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:11:11.118683 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:11.443454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22666): Launched 22:11:11.725313 run iperf3-srv_10.42.42.10(pid=22667): Launched 22:11:11.847330 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:11:12.067132 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:12.392397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22668): Launched 22:11:12.674025 run iperf3-srv_10.42.42.10(pid=22669): Launched 22:11:12.796260 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:11:13.015755 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:13.341366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22670): Launched 22:11:13.625099 run iperf3-srv_10.42.42.10(pid=22671): Launched 22:11:13.747004 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:11:13.965477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:14.290702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22672): Launched 22:11:14.572653 run iperf3-srv_10.42.42.10(pid=22673): Launched 22:11:14.694600 tst iperf3m4.py:8: start network... 22:11:14.912519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:15.405588 run create_hlr_db(pid=22674): Launched 22:11:15.523931 bus /gobi_6: Setting Powered False 22:11:16.597282 run create_hlr_db(pid=22674): Terminated: ok {rc=0} 22:11:17.095851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22676): Launched 22:11:17.431387 run osmo-hlr_10.42.42.2(pid=22677): Launched 22:11:17.556489 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:18.118620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22679): Launched 22:11:18.441586 run osmo-stp_10.42.42.5(pid=22680): Launched 22:11:18.566130 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:19.127597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22682): Launched 22:11:19.251685 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:19.524222 run patchelf(pid=22683): Launched 22:11:19.704790 run osmo-stp_10.42.42.5(pid=22680): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22680)] 22:11:19.842254 run osmo-stp_10.42.42.5(pid=22680): stdout: | (launched: 2022-12-09_22:11:18.383303) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:19.980803 run osmo-stp_10.42.42.5(pid=22680): stderr: | 20221209221118574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221118574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221118574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221118575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221118578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221118578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221118578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:20.119853 run osmo-stp_10.42.42.5(pid=22680): stdout: | (launched: 2022-12-09_22:11:18.383303) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:20.252422 run osmo-stp_10.42.42.5(pid=22680): stderr: | 20221209221118574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221118574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221118574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221118575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221118578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221118578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221118578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:20.409478 run patchelf(pid=22683): Terminating (SIGINT) 22:11:20.592756 run patchelf(pid=22683): Terminated: ok {rc=0} 22:11:20.724376 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22680): Process ended prematurely: osmo-stp_10.42.42.5(pid=22680) [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22680)] [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 22:11:20.734630 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:11:20.763307 run osmo-hlr_10.42.42.2(pid=22677): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22677)] 22:11:20.813216 run osmo-hlr_10.42.42.2(pid=22677): stdout: | (launched: 2022-12-09_22:11:17.372755) 22:11:20.864717 run osmo-hlr_10.42.42.2(pid=22677): stderr: | 20221209221117571 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221117571 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221117571 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221117571 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221117571 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221117571 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221117588 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221117598 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221117598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221117598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:20.916648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22666): Terminating (SIGTERM) 22:11:20.958378 run iperf3-srv_10.42.42.10(pid=22667): Terminating (SIGTERM) 22:11:21.000017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22668): Terminating (SIGTERM) 22:11:21.042238 run iperf3-srv_10.42.42.10(pid=22669): Terminating (SIGTERM) 22:11:21.084503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22670): Terminating (SIGTERM) 22:11:21.126607 run iperf3-srv_10.42.42.10(pid=22671): Terminating (SIGTERM) 22:11:21.168309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22672): Terminating (SIGTERM) 22:11:21.210153 run iperf3-srv_10.42.42.10(pid=22673): Terminating (SIGTERM) 22:11:21.251753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22676): Terminating (SIGTERM) 22:11:21.293656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22679): Terminating (SIGTERM) 22:11:21.335420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22682): Terminating (SIGTERM) 22:11:21.377410 --- ParallelTerminationStrategy: PID 22666 died... 22:11:21.397367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22666): Terminated: ok {rc=0} 22:11:21.443309 --- ParallelTerminationStrategy: PID 22667 died... 22:11:21.462886 run iperf3-srv_10.42.42.10(pid=22667): Terminated {rc=256} 22:11:21.508895 --- ParallelTerminationStrategy: PID 22668 died... 22:11:21.528781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22668): Terminated: ok {rc=0} 22:11:21.574783 --- ParallelTerminationStrategy: PID 22669 died... 22:11:21.594438 run iperf3-srv_10.42.42.10(pid=22669): Terminated {rc=256} 22:11:21.640141 --- ParallelTerminationStrategy: PID 22670 died... 22:11:21.659626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22670): Terminated: ok {rc=0} 22:11:21.705514 --- ParallelTerminationStrategy: PID 22671 died... 22:11:21.725047 run iperf3-srv_10.42.42.10(pid=22671): Terminated {rc=256} 22:11:21.770844 --- ParallelTerminationStrategy: PID 22672 died... 22:11:21.790454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22672): Terminated: ok {rc=0} 22:11:21.836310 --- ParallelTerminationStrategy: PID 22673 died... 22:11:21.855845 run iperf3-srv_10.42.42.10(pid=22673): Terminated {rc=256} 22:11:21.901957 --- ParallelTerminationStrategy: PID 22676 died... 22:11:21.921505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22676): Terminated: ok {rc=0} 22:11:21.967362 --- ParallelTerminationStrategy: PID 22679 died... 22:11:21.986782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22679): Terminated: ok {rc=0} 22:11:22.032778 --- ParallelTerminationStrategy: PID 22682 died... 22:11:22.052410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22682): Terminated: ok {rc=0} 22:11:22.140397 bus /gobi_4: Setting Powered False 22:11:23.239050 bus /gobi_4: Setting Powered False 22:11:24.356158 bus /gobi_1: Setting Powered False 22:11:25.455816 bus /gobi_1: Setting Powered False 22:11:26.571213 bus /gobi_0: Setting Powered False 22:11:27.666446 bus /gobi_0: Setting Powered False 22:11:28.780389 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 22:11:29.882507 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:29.894826 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:11:29.948688 tst ping.py: using LAC 24000 22:11:30.073393 tst ping.py: using RAC 30 22:11:30.197555 tst ping.py: using CellId 24000 22:11:30.317607 tst ping.py: using BVCI 24001 22:11:30.427619 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:30.438998 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:30.450427 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:30.462400 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:30.474274 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:30.486215 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:30.498151 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:30.509801 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:30.630719 tst ping.py:19: start network... 22:11:30.860103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:31.370762 run create_hlr_db(pid=22684): Launched 22:11:31.535056 bus /gobi_6: Setting Powered False 22:11:32.594608 run create_hlr_db(pid=22684): Terminated: ok {rc=0} 22:11:33.042273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22686): Launched 22:11:33.360648 run osmo-hlr_10.42.42.2(pid=22687): Launched 22:11:33.482266 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:34.034594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22689): Launched 22:11:34.351752 run osmo-stp_10.42.42.5(pid=22690): Launched 22:11:34.472772 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:35.020030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22692): Launched 22:11:35.142334 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:35.410272 run patchelf(pid=22693): Launched 22:11:35.587213 run osmo-stp_10.42.42.5(pid=22690): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22690)] 22:11:35.722193 run osmo-stp_10.42.42.5(pid=22690): stdout: | (launched: 2022-12-09_22:11:34.294390) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:35.858613 run osmo-stp_10.42.42.5(pid=22690): stderr: | 20221209221134485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221134485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221134485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221134486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221134486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221134486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221134486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:35.995538 run osmo-stp_10.42.42.5(pid=22690): stdout: | (launched: 2022-12-09_22:11:34.294390) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:36.126317 run osmo-stp_10.42.42.5(pid=22690): stderr: | 20221209221134485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221134485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221134485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221134486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221134486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221134486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221134486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:36.280520 run patchelf(pid=22693): Terminating (SIGINT) 22:11:36.460464 run patchelf(pid=22693): Terminated: ok {rc=0} 22:11:36.589851 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22690): Process ended prematurely: osmo-stp_10.42.42.5(pid=22690) [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22690)] [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 22:11:36.599328 tst ping.py:22: Test FAILED (6.7 sec) 22:11:36.627550 run osmo-hlr_10.42.42.2(pid=22687): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22687)] 22:11:36.677401 run osmo-hlr_10.42.42.2(pid=22687): stdout: | (launched: 2022-12-09_22:11:33.303274) 22:11:36.729292 run osmo-hlr_10.42.42.2(pid=22687): stderr: | 20221209221133500 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221133500 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221133500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221133501 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221133501 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221133501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221133511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221133520 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221133520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221133520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:36.781623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22686): Terminating (SIGTERM) 22:11:36.823552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22689): Terminating (SIGTERM) 22:11:36.865661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22692): Terminating (SIGTERM) 22:11:36.907878 --- ParallelTerminationStrategy: PID 22686 died... 22:11:36.928111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22686): Terminated: ok {rc=0} 22:11:36.974717 --- ParallelTerminationStrategy: PID 22689 died... 22:11:36.994739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22689): Terminated: ok {rc=0} 22:11:37.040834 --- ParallelTerminationStrategy: PID 22692 died... 22:11:37.061016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22692): Terminated: ok {rc=0} 22:11:37.150254 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 22:11:38.239589 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:38.252474 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:11:38.307707 tst ping_idle_ping.py: using LAC 24001 22:11:38.433433 tst ping_idle_ping.py: using RAC 31 22:11:38.557756 tst ping_idle_ping.py: using CellId 24001 22:11:38.682469 tst ping_idle_ping.py: using BVCI 24002 22:11:38.799036 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:38.810808 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:38.822408 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:38.833993 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:38.845459 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:38.856853 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:38.868512 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:38.880007 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:38.997694 tst ping_idle_ping.py:24: start network... 22:11:39.214847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:39.709504 run create_hlr_db(pid=22694): Launched 22:11:39.840244 bus /gobi_6: Setting Powered False 22:11:40.900827 run create_hlr_db(pid=22694): Terminated: ok {rc=0} 22:11:41.328442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22696): Launched 22:11:41.628203 run osmo-hlr_10.42.42.2(pid=22697): Launched 22:11:41.743378 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:42.267643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22699): Launched 22:11:42.567287 run osmo-stp_10.42.42.5(pid=22700): Launched 22:11:42.682039 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:43.199210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22702): Launched 22:11:43.314275 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:43.565239 run patchelf(pid=22703): Launched 22:11:43.731778 run osmo-stp_10.42.42.5(pid=22700): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22700)] 22:11:43.858738 run osmo-stp_10.42.42.5(pid=22700): stdout: | (launched: 2022-12-09_22:11:42.512910) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:43.987315 run osmo-stp_10.42.42.5(pid=22700): stderr: | 20221209221142682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221142682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221142682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221142683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221142683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221142683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221142683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:44.116274 run osmo-stp_10.42.42.5(pid=22700): stdout: | (launched: 2022-12-09_22:11:42.512910) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:44.238578 run osmo-stp_10.42.42.5(pid=22700): stderr: | 20221209221142682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221142682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221142682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221142683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221142683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221142683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221142683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:44.383591 run patchelf(pid=22703): Terminating (SIGINT) 22:11:44.552939 run patchelf(pid=22703): Terminated: ok {rc=0} 22:11:44.674951 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22700): Process ended prematurely: osmo-stp_10.42.42.5(pid=22700) [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22700)] [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 22:11:44.683899 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:11:44.711234 run osmo-hlr_10.42.42.2(pid=22697): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22697)] 22:11:44.759294 run osmo-hlr_10.42.42.2(pid=22697): stdout: | (launched: 2022-12-09_22:11:41.573843) 22:11:44.809353 run osmo-hlr_10.42.42.2(pid=22697): stderr: | 20221209221141747 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221141747 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221141747 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221141747 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221141747 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221141747 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221141759 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221141768 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221141768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221141768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:44.859377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22696): Terminating (SIGTERM) 22:11:44.899616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22699): Terminating (SIGTERM) 22:11:44.939800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22702): Terminating (SIGTERM) 22:11:44.980101 --- ParallelTerminationStrategy: PID 22696 died... 22:11:44.999356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22696): Terminated: ok {rc=0} 22:11:45.044146 --- ParallelTerminationStrategy: PID 22699 died... 22:11:45.062898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22699): Terminated: ok {rc=0} 22:11:45.107740 --- ParallelTerminationStrategy: PID 22702 died... 22:11:45.126478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22702): Terminated: ok {rc=0} 22:11:45.210532 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:11:46.576549 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:11:46.584289 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:11:46.620420 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:11:46.657195 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:11:46.717698 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:11:46.759164 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:11:46.802094 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:11:47.343721 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2365 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:11:47.350030 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:47.362283 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:11:47.435870 tst switch_tch_pdch.py: using LAC 24002 22:11:47.563479 tst switch_tch_pdch.py: using RAC 32 22:11:47.687751 tst switch_tch_pdch.py: using CellId 24002 22:11:47.813062 tst switch_tch_pdch.py: using BVCI 24003 22:11:47.928470 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:47.940171 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:47.951562 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:47.963451 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:47.975295 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:47.987151 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:47.999134 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:48.010965 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:11:48.128481 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:11:48.244562 tst switch_tch_pdch.py:51: start network... 22:11:48.444901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:48.905038 run create_hlr_db(pid=22708): Launched 22:11:49.019244 bus /gobi_6: Setting Powered False 22:11:50.078091 run create_hlr_db(pid=22708): Terminated: ok {rc=0} 22:11:50.493215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22710): Launched 22:11:50.789711 run osmo-hlr_10.42.42.2(pid=22711): Launched 22:11:50.903209 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:51.430215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22713): Launched 22:11:51.727504 run osmo-stp_10.42.42.5(pid=22714): Launched 22:11:51.841739 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:52.354797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22716): Launched 22:11:52.469053 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:52.720239 run patchelf(pid=22717): Launched 22:11:52.886698 run osmo-stp_10.42.42.5(pid=22714): ERR: Terminated: ERROR {rc=1} [trial-2365↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22714)] 22:11:53.013674 run osmo-stp_10.42.42.5(pid=22714): stdout: | (launched: 2022-12-09_22:11:51.673493) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:53.142185 run osmo-stp_10.42.42.5(pid=22714): stderr: | 20221209221151844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221151844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221151844 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221151844 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221151845 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221151845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221151845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:53.270870 run osmo-stp_10.42.42.5(pid=22714): stdout: | (launched: 2022-12-09_22:11:51.673493) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:53.393112 run osmo-stp_10.42.42.5(pid=22714): stderr: | 20221209221151844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221151844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221151844 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221151844 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221151845 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221151845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221151845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:53.537715 run patchelf(pid=22717): Terminating (SIGINT) 22:11:53.706733 run patchelf(pid=22717): Terminated: ok {rc=0} 22:11:53.828423 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22714): Process ended prematurely: osmo-stp_10.42.42.5(pid=22714) [trial-2365↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22714)] [trial-2365↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:11:53.837331 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 22:11:53.864498 run osmo-hlr_10.42.42.2(pid=22711): ERR: Terminated: ERROR {rc=237} [trial-2365↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22711)] 22:11:53.912937 run osmo-hlr_10.42.42.2(pid=22711): stdout: | (launched: 2022-12-09_22:11:50.735960) 22:11:53.963194 run osmo-hlr_10.42.42.2(pid=22711): stderr: | 20221209221150908 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221150908 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221150908 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221150908 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221150908 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221150908 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221150920 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221150928 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221150928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221150928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:54.013852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22710): Terminating (SIGTERM) 22:11:54.054020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22713): Terminating (SIGTERM) 22:11:54.094080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22716): Terminating (SIGTERM) 22:11:54.134408 --- ParallelTerminationStrategy: PID 22710 died... 22:11:54.153479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22710): Terminated: ok {rc=0} 22:11:54.198314 --- ParallelTerminationStrategy: PID 22713 died... 22:11:54.216848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22713): Terminated: ok {rc=0} 22:11:54.261803 --- ParallelTerminationStrategy: PID 22716 died... 22:11:54.280377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22716): Terminated: ok {rc=0} 22:11:54.363783 bus /gobi_0: Setting Powered False 22:11:55.462571 bus /gobi_0: Setting Powered False 22:11:56.581345 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:11:57.830931 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:11:57.836502 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:11:57.869930 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:11:57.904087 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:11:57.956669 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:11:57.989574 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:11:58.023629 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:11:58.578162 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2365 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:11:58.583669 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:11:58.594573 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:11:58.663574 tst switch_tch_pdch.py: using LAC 24003 22:11:58.780129 tst switch_tch_pdch.py: using RAC 33 22:11:58.906315 tst switch_tch_pdch.py: using CellId 24003 22:11:59.032469 tst switch_tch_pdch.py: using BVCI 24004 22:11:59.148525 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:11:59.160025 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:11:59.171375 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:11:59.182592 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:11:59.193821 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:11:59.204833 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:11:59.216101 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:11:59.227132 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:11:59.345624 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:11:59.464937 tst switch_tch_pdch.py:51: start network... 22:11:59.679576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:00.143163 run create_hlr_db(pid=22722): Launched 22:12:00.272710 bus /gobi_6: Setting Powered False 22:12:01.346991 run create_hlr_db(pid=22722): Terminated: ok {rc=0} 22:12:01.809637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22724): Launched 22:12:02.123681 run osmo-hlr_10.42.42.2(pid=22725): Launched 22:12:02.248133 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:02.796270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22727): Launched 22:12:03.092904 run osmo-stp_10.42.42.5(pid=22728): Launched 22:12:03.205981 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:12:03.694219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22730): Launched 22:12:03.808208 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:12:04.058412 run patchelf(pid=22731): Launched 22:12:04.224119 run osmo-stp_10.42.42.5(pid=22728): ERR: Terminated: ERROR {rc=1} [trial-2365↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22728)] 22:12:04.349952 run osmo-stp_10.42.42.5(pid=22728): stdout: | (launched: 2022-12-09_22:12:03.039269) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:04.477623 run osmo-stp_10.42.42.5(pid=22728): stderr: | 20221209221203207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221203207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221203207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221203207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221203210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221203210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221203210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:04.605442 run osmo-stp_10.42.42.5(pid=22728): stdout: | (launched: 2022-12-09_22:12:03.039269) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:04.726849 run osmo-stp_10.42.42.5(pid=22728): stderr: | 20221209221203207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221203207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221203207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221203207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221203210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221203210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221203210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:04.870555 run patchelf(pid=22731): Terminating (SIGINT) 22:12:05.038998 run patchelf(pid=22731): Terminated: ok {rc=0} 22:12:05.159895 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22728): Process ended prematurely: osmo-stp_10.42.42.5(pid=22728) [trial-2365↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22728)] [trial-2365↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:12:05.168807 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 22:12:05.195861 run osmo-hlr_10.42.42.2(pid=22725): ERR: Terminated: ERROR {rc=237} [trial-2365↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22725)] 22:12:05.243528 run osmo-hlr_10.42.42.2(pid=22725): stdout: | (launched: 2022-12-09_22:12:02.066357) 22:12:05.292815 run osmo-hlr_10.42.42.2(pid=22725): stderr: | 20221209221202350 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221202350 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221202350 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221202350 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221202350 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221202350 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221202364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221202374 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221202374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221202374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:05.342665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22724): Terminating (SIGTERM) 22:12:05.382231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22727): Terminating (SIGTERM) 22:12:05.422243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22730): Terminating (SIGTERM) 22:12:05.461900 --- ParallelTerminationStrategy: PID 22724 died... 22:12:05.480617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22724): Terminated: ok {rc=0} 22:12:05.525118 --- ParallelTerminationStrategy: PID 22727 died... 22:12:05.543515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22727): Terminated: ok {rc=0} 22:12:05.588172 --- ParallelTerminationStrategy: PID 22730 died... 22:12:05.606673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22730): Terminated: ok {rc=0} 22:12:05.691543 bus /gobi_0: Setting Powered False 22:12:06.792164 bus /gobi_0: Setting Powered False 22:12:07.910412 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 22:12:09.168538 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:09.172887 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:12:09.208326 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 22:12:09.215485 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 22:12:09.269310 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:12:09.304423 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 22:12:09.311496 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 22:12:09.849956 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 22:12:09.855307 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 22:12:09.866777 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:12:09.917066 tst mo_mt_sms.py: using LAC 24004 22:12:10.041984 tst mo_mt_sms.py: using RAC 34 22:12:10.168780 tst mo_mt_sms.py: using CellId 24004 22:12:10.292679 tst mo_mt_sms.py: using BVCI 24005 22:12:10.410072 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:12:10.526762 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:12:10.644249 tst mo_mt_sms.py:9: start nitb and bts... 22:12:10.859449 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:12:11.505579 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22736): Launched 22:12:11.825416 run osmo-nitb_10.42.42.2(pid=22737): Launched 22:12:12.003042 run osmo-nitb_10.42.42.2(pid=22737): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22737)] 22:12:12.147211 run osmo-nitb_10.42.42.2(pid=22737): stdout: | (launched: 2022-12-09_22:12:11.767946) 22:12:12.292292 run osmo-nitb_10.42.42.2(pid=22737): stderr: | (launched: 2022-12-09_22:12:11.815372) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:12:12.437572 run osmo-nitb_10.42.42.2(pid=22737): stdout: | (launched: 2022-12-09_22:12:11.767946) 22:12:12.576751 run osmo-nitb_10.42.42.2(pid=22737): stderr: | (launched: 2022-12-09_22:12:11.815372) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22737): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22737) [trial-2365↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22737)] 22:12:12.946137 tst osmo-nitb_10.42.42.2(pid=22737): stdout: | (launched: 2022-12-09_22:12:11.767946) 22:12:13.075097 tst osmo-nitb_10.42.42.2(pid=22737): stderr: | (launched: 2022-12-09_22:12:11.815372) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:12:13.227310 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=22737): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22737) [trial-2365↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22737)] [trial-2365↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 22:12:13.236371 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 22:12:13.243611 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22736): Terminating (SIGTERM) 22:12:13.454226 --- ParallelTerminationStrategy: PID 22736 died... 22:12:13.475577 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22736): Terminated: ok {rc=0} 22:12:13.563080 bus /sierra_3: Setting Powered False 22:12:14.663373 bus /sierra_3: Setting Powered False 22:12:15.782984 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 sms:trx-sysmocell5000 --------------------------------------------------------------------- 22:12:17.013684 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:17.018879 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:12:17.061410 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 22:12:17.099060 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 22:12:17.161472 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:12:17.203096 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 22:12:17.231885 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 22:12:17.772781 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 22:12:17.778211 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:17.789719 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:12:17.841889 tst mo_mt_sms.py: using LAC 24005 22:12:17.972673 tst mo_mt_sms.py: using RAC 35 22:12:18.097891 tst mo_mt_sms.py: using CellId 24005 22:12:18.225123 tst mo_mt_sms.py: using BVCI 24006 22:12:18.342232 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:18.353556 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:18.364631 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:18.376228 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:18.387767 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:18.399250 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:12:18.515449 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:12:18.635104 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:19.128649 run create_hlr_db(pid=22741): Launched 22:12:19.258968 bus /sierra_2: Setting Powered False 22:12:20.322397 run create_hlr_db(pid=22741): Terminated: ok {rc=0} 22:12:20.748856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22743): Launched 22:12:21.047293 run osmo-hlr_10.42.42.2(pid=22744): Launched 22:12:21.161532 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:21.684016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22746): Launched 22:12:21.981958 run osmo-stp_10.42.42.5(pid=22747): Launched 22:12:22.094820 run osmo-msc_10.42.42.6: Starting osmo-msc 22:12:22.630766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22749): Launched 22:12:22.927801 run osmo-msc_10.42.42.6(pid=22750): Launched 22:12:23.094092 run osmo-stp_10.42.42.5(pid=22747): ERR: Terminated: ERROR {rc=1} [trial-2365↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22747)] 22:12:23.219459 run osmo-stp_10.42.42.5(pid=22747): stdout: | (launched: 2022-12-09_22:12:21.927301) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:23.345250 run osmo-stp_10.42.42.5(pid=22747): stderr: | 20221209221222096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221222096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221222096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221222097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221222099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221222099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221222099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:23.468836 run osmo-stp_10.42.42.5(pid=22747): stdout: | (launched: 2022-12-09_22:12:21.927301) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:23.587281 run osmo-stp_10.42.42.5(pid=22747): stderr: | 20221209221222096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221222096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221222096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221222097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221222099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221222099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221222099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:23.728792 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=22747): Process ended prematurely: osmo-stp_10.42.42.5(pid=22747) [trial-2365↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22747)] [trial-2365↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 22:12:23.737198 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 22:12:23.763626 run osmo-hlr_10.42.42.2(pid=22744): ERR: Terminated: ERROR {rc=237} [trial-2365↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22744)] 22:12:23.812011 run osmo-hlr_10.42.42.2(pid=22744): stdout: | (launched: 2022-12-09_22:12:20.993324) 22:12:23.861583 run osmo-hlr_10.42.42.2(pid=22744): stderr: | 20221209221221167 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221221167 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221221167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221221167 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221221167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221221167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221221180 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221221190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221221190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221221190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:23.930699 run osmo-msc_10.42.42.6(pid=22750): ERR: Terminated: ERROR {rc=2} [trial-2365↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22750)] 22:12:23.978475 run osmo-msc_10.42.42.6(pid=22750): stdout: | (launched: 2022-12-09_22:12:22.873425) 22:12:24.027981 run osmo-msc_10.42.42.6(pid=22750): stderr: | 20221209221223147 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221223147 DLGLOBAL DEBUG validating counter group 0x7f3468a8ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221223147 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221223148 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221223148 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221223148 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221223151 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221223152 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221223152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221223152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:12:24.077908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22743): Terminating (SIGTERM) 22:12:24.117558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22746): Terminating (SIGTERM) 22:12:24.157342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22749): Terminating (SIGTERM) 22:12:24.197958 --- ParallelTerminationStrategy: PID 22743 died... 22:12:24.217025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22743): Terminated: ok {rc=0} 22:12:24.261624 --- ParallelTerminationStrategy: PID 22746 died... 22:12:24.280082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22746): Terminated: ok {rc=0} 22:12:24.324424 --- ParallelTerminationStrategy: PID 22749 died... 22:12:24.343134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22749): Terminated: ok {rc=0} 22:12:24.429628 bus /sierra_3: Setting Powered False 22:12:25.529370 bus /sierra_3: Setting Powered False 22:12:26.646703 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 22:12:27.878231 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:27.882133 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:12:27.916856 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 22:12:27.923840 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 22:12:27.960205 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:12:27.995874 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 22:12:28.002982 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 22:12:28.518965 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2365 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 22:12:28.524136 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 22:12:28.535076 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:12:28.584151 tst assert_extension.py: using LAC 24006 22:12:28.700181 tst assert_extension.py: using RAC 36 22:12:28.816373 tst assert_extension.py: using CellId 24006 22:12:28.932691 tst assert_extension.py: using BVCI 24007 22:12:29.039462 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 22:12:29.157158 tst assert_extension.py:10: start nitb and bts... 22:12:29.371699 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:12:30.021238 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22755): Launched 22:12:30.338374 run osmo-nitb_10.42.42.2(pid=22756): Launched 22:12:30.514293 run osmo-nitb_10.42.42.2(pid=22756): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22756)] 22:12:30.657451 run osmo-nitb_10.42.42.2(pid=22756): stdout: | (launched: 2022-12-09_22:12:30.281022) 22:12:30.801988 run osmo-nitb_10.42.42.2(pid=22756): stderr: | (launched: 2022-12-09_22:12:30.328291) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:12:30.955062 run osmo-nitb_10.42.42.2(pid=22756): stdout: | (launched: 2022-12-09_22:12:30.281022) 22:12:31.091059 run osmo-nitb_10.42.42.2(pid=22756): stderr: | (launched: 2022-12-09_22:12:30.328291) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22756): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22756) [trial-2365↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22756)] 22:12:31.457648 tst osmo-nitb_10.42.42.2(pid=22756): stdout: | (launched: 2022-12-09_22:12:30.281022) 22:12:31.588378 tst osmo-nitb_10.42.42.2(pid=22756): stderr: | (launched: 2022-12-09_22:12:30.328291) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:12:31.744382 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=22756): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22756) [trial-2365↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22756)] [trial-2365↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 22:12:31.754368 tst assert_extension.py:12: Test FAILED (3.2 sec) 22:12:31.762313 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22755): Terminating (SIGTERM) 22:12:31.975518 --- ParallelTerminationStrategy: PID 22755 died... 22:12:31.997928 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22755): Terminated: ok {rc=0} 22:12:32.087590 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 22:12:33.268620 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:33.272645 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:12:33.306833 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 22:12:33.334154 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 22:12:33.370551 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:12:33.405632 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 22:12:33.433227 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 22:12:33.966615 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2365 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 22:12:33.972083 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:33.983417 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:12:34.040006 tst assert_extension.py: using LAC 24007 22:12:34.164181 tst assert_extension.py: using RAC 37 22:12:34.287489 tst assert_extension.py: using CellId 24007 22:12:34.413214 tst assert_extension.py: using BVCI 24008 22:12:34.527644 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:34.538794 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:34.549803 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:34.560627 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:34.571553 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:34.582815 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 22:12:34.701590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:35.161360 run create_hlr_db(pid=22762): Launched 22:12:35.276148 bus /sierra_2: Setting Powered False 22:12:36.336324 run create_hlr_db(pid=22762): Terminated: ok {rc=0} 22:12:36.752268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22764): Launched 22:12:37.049339 run osmo-hlr_10.42.42.2(pid=22765): Launched 22:12:37.162977 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:37.788428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22767): Launched 22:12:38.081335 run osmo-stp_10.42.42.5(pid=22768): Launched 22:12:38.193230 run osmo-msc_10.42.42.6: Starting osmo-msc 22:12:38.721707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22770): Launched 22:12:39.014317 run osmo-msc_10.42.42.6(pid=22771): Launched 22:12:39.179986 run osmo-stp_10.42.42.5(pid=22768): ERR: Terminated: ERROR {rc=1} [trial-2365↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22768)] 22:12:39.304470 run osmo-stp_10.42.42.5(pid=22768): stdout: | (launched: 2022-12-09_22:12:38.028198) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:39.429706 run osmo-stp_10.42.42.5(pid=22768): stderr: | 20221209221238197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221238198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221238198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221238198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221238199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221238199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221238199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:39.552280 run osmo-stp_10.42.42.5(pid=22768): stdout: | (launched: 2022-12-09_22:12:38.028198) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:39.669616 run osmo-stp_10.42.42.5(pid=22768): stderr: | 20221209221238197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221238198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221238198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221238198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221238199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221238199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221238199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:39.810498 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=22768): Process ended prematurely: osmo-stp_10.42.42.5(pid=22768) [trial-2365↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22768)] [trial-2365↪ussd:trx-sysmocell5000↪assert_extension.py:17] 22:12:39.818947 tst assert_extension.py:17: Test FAILED (5.8 sec) 22:12:39.845436 run osmo-hlr_10.42.42.2(pid=22765): ERR: Terminated: ERROR {rc=237} [trial-2365↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22765)] 22:12:39.893845 run osmo-hlr_10.42.42.2(pid=22765): stdout: | (launched: 2022-12-09_22:12:36.995529) 22:12:39.943597 run osmo-hlr_10.42.42.2(pid=22765): stderr: | 20221209221237173 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221237173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221237173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221237173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221237173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221237173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221237186 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221237194 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221237194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221237194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:40.012482 run osmo-msc_10.42.42.6(pid=22771): ERR: Terminated: ERROR {rc=2} [trial-2365↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22771)] 22:12:40.061090 run osmo-msc_10.42.42.6(pid=22771): stdout: | (launched: 2022-12-09_22:12:38.961074) 22:12:40.110569 run osmo-msc_10.42.42.6(pid=22771): stderr: | 20221209221239231 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221239231 DLGLOBAL DEBUG validating counter group 0x7f23eb762c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221239232 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221239232 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221239232 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221239232 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221239234 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221239234 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221239234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221239234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:12:40.160563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22764): Terminating (SIGTERM) 22:12:40.200469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22767): Terminating (SIGTERM) 22:12:40.240431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22770): Terminating (SIGTERM) 22:12:40.280691 --- ParallelTerminationStrategy: PID 22764 died... 22:12:40.299923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22764): Terminated: ok {rc=0} 22:12:40.344479 --- ParallelTerminationStrategy: PID 22767 died... 22:12:40.363064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22767): Terminated: ok {rc=0} 22:12:40.407180 --- ParallelTerminationStrategy: PID 22770 died... 22:12:40.425733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22770): Terminated: ok {rc=0} 22:12:40.512018 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:12:41.724185 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:41.732198 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:12:41.767230 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:12:41.794692 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:12:41.846770 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:12:41.881135 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:12:41.908150 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:12:42.457764 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:12:42.506959 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:42.518245 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:12:42.588400 tst mo_mt_call.py: using LAC 24008 22:12:42.706970 tst mo_mt_call.py: using RAC 38 22:12:42.829192 tst mo_mt_call.py: using CellId 24008 22:12:42.945660 tst mo_mt_call.py: using BVCI 24009 22:12:43.053100 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:43.064025 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:43.074921 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:43.086252 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:43.097554 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:43.108602 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:12:43.226909 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:12:43.340939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:43.805081 run create_hlr_db(pid=22776): Launched 22:12:43.919762 bus /sierra_2: Setting Powered False 22:12:44.979161 run create_hlr_db(pid=22776): Terminated: ok {rc=0} 22:12:45.424795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22778): Launched 22:12:45.744244 run osmo-hlr_10.42.42.2(pid=22779): Launched 22:12:45.916268 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:46.565317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22781): Launched 22:12:46.897680 run osmo-stp_10.42.42.5(pid=22782): Launched 22:12:47.150649 run osmo-msc_10.42.42.6: Starting osmo-msc 22:12:47.801740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22784): Launched 22:12:48.123728 run osmo-msc_10.42.42.6(pid=22785): Launched 22:12:48.302569 run osmo-stp_10.42.42.5(pid=22782): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22782)] 22:12:48.437644 run osmo-stp_10.42.42.5(pid=22782): stdout: | (launched: 2022-12-09_22:12:46.832188) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:48.573472 run osmo-stp_10.42.42.5(pid=22782): stderr: | 20221209221247162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221247162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221247162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221247163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221247169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221247169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221247169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:48.708446 run osmo-stp_10.42.42.5(pid=22782): stdout: | (launched: 2022-12-09_22:12:46.832188) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:48.835808 run osmo-stp_10.42.42.5(pid=22782): stderr: | 20221209221247162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221247162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221247162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221247163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221247169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221247169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221247169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:48.988709 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22782): Process ended prematurely: osmo-stp_10.42.42.5(pid=22782) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22782)] [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:12:48.998427 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 22:12:49.026339 run osmo-hlr_10.42.42.2(pid=22779): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22779)] 22:12:49.076564 run osmo-hlr_10.42.42.2(pid=22779): stdout: | (launched: 2022-12-09_22:12:45.686459) 22:12:49.129207 run osmo-hlr_10.42.42.2(pid=22779): stderr: | 20221209221245938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221245938 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221245938 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221245938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221245938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221245938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221245954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221245976 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221245976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221245976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:49.201396 run osmo-msc_10.42.42.6(pid=22785): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22785)] 22:12:49.251646 run osmo-msc_10.42.42.6(pid=22785): stdout: | (launched: 2022-12-09_22:12:48.065207) 22:12:49.303618 run osmo-msc_10.42.42.6(pid=22785): stderr: | 20221209221248388 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221248388 DLGLOBAL DEBUG validating counter group 0x7f067cf50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221248388 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221248388 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221248388 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221248389 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221248390 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221248391 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221248391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221248391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:12:49.356142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22778): Terminating (SIGTERM) 22:12:49.398153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22781): Terminating (SIGTERM) 22:12:49.440154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22784): Terminating (SIGTERM) 22:12:49.482532 --- ParallelTerminationStrategy: PID 22778 died... 22:12:49.502573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22778): Terminated: ok {rc=0} 22:12:49.548827 --- ParallelTerminationStrategy: PID 22781 died... 22:12:49.568794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22781): Terminated: ok {rc=0} 22:12:49.615345 --- ParallelTerminationStrategy: PID 22784 died... 22:12:49.634949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22784): Terminated: ok {rc=0} 22:12:49.723832 bus /sierra_3: Setting Powered False 22:12:50.824586 bus /sierra_3: Setting Powered False 22:12:51.966175 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:12:53.112536 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:53.124519 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:12:53.194727 tst mo_mt_call_osmux.py: using LAC 24009 22:12:53.314389 tst mo_mt_call_osmux.py: using RAC 39 22:12:53.444478 tst mo_mt_call_osmux.py: using CellId 24009 22:12:53.569427 tst mo_mt_call_osmux.py: using BVCI 24010 22:12:53.686206 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:53.698036 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:53.709741 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:53.721587 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:53.733699 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:53.745590 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:12:53.863653 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:12:53.982647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:54.446703 run create_hlr_db(pid=22787): Launched 22:12:54.563307 bus /sierra_2: Setting Powered False 22:12:55.622931 run create_hlr_db(pid=22787): Terminated: ok {rc=0} 22:12:56.062799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22789): Launched 22:12:56.368133 run osmo-hlr_10.42.42.2(pid=22790): Launched 22:12:56.483701 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:57.011644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22792): Launched 22:12:57.311169 run osmo-stp_10.42.42.5(pid=22793): Launched 22:12:57.425814 run osmo-msc_10.42.42.6: Starting osmo-msc 22:12:57.969575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22795): Launched 22:12:58.271635 run osmo-msc_10.42.42.6(pid=22796): Launched 22:12:58.440441 run osmo-stp_10.42.42.5(pid=22793): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22793)] 22:12:58.568378 run osmo-stp_10.42.42.5(pid=22793): stdout: | (launched: 2022-12-09_22:12:57.256737) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:58.696754 run osmo-stp_10.42.42.5(pid=22793): stderr: | 20221209221257427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221257427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221257428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221257428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221257428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221257429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221257429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:58.822281 run osmo-stp_10.42.42.5(pid=22793): stdout: | (launched: 2022-12-09_22:12:57.256737) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:58.941567 run osmo-stp_10.42.42.5(pid=22793): stderr: | 20221209221257427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221257427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221257428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221257428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221257428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221257429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221257429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:59.084149 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22793): Process ended prematurely: osmo-stp_10.42.42.5(pid=22793) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22793)] [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:12:59.093104 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:12:59.119862 run osmo-hlr_10.42.42.2(pid=22790): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22790)] 22:12:59.167733 run osmo-hlr_10.42.42.2(pid=22790): stdout: | (launched: 2022-12-09_22:12:56.314055) 22:12:59.217130 run osmo-hlr_10.42.42.2(pid=22790): stderr: | 20221209221256491 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221256491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221256491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221256491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221256491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221256491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221256503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221256511 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221256511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221256511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:59.286068 run osmo-msc_10.42.42.6(pid=22796): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22796)] 22:12:59.333626 run osmo-msc_10.42.42.6(pid=22796): stdout: | (launched: 2022-12-09_22:12:58.217015) 22:12:59.383029 run osmo-msc_10.42.42.6(pid=22796): stderr: | 20221209221258489 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221258489 DLGLOBAL DEBUG validating counter group 0x7f539d52dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221258489 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221258489 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221258490 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221258490 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221258492 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221258492 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221258493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221258493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:12:59.432664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22789): Terminating (SIGTERM) 22:12:59.472439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22792): Terminating (SIGTERM) 22:12:59.512845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22795): Terminating (SIGTERM) 22:12:59.552692 --- ParallelTerminationStrategy: PID 22789 died... 22:12:59.571779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22789): Terminated: ok {rc=0} 22:12:59.617513 --- ParallelTerminationStrategy: PID 22792 died... 22:12:59.636093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22792): Terminated: ok {rc=0} 22:12:59.680749 --- ParallelTerminationStrategy: PID 22795 died... 22:12:59.699444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22795): Terminated: ok {rc=0} 22:12:59.786276 bus /sierra_3: Setting Powered False 22:13:00.902282 bus /sierra_3: Setting Powered False 22:13:02.022344 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:13:03.279138 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:13:03.286493 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:13:03.320871 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:13:03.347944 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:13:03.400111 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:13:03.434503 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:13:03.461696 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:13:04.015466 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:13:04.066413 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:04.078050 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:13:04.149110 tst mo_mt_call.py: using LAC 24010 22:13:04.274653 tst mo_mt_call.py: using RAC 40 22:13:04.404383 tst mo_mt_call.py: using CellId 24010 22:13:04.529166 tst mo_mt_call.py: using BVCI 24011 22:13:04.645561 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:04.656930 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:04.668356 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:04.679772 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:04.691516 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:04.702850 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:13:04.817552 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:13:04.932161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:05.395000 run create_hlr_db(pid=22801): Launched 22:13:05.510604 bus /sierra_2: Setting Powered False 22:13:06.571013 run create_hlr_db(pid=22801): Terminated: ok {rc=0} 22:13:07.008570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22803): Launched 22:13:07.329109 run osmo-hlr_10.42.42.2(pid=22804): Launched 22:13:07.451657 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:07.980210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22806): Launched 22:13:08.280272 run osmo-stp_10.42.42.5(pid=22807): Launched 22:13:08.395076 run osmo-msc_10.42.42.6: Starting osmo-msc 22:13:08.940936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22809): Launched 22:13:09.240325 run osmo-msc_10.42.42.6(pid=22810): Launched 22:13:09.409955 run osmo-stp_10.42.42.5(pid=22807): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22807)] 22:13:09.537536 run osmo-stp_10.42.42.5(pid=22807): stdout: | (launched: 2022-12-09_22:13:08.225619) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:09.666353 run osmo-stp_10.42.42.5(pid=22807): stderr: | 20221209221308397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221308397 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221308397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221308397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221308398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221308398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221308398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:09.791838 run osmo-stp_10.42.42.5(pid=22807): stdout: | (launched: 2022-12-09_22:13:08.225619) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:09.911565 run osmo-stp_10.42.42.5(pid=22807): stderr: | 20221209221308397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221308397 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221308397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221308397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221308398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221308398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221308398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:10.054956 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22807): Process ended prematurely: osmo-stp_10.42.42.5(pid=22807) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22807)] [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:13:10.063910 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:13:10.090740 run osmo-hlr_10.42.42.2(pid=22804): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22804)] 22:13:10.139108 run osmo-hlr_10.42.42.2(pid=22804): stdout: | (launched: 2022-12-09_22:13:07.271328) 22:13:10.188767 run osmo-hlr_10.42.42.2(pid=22804): stderr: | 20221209221307470 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221307470 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221307470 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221307470 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221307470 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221307470 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221307485 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221307494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221307494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221307494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:10.257676 run osmo-msc_10.42.42.6(pid=22810): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22810)] 22:13:10.305377 run osmo-msc_10.42.42.6(pid=22810): stdout: | (launched: 2022-12-09_22:13:09.186043) 22:13:10.354869 run osmo-msc_10.42.42.6(pid=22810): stderr: | 20221209221309456 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221309456 DLGLOBAL DEBUG validating counter group 0x7f7b1d805c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221309456 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221309456 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221309456 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221309457 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221309458 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221309459 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221309459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221309459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:13:10.404522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22803): Terminating (SIGTERM) 22:13:10.444321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22806): Terminating (SIGTERM) 22:13:10.484050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22809): Terminating (SIGTERM) 22:13:10.524114 --- ParallelTerminationStrategy: PID 22803 died... 22:13:10.543277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22803): Terminated: ok {rc=0} 22:13:10.587487 --- ParallelTerminationStrategy: PID 22806 died... 22:13:10.606374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22806): Terminated: ok {rc=0} 22:13:10.650587 --- ParallelTerminationStrategy: PID 22809 died... 22:13:10.669261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22809): Terminated: ok {rc=0} 22:13:10.753063 bus /sierra_3: Setting Powered False 22:13:11.851358 bus /sierra_3: Setting Powered False 22:13:12.969859 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:13:14.116367 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:14.128322 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:13:14.197827 tst mo_mt_call_osmux.py: using LAC 24011 22:13:14.328841 tst mo_mt_call_osmux.py: using RAC 41 22:13:14.454337 tst mo_mt_call_osmux.py: using CellId 24011 22:13:14.577643 tst mo_mt_call_osmux.py: using BVCI 24012 22:13:14.694556 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:14.706392 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:14.717936 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:14.729352 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:14.740824 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:14.752365 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:13:14.874497 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:13:14.994312 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:15.488777 run create_hlr_db(pid=22812): Launched 22:13:15.618374 bus /sierra_2: Setting Powered False 22:13:16.698295 run create_hlr_db(pid=22812): Terminated: ok {rc=0} 22:13:17.142367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22814): Launched 22:13:17.448287 run osmo-hlr_10.42.42.2(pid=22815): Launched 22:13:17.564515 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:18.086143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22817): Launched 22:13:18.386483 run osmo-stp_10.42.42.5(pid=22818): Launched 22:13:18.501669 run osmo-msc_10.42.42.6: Starting osmo-msc 22:13:19.045806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22820): Launched 22:13:19.351130 run osmo-msc_10.42.42.6(pid=22821): Launched 22:13:19.520280 run osmo-stp_10.42.42.5(pid=22818): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22818)] 22:13:19.648863 run osmo-stp_10.42.42.5(pid=22818): stdout: | (launched: 2022-12-09_22:13:18.331937) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:19.777604 run osmo-stp_10.42.42.5(pid=22818): stderr: | 20221209221318502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221318502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221318502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221318503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221318503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221318503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221318503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:19.904457 run osmo-stp_10.42.42.5(pid=22818): stdout: | (launched: 2022-12-09_22:13:18.331937) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:20.024518 run osmo-stp_10.42.42.5(pid=22818): stderr: | 20221209221318502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221318502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221318502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221318503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221318503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221318503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221318503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:20.168380 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22818): Process ended prematurely: osmo-stp_10.42.42.5(pid=22818) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22818)] [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:13:20.177333 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:13:20.203908 run osmo-hlr_10.42.42.2(pid=22815): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22815)] 22:13:20.252035 run osmo-hlr_10.42.42.2(pid=22815): stdout: | (launched: 2022-12-09_22:13:17.393943) 22:13:20.301779 run osmo-hlr_10.42.42.2(pid=22815): stderr: | 20221209221317572 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221317572 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221317572 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221317572 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221317572 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221317572 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221317584 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221317593 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221317593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221317593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:20.370888 run osmo-msc_10.42.42.6(pid=22821): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22821)] 22:13:20.418408 run osmo-msc_10.42.42.6(pid=22821): stdout: | (launched: 2022-12-09_22:13:19.295359) 22:13:20.467481 run osmo-msc_10.42.42.6(pid=22821): stderr: | 20221209221319566 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221319567 DLGLOBAL DEBUG validating counter group 0x7f1f4fee4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221319567 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221319567 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221319567 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221319567 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221319569 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221319569 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221319570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221319570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:13:20.517242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22814): Terminating (SIGTERM) 22:13:20.557027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22817): Terminating (SIGTERM) 22:13:20.597074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22820): Terminating (SIGTERM) 22:13:20.637055 --- ParallelTerminationStrategy: PID 22814 died... 22:13:20.655929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22814): Terminated: ok {rc=0} 22:13:20.699994 --- ParallelTerminationStrategy: PID 22817 died... 22:13:20.718537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22817): Terminated: ok {rc=0} 22:13:20.762455 --- ParallelTerminationStrategy: PID 22820 died... 22:13:20.781111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22820): Terminated: ok {rc=0} 22:13:20.864472 bus /sierra_3: Setting Powered False 22:13:21.962935 bus /sierra_3: Setting Powered False 22:13:23.082798 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:13:24.334362 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:13:24.342811 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:13:24.377441 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:13:24.404587 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:13:24.456408 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:13:24.490762 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:13:24.518397 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:13:25.071854 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:13:25.123517 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:25.135193 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:13:25.205321 tst mo_mt_call.py: using LAC 24012 22:13:25.330580 tst mo_mt_call.py: using RAC 42 22:13:25.456691 tst mo_mt_call.py: using CellId 24012 22:13:25.585251 tst mo_mt_call.py: using BVCI 24013 22:13:25.702312 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:25.713946 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:25.725364 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:25.736670 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:25.748206 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:25.759659 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:13:25.880740 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:13:25.998302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:26.462649 run create_hlr_db(pid=22827): Launched 22:13:26.578525 bus /sierra_2: Setting Powered False 22:13:27.638776 run create_hlr_db(pid=22827): Terminated: ok {rc=0} 22:13:28.057714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22829): Launched 22:13:28.358157 run osmo-hlr_10.42.42.2(pid=22830): Launched 22:13:28.473081 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:29.000862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22832): Launched 22:13:29.300821 run osmo-stp_10.42.42.5(pid=22833): Launched 22:13:29.416209 run osmo-msc_10.42.42.6: Starting osmo-msc 22:13:29.959692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22835): Launched 22:13:30.261881 run osmo-msc_10.42.42.6(pid=22836): Launched 22:13:30.432289 run osmo-stp_10.42.42.5(pid=22833): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22833)] 22:13:30.560363 run osmo-stp_10.42.42.5(pid=22833): stdout: | (launched: 2022-12-09_22:13:29.246276) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:30.688223 run osmo-stp_10.42.42.5(pid=22833): stderr: | 20221209221329415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221329416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221329416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221329416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221329419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221329419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221329419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:30.813861 run osmo-stp_10.42.42.5(pid=22833): stdout: | (launched: 2022-12-09_22:13:29.246276) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:30.943933 run osmo-stp_10.42.42.5(pid=22833): stderr: | 20221209221329415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221329416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221329416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221329416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221329419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221329419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221329419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:31.093303 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22833): Process ended prematurely: osmo-stp_10.42.42.5(pid=22833) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22833)] [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:13:31.108080 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:13:31.146197 run osmo-hlr_10.42.42.2(pid=22830): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22830)] 22:13:31.211390 run osmo-hlr_10.42.42.2(pid=22830): stdout: | (launched: 2022-12-09_22:13:28.303382) 22:13:31.295252 run osmo-hlr_10.42.42.2(pid=22830): stderr: | 20221209221328480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221328480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221328480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221328480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221328480 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221328480 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221328492 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221328500 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221328501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221328501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:31.374501 run osmo-msc_10.42.42.6(pid=22836): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22836)] 22:13:31.423795 run osmo-msc_10.42.42.6(pid=22836): stdout: | (launched: 2022-12-09_22:13:30.207231) 22:13:31.475389 run osmo-msc_10.42.42.6(pid=22836): stderr: | 20221209221330479 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221330480 DLGLOBAL DEBUG validating counter group 0x7f28e6a76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221330480 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221330480 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221330480 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221330480 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221330482 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221330483 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221330483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221330483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:13:31.527684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22829): Terminating (SIGTERM) 22:13:31.570046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22832): Terminating (SIGTERM) 22:13:31.612232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22835): Terminating (SIGTERM) 22:13:31.654995 --- ParallelTerminationStrategy: PID 22829 died... 22:13:31.674738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22829): Terminated: ok {rc=0} 22:13:31.722595 --- ParallelTerminationStrategy: PID 22832 died... 22:13:31.742236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22832): Terminated: ok {rc=0} 22:13:31.789967 --- ParallelTerminationStrategy: PID 22835 died... 22:13:31.809759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22835): Terminated: ok {rc=0} 22:13:31.907914 bus /sierra_3: Setting Powered False 22:13:33.008681 bus /sierra_3: Setting Powered False 22:13:34.125457 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:13:35.274069 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:35.286507 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:13:35.363622 tst mo_mt_call_osmux.py: using LAC 24013 22:13:35.490517 tst mo_mt_call_osmux.py: using RAC 43 22:13:35.615997 tst mo_mt_call_osmux.py: using CellId 24013 22:13:35.734307 tst mo_mt_call_osmux.py: using BVCI 24014 22:13:35.843420 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:35.854602 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:35.865666 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:35.876859 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:35.888211 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:35.899495 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:13:36.016890 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:13:36.133195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:36.598898 run create_hlr_db(pid=22838): Launched 22:13:36.714180 bus /sierra_2: Setting Powered False 22:13:37.775126 run create_hlr_db(pid=22838): Terminated: ok {rc=0} 22:13:38.195525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22840): Launched 22:13:38.497394 run osmo-hlr_10.42.42.2(pid=22841): Launched 22:13:38.614568 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:39.145725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22843): Launched 22:13:39.449354 run osmo-stp_10.42.42.5(pid=22844): Launched 22:13:39.564939 run osmo-msc_10.42.42.6: Starting osmo-msc 22:13:40.111009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22846): Launched 22:13:40.412920 run osmo-msc_10.42.42.6(pid=22847): Launched 22:13:40.584514 run osmo-stp_10.42.42.5(pid=22844): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22844)] 22:13:40.712366 run osmo-stp_10.42.42.5(pid=22844): stdout: | (launched: 2022-12-09_22:13:39.394405) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:40.841153 run osmo-stp_10.42.42.5(pid=22844): stderr: | 20221209221339563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221339564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221339564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221339564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221339565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221339565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221339565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:40.966866 run osmo-stp_10.42.42.5(pid=22844): stdout: | (launched: 2022-12-09_22:13:39.394405) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:41.086951 run osmo-stp_10.42.42.5(pid=22844): stderr: | 20221209221339563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221339564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221339564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221339564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221339565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221339565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221339565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:41.230748 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22844): Process ended prematurely: osmo-stp_10.42.42.5(pid=22844) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22844)] [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:13:41.239507 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:13:41.266053 run osmo-hlr_10.42.42.2(pid=22841): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22841)] 22:13:41.314266 run osmo-hlr_10.42.42.2(pid=22841): stdout: | (launched: 2022-12-09_22:13:38.442700) 22:13:41.363792 run osmo-hlr_10.42.42.2(pid=22841): stderr: | 20221209221338619 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221338620 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221338620 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221338620 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221338620 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221338620 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221338632 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221338640 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221338640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221338640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:41.432625 run osmo-msc_10.42.42.6(pid=22847): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22847)] 22:13:41.480561 run osmo-msc_10.42.42.6(pid=22847): stdout: | (launched: 2022-12-09_22:13:40.358399) 22:13:41.529899 run osmo-msc_10.42.42.6(pid=22847): stderr: | 20221209221340629 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221340629 DLGLOBAL DEBUG validating counter group 0x7f99e0bb4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221340630 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221340630 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221340630 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221340630 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221340632 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221340632 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221340632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221340632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:13:41.579870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22840): Terminating (SIGTERM) 22:13:41.619507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22843): Terminating (SIGTERM) 22:13:41.659063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22846): Terminating (SIGTERM) 22:13:41.698805 --- ParallelTerminationStrategy: PID 22840 died... 22:13:41.717704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22840): Terminated: ok {rc=0} 22:13:41.762175 --- ParallelTerminationStrategy: PID 22843 died... 22:13:41.780486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22843): Terminated: ok {rc=0} 22:13:41.824598 --- ParallelTerminationStrategy: PID 22846 died... 22:13:41.843048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22846): Terminated: ok {rc=0} 22:13:41.928521 bus /sierra_3: Setting Powered False 22:13:43.026702 bus /sierra_3: Setting Powered False 22:13:44.139847 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:13:45.398272 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:13:45.406761 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:13:45.441926 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:13:45.469386 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:13:45.520701 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:13:45.555496 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:13:45.582968 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:13:46.147882 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:13:46.201916 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:46.213966 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:13:46.284590 tst mo_mt_call.py: using LAC 24014 22:13:46.406768 tst mo_mt_call.py: using RAC 44 22:13:46.529374 tst mo_mt_call.py: using CellId 24014 22:13:46.651698 tst mo_mt_call.py: using BVCI 24015 22:13:46.764286 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:46.776380 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:46.790517 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:46.802488 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:46.816320 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:46.829653 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:13:46.950439 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:13:47.072347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:47.582519 run create_hlr_db(pid=22852): Launched 22:13:47.713476 bus /sierra_2: Setting Powered False 22:13:48.776634 run create_hlr_db(pid=22852): Terminated: ok {rc=0} 22:13:49.222053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22854): Launched 22:13:49.541929 run osmo-hlr_10.42.42.2(pid=22855): Launched 22:13:49.664123 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:50.217028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22857): Launched 22:13:50.537446 run osmo-stp_10.42.42.5(pid=22858): Launched 22:13:50.660799 run osmo-msc_10.42.42.6: Starting osmo-msc 22:13:51.245655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22860): Launched 22:13:51.566202 run osmo-msc_10.42.42.6(pid=22861): Launched 22:13:51.745242 run osmo-stp_10.42.42.5(pid=22858): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22858)] 22:13:51.879651 run osmo-stp_10.42.42.5(pid=22858): stdout: | (launched: 2022-12-09_22:13:50.479719) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:52.017285 run osmo-stp_10.42.42.5(pid=22858): stderr: | 20221209221350674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221350674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221350674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221350675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221350675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221350675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221350675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:52.153093 run osmo-stp_10.42.42.5(pid=22858): stdout: | (launched: 2022-12-09_22:13:50.479719) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:52.281709 run osmo-stp_10.42.42.5(pid=22858): stderr: | 20221209221350674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221350674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221350674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221350675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221350675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221350675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221350675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:52.434834 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22858): Process ended prematurely: osmo-stp_10.42.42.5(pid=22858) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22858)] [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:13:52.444190 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:13:52.472127 run osmo-hlr_10.42.42.2(pid=22855): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22855)] 22:13:52.522514 run osmo-hlr_10.42.42.2(pid=22855): stdout: | (launched: 2022-12-09_22:13:49.484315) 22:13:52.574451 run osmo-hlr_10.42.42.2(pid=22855): stderr: | 20221209221349684 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221349684 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221349684 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221349684 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221349684 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221349684 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221349697 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221349705 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221349706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221349706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:52.646673 run osmo-msc_10.42.42.6(pid=22861): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22861)] 22:13:52.696595 run osmo-msc_10.42.42.6(pid=22861): stdout: | (launched: 2022-12-09_22:13:51.508221) 22:13:52.748161 run osmo-msc_10.42.42.6(pid=22861): stderr: | 20221209221351832 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221351832 DLGLOBAL DEBUG validating counter group 0x7f5880ef3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221351832 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221351832 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221351832 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221351833 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221351834 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221351835 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221351835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221351835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:13:52.800189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22854): Terminating (SIGTERM) 22:13:52.841551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22857): Terminating (SIGTERM) 22:13:52.883330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22860): Terminating (SIGTERM) 22:13:52.925299 --- ParallelTerminationStrategy: PID 22854 died... 22:13:52.945323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22854): Terminated: ok {rc=0} 22:13:52.991480 --- ParallelTerminationStrategy: PID 22857 died... 22:13:53.011118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22857): Terminated: ok {rc=0} 22:13:53.057066 --- ParallelTerminationStrategy: PID 22860 died... 22:13:53.076679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22860): Terminated: ok {rc=0} 22:13:53.164887 bus /sierra_3: Setting Powered False 22:13:54.265390 bus /sierra_3: Setting Powered False 22:13:55.381351 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:13:56.530605 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:56.543072 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:13:56.620283 tst mo_mt_call_osmux.py: using LAC 24015 22:13:56.746409 tst mo_mt_call_osmux.py: using RAC 45 22:13:56.863672 tst mo_mt_call_osmux.py: using CellId 24015 22:13:56.980911 tst mo_mt_call_osmux.py: using BVCI 24016 22:13:57.090192 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:57.101457 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:57.112335 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:57.124127 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:57.135818 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:57.147420 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:13:57.264536 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:13:57.384178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:57.881183 run create_hlr_db(pid=22864): Launched 22:13:58.013039 bus /sierra_2: Setting Powered False 22:13:59.077143 run create_hlr_db(pid=22864): Terminated: ok {rc=0} 22:13:59.506532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22866): Launched 22:13:59.806782 run osmo-hlr_10.42.42.2(pid=22867): Launched 22:13:59.921430 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:00.457919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22869): Launched 22:14:00.758457 run osmo-stp_10.42.42.5(pid=22870): Launched 22:14:00.970060 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:01.574488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22872): Launched 22:14:01.894049 run osmo-msc_10.42.42.6(pid=22873): Launched 22:14:02.256597 run osmo-stp_10.42.42.5(pid=22870): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22870)] 22:14:02.396510 run osmo-stp_10.42.42.5(pid=22870): stdout: | (launched: 2022-12-09_22:14:00.703825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:02.534224 run osmo-stp_10.42.42.5(pid=22870): stderr: | 20221209221400896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221400896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221400896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221400898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221400899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221400899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221400899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:02.669418 run osmo-stp_10.42.42.5(pid=22870): stdout: | (launched: 2022-12-09_22:14:00.703825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:02.798423 run osmo-stp_10.42.42.5(pid=22870): stderr: | 20221209221400896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221400896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221400896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221400898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221400899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221400899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221400899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:02.952400 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22870): Process ended prematurely: osmo-stp_10.42.42.5(pid=22870) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22870)] [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:14:02.962240 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:14:02.990229 run osmo-hlr_10.42.42.2(pid=22867): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22867)] 22:14:03.041090 run osmo-hlr_10.42.42.2(pid=22867): stdout: | (launched: 2022-12-09_22:13:59.752505) 22:14:03.093422 run osmo-hlr_10.42.42.2(pid=22867): stderr: | 20221209221359928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221359928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221359928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221359928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221359928 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221359928 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221359941 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221359949 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221359950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221359950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:03.166257 run osmo-msc_10.42.42.6(pid=22873): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22873)] 22:14:03.216745 run osmo-msc_10.42.42.6(pid=22873): stdout: | (launched: 2022-12-09_22:14:01.827936) 22:14:03.268762 run osmo-msc_10.42.42.6(pid=22873): stderr: | 20221209221402301 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221402302 DLGLOBAL DEBUG validating counter group 0x7f5a518f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221402302 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221402302 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221402302 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221402302 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221402304 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221402304 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221402304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221402305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:03.321393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22866): Terminating (SIGTERM) 22:14:03.362941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22869): Terminating (SIGTERM) 22:14:03.404841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22872): Terminating (SIGTERM) 22:14:03.447304 --- ParallelTerminationStrategy: PID 22866 died... 22:14:03.467334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22866): Terminated: ok {rc=0} 22:14:03.513695 --- ParallelTerminationStrategy: PID 22869 died... 22:14:03.533422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22869): Terminated: ok {rc=0} 22:14:03.579794 --- ParallelTerminationStrategy: PID 22872 died... 22:14:03.599463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22872): Terminated: ok {rc=0} 22:14:03.687141 bus /sierra_3: Setting Powered False 22:14:04.787400 bus /sierra_3: Setting Powered False 22:14:05.903730 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:14:07.159417 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:14:07.166468 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:14:07.201393 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:14:07.228680 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:14:07.282204 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:14:07.316826 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:14:07.343911 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:14:07.896715 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:14:07.948008 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:07.959730 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:14:08.032285 tst mo_mt_call.py: using LAC 24016 22:14:08.160103 tst mo_mt_call.py: using RAC 46 22:14:08.287970 tst mo_mt_call.py: using CellId 24016 22:14:08.414612 tst mo_mt_call.py: using BVCI 24017 22:14:08.532281 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:08.543878 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:08.555220 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:08.566676 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:08.578241 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:08.589724 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:14:08.710929 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:14:08.828675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:09.293559 run create_hlr_db(pid=22878): Launched 22:14:09.411152 bus /sierra_2: Setting Powered False 22:14:10.471060 run create_hlr_db(pid=22878): Terminated: ok {rc=0} 22:14:10.890311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22880): Launched 22:14:11.191139 run osmo-hlr_10.42.42.2(pid=22881): Launched 22:14:11.306348 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:11.839491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22883): Launched 22:14:12.141124 run osmo-stp_10.42.42.5(pid=22884): Launched 22:14:12.256825 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:12.816253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22886): Launched 22:14:13.118092 run osmo-msc_10.42.42.6(pid=22887): Launched 22:14:13.287931 run osmo-stp_10.42.42.5(pid=22884): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22884)] 22:14:13.416189 run osmo-stp_10.42.42.5(pid=22884): stdout: | (launched: 2022-12-09_22:14:12.086595) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:13.544720 run osmo-stp_10.42.42.5(pid=22884): stderr: | 20221209221412258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221412258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221412258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221412259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221412259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221412259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221412259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:13.670888 run osmo-stp_10.42.42.5(pid=22884): stdout: | (launched: 2022-12-09_22:14:12.086595) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:13.790944 run osmo-stp_10.42.42.5(pid=22884): stderr: | 20221209221412258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221412258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221412258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221412259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221412259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221412259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221412259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:13.934847 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22884): Process ended prematurely: osmo-stp_10.42.42.5(pid=22884) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22884)] [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:14:13.943574 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:14:13.970315 run osmo-hlr_10.42.42.2(pid=22881): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22881)] 22:14:14.018173 run osmo-hlr_10.42.42.2(pid=22881): stdout: | (launched: 2022-12-09_22:14:11.136027) 22:14:14.067685 run osmo-hlr_10.42.42.2(pid=22881): stderr: | 20221209221411312 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221411312 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221411312 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221411312 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221411312 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221411312 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221411324 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221411333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221411333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221411333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:14.136740 run osmo-msc_10.42.42.6(pid=22887): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22887)] 22:14:14.184497 run osmo-msc_10.42.42.6(pid=22887): stdout: | (launched: 2022-12-09_22:14:13.063090) 22:14:14.233764 run osmo-msc_10.42.42.6(pid=22887): stderr: | 20221209221413334 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221413335 DLGLOBAL DEBUG validating counter group 0x7f167f622c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221413335 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221413335 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221413335 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221413335 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221413337 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221413338 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221413338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221413338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:14.283511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22880): Terminating (SIGTERM) 22:14:14.323367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22883): Terminating (SIGTERM) 22:14:14.363078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22886): Terminating (SIGTERM) 22:14:14.403100 --- ParallelTerminationStrategy: PID 22880 died... 22:14:14.422277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22880): Terminated: ok {rc=0} 22:14:14.466635 --- ParallelTerminationStrategy: PID 22883 died... 22:14:14.485127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22883): Terminated: ok {rc=0} 22:14:14.529390 --- ParallelTerminationStrategy: PID 22886 died... 22:14:14.547873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22886): Terminated: ok {rc=0} 22:14:14.633111 bus /sierra_3: Setting Powered False 22:14:15.730653 bus /sierra_3: Setting Powered False 22:14:16.850098 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:14:18.013670 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:18.025940 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:14:18.097896 tst mo_mt_call_osmux.py: using LAC 24017 22:14:18.218346 tst mo_mt_call_osmux.py: using RAC 47 22:14:18.337940 tst mo_mt_call_osmux.py: using CellId 24017 22:14:18.454929 tst mo_mt_call_osmux.py: using BVCI 24018 22:14:18.565511 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:18.576592 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:18.587605 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:18.598825 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:18.610150 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:18.621310 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:14:18.740312 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:14:18.862473 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:19.329191 run create_hlr_db(pid=22889): Launched 22:14:19.444566 bus /sierra_2: Setting Powered False 22:14:20.505184 run create_hlr_db(pid=22889): Terminated: ok {rc=0} 22:14:20.944480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22891): Launched 22:14:21.266159 run osmo-hlr_10.42.42.2(pid=22892): Launched 22:14:21.389124 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:21.941505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22894): Launched 22:14:22.265399 run osmo-stp_10.42.42.5(pid=22895): Launched 22:14:22.389858 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:22.975543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22897): Launched 22:14:23.297808 run osmo-msc_10.42.42.6(pid=22898): Launched 22:14:23.477948 run osmo-stp_10.42.42.5(pid=22895): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22895)] 22:14:23.613873 run osmo-stp_10.42.42.5(pid=22895): stdout: | (launched: 2022-12-09_22:14:22.207092) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:23.750607 run osmo-stp_10.42.42.5(pid=22895): stderr: | 20221209221422402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221422402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221422402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221422403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221422403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221422403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221422403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:23.886453 run osmo-stp_10.42.42.5(pid=22895): stdout: | (launched: 2022-12-09_22:14:22.207092) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:24.014506 run osmo-stp_10.42.42.5(pid=22895): stderr: | 20221209221422402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221422402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221422402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221422403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221422403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221422403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221422403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:24.168732 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22895): Process ended prematurely: osmo-stp_10.42.42.5(pid=22895) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22895)] [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:14:24.178307 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:14:24.206052 run osmo-hlr_10.42.42.2(pid=22892): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22892)] 22:14:24.256105 run osmo-hlr_10.42.42.2(pid=22892): stdout: | (launched: 2022-12-09_22:14:21.208008) 22:14:24.308120 run osmo-hlr_10.42.42.2(pid=22892): stderr: | 20221209221421408 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221421408 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221421408 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221421408 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221421408 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221421408 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221421425 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221421434 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221421435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221421435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:24.380328 run osmo-msc_10.42.42.6(pid=22898): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22898)] 22:14:24.430146 run osmo-msc_10.42.42.6(pid=22898): stdout: | (launched: 2022-12-09_22:14:23.239459) 22:14:24.481864 run osmo-msc_10.42.42.6(pid=22898): stderr: | 20221209221423562 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221423562 DLGLOBAL DEBUG validating counter group 0x7efd360e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221423562 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221423562 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221423562 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221423563 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221423564 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221423565 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221423565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221423565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:24.534474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22891): Terminating (SIGTERM) 22:14:24.575783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22894): Terminating (SIGTERM) 22:14:24.617805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22897): Terminating (SIGTERM) 22:14:24.659480 --- ParallelTerminationStrategy: PID 22891 died... 22:14:24.679496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22891): Terminated: ok {rc=0} 22:14:24.725494 --- ParallelTerminationStrategy: PID 22894 died... 22:14:24.744872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22894): Terminated: ok {rc=0} 22:14:24.790777 --- ParallelTerminationStrategy: PID 22897 died... 22:14:24.810225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22897): Terminated: ok {rc=0} 22:14:24.897607 bus /sierra_3: Setting Powered False 22:14:25.996085 bus /sierra_3: Setting Powered False 22:14:27.111830 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:14:28.371036 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:14:28.378041 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:14:28.412022 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:14:28.439015 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:14:28.491082 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:14:28.525315 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:14:28.552396 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:14:29.107569 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:14:29.160229 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:29.172060 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:14:29.244893 tst mo_mt_call.py: using LAC 24018 22:14:29.371281 tst mo_mt_call.py: using RAC 48 22:14:29.497324 tst mo_mt_call.py: using CellId 24018 22:14:29.622628 tst mo_mt_call.py: using BVCI 24019 22:14:29.738536 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:29.750212 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:29.761637 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:29.773053 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:29.784588 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:29.796090 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:14:29.913548 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:14:30.030368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:30.496159 run create_hlr_db(pid=22904): Launched 22:14:30.612856 bus /sierra_2: Setting Powered False 22:14:31.688877 run create_hlr_db(pid=22904): Terminated: ok {rc=0} 22:14:32.200411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22906): Launched 22:14:32.531527 run osmo-hlr_10.42.42.2(pid=22907): Launched 22:14:32.655143 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:33.213539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22909): Launched 22:14:33.536384 run osmo-stp_10.42.42.5(pid=22910): Launched 22:14:33.658521 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:34.238064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22912): Launched 22:14:34.559073 run osmo-msc_10.42.42.6(pid=22913): Launched 22:14:34.739220 run osmo-stp_10.42.42.5(pid=22910): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22910)] 22:14:34.874545 run osmo-stp_10.42.42.5(pid=22910): stdout: | (launched: 2022-12-09_22:14:33.478192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:35.011153 run osmo-stp_10.42.42.5(pid=22910): stderr: | 20221209221433673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221433673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221433673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221433674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221433674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221433674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221433674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:35.147345 run osmo-stp_10.42.42.5(pid=22910): stdout: | (launched: 2022-12-09_22:14:33.478192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:35.276188 run osmo-stp_10.42.42.5(pid=22910): stderr: | 20221209221433673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221433673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221433673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221433674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221433674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221433674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221433674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:35.429631 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22910): Process ended prematurely: osmo-stp_10.42.42.5(pid=22910) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22910)] [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:14:35.439312 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:14:35.467074 run osmo-hlr_10.42.42.2(pid=22907): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22907)] 22:14:35.517134 run osmo-hlr_10.42.42.2(pid=22907): stdout: | (launched: 2022-12-09_22:14:32.473911) 22:14:35.568729 run osmo-hlr_10.42.42.2(pid=22907): stderr: | 20221209221432673 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221432673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221432673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221432673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221432673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221432673 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221432686 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221432694 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221432695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221432695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:35.640888 run osmo-msc_10.42.42.6(pid=22913): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22913)] 22:14:35.690593 run osmo-msc_10.42.42.6(pid=22913): stdout: | (launched: 2022-12-09_22:14:34.501115) 22:14:35.742184 run osmo-msc_10.42.42.6(pid=22913): stderr: | 20221209221434822 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221434822 DLGLOBAL DEBUG validating counter group 0x7fe717e0bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221434822 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221434822 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221434823 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221434823 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221434825 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221434825 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221434825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221434825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:35.793874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22906): Terminating (SIGTERM) 22:14:35.835035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22909): Terminating (SIGTERM) 22:14:35.876728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22912): Terminating (SIGTERM) 22:14:35.918574 --- ParallelTerminationStrategy: PID 22906 died... 22:14:35.938578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22906): Terminated: ok {rc=0} 22:14:35.984482 --- ParallelTerminationStrategy: PID 22909 died... 22:14:36.004001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22909): Terminated: ok {rc=0} 22:14:36.049897 --- ParallelTerminationStrategy: PID 22912 died... 22:14:36.069463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22912): Terminated: ok {rc=0} 22:14:36.157484 bus /sierra_3: Setting Powered False 22:14:37.255737 bus /sierra_3: Setting Powered False 22:14:38.372275 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:14:39.521208 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:39.533631 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:14:39.606699 tst mo_mt_call_osmux.py: using LAC 24019 22:14:39.734433 tst mo_mt_call_osmux.py: using RAC 49 22:14:39.861238 tst mo_mt_call_osmux.py: using CellId 24019 22:14:39.986786 tst mo_mt_call_osmux.py: using BVCI 24020 22:14:40.098586 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:40.110149 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:40.121386 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:40.133260 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:40.145463 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:40.157263 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:14:40.279506 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:14:40.400604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:40.897927 run create_hlr_db(pid=22915): Launched 22:14:41.029110 bus /sierra_2: Setting Powered False 22:14:42.092459 run create_hlr_db(pid=22915): Terminated: ok {rc=0} 22:14:42.523688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22917): Launched 22:14:42.825462 run osmo-hlr_10.42.42.2(pid=22918): Launched 22:14:42.941673 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:43.475244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22920): Launched 22:14:43.775338 run osmo-stp_10.42.42.5(pid=22921): Launched 22:14:43.890131 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:44.433355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22923): Launched 22:14:44.734390 run osmo-msc_10.42.42.6(pid=22924): Launched 22:14:44.902214 run osmo-stp_10.42.42.5(pid=22921): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22921)] 22:14:45.029837 run osmo-stp_10.42.42.5(pid=22921): stdout: | (launched: 2022-12-09_22:14:43.720861) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:45.157513 run osmo-stp_10.42.42.5(pid=22921): stderr: | 20221209221443891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221443892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221443892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221443892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221443893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221443893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221443893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:45.283332 run osmo-stp_10.42.42.5(pid=22921): stdout: | (launched: 2022-12-09_22:14:43.720861) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:45.402963 run osmo-stp_10.42.42.5(pid=22921): stderr: | 20221209221443891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221443892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221443892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221443892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221443893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221443893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221443893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:45.546770 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22921): Process ended prematurely: osmo-stp_10.42.42.5(pid=22921) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22921)] [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:14:45.555474 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:14:45.582289 run osmo-hlr_10.42.42.2(pid=22918): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22918)] 22:14:45.630077 run osmo-hlr_10.42.42.2(pid=22918): stdout: | (launched: 2022-12-09_22:14:42.770993) 22:14:45.679364 run osmo-hlr_10.42.42.2(pid=22918): stderr: | 20221209221442943 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221442944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221442944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221442944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221442944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221442944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221442955 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221442963 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221442963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221442963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:45.748497 run osmo-msc_10.42.42.6(pid=22924): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22924)] 22:14:45.796279 run osmo-msc_10.42.42.6(pid=22924): stdout: | (launched: 2022-12-09_22:14:44.679749) 22:14:45.864614 run osmo-msc_10.42.42.6(pid=22924): stderr: | 20221209221444950 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221444951 DLGLOBAL DEBUG validating counter group 0x7f7b75125c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221444951 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221444951 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221444951 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221444951 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221444953 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221444953 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221444954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221444954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:45.936360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22917): Terminating (SIGTERM) 22:14:45.977356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22920): Terminating (SIGTERM) 22:14:46.019597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22923): Terminating (SIGTERM) 22:14:46.061878 --- ParallelTerminationStrategy: PID 22917 died... 22:14:46.081525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22917): Terminated: ok {rc=0} 22:14:46.129313 --- ParallelTerminationStrategy: PID 22920 died... 22:14:46.148827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22920): Terminated: ok {rc=0} 22:14:46.196518 --- ParallelTerminationStrategy: PID 22923 died... 22:14:46.216239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22923): Terminated: ok {rc=0} 22:14:46.303957 bus /sierra_3: Setting Powered False 22:14:47.405396 bus /sierra_3: Setting Powered False 22:14:48.520519 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:14:49.778854 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:14:49.785222 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:14:49.819708 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:14:49.846821 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:14:49.898764 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:14:49.933241 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:14:49.960423 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:14:50.512217 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:14:50.563628 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:50.575038 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:14:50.650059 tst mo_mt_call.py: using LAC 24020 22:14:50.777118 tst mo_mt_call.py: using RAC 50 22:14:50.904179 tst mo_mt_call.py: using CellId 24020 22:14:51.028814 tst mo_mt_call.py: using BVCI 24021 22:14:51.145386 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:51.156624 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:51.168222 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:51.179572 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:51.190892 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:51.202089 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:14:51.323342 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:14:51.441156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:51.906815 run create_hlr_db(pid=22929): Launched 22:14:52.022128 bus /sierra_2: Setting Powered False 22:14:53.082530 run create_hlr_db(pid=22929): Terminated: ok {rc=0} 22:14:53.521268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22931): Launched 22:14:53.842764 run osmo-hlr_10.42.42.2(pid=22932): Launched 22:14:53.965500 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:54.525402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22934): Launched 22:14:54.849346 run osmo-stp_10.42.42.5(pid=22935): Launched 22:14:54.973259 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:55.556700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22937): Launched 22:14:55.878506 run osmo-msc_10.42.42.6(pid=22938): Launched 22:14:56.058345 run osmo-stp_10.42.42.5(pid=22935): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22935)] 22:14:56.193522 run osmo-stp_10.42.42.5(pid=22935): stdout: | (launched: 2022-12-09_22:14:54.791132) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:56.329522 run osmo-stp_10.42.42.5(pid=22935): stderr: | 20221209221454982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221454982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221454982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221454983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221454984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221454984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221454984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:56.465129 run osmo-stp_10.42.42.5(pid=22935): stdout: | (launched: 2022-12-09_22:14:54.791132) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:56.593311 run osmo-stp_10.42.42.5(pid=22935): stderr: | 20221209221454982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221454982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221454982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221454983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221454984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221454984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221454984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:56.746819 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22935): Process ended prematurely: osmo-stp_10.42.42.5(pid=22935) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22935)] [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:14:56.756265 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:14:56.784197 run osmo-hlr_10.42.42.2(pid=22932): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22932)] 22:14:56.834454 run osmo-hlr_10.42.42.2(pid=22932): stdout: | (launched: 2022-12-09_22:14:53.784703) 22:14:56.886337 run osmo-hlr_10.42.42.2(pid=22932): stderr: | 20221209221453982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221453982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221453982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221453982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221453982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221453982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221453995 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221454005 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221454006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221454006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:56.958691 run osmo-msc_10.42.42.6(pid=22938): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22938)] 22:14:57.008877 run osmo-msc_10.42.42.6(pid=22938): stdout: | (launched: 2022-12-09_22:14:55.820475) 22:14:57.060645 run osmo-msc_10.42.42.6(pid=22938): stderr: | 20221209221456140 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221456141 DLGLOBAL DEBUG validating counter group 0x7fcae10e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221456141 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221456141 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221456141 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221456141 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221456143 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221456143 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221456144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221456144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:57.112990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22931): Terminating (SIGTERM) 22:14:57.154627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22934): Terminating (SIGTERM) 22:14:57.196605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22937): Terminating (SIGTERM) 22:14:57.238797 --- ParallelTerminationStrategy: PID 22931 died... 22:14:57.258373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22931): Terminated: ok {rc=0} 22:14:57.304562 --- ParallelTerminationStrategy: PID 22934 died... 22:14:57.324299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22934): Terminated: ok {rc=0} 22:14:57.370363 --- ParallelTerminationStrategy: PID 22937 died... 22:14:57.389923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22937): Terminated: ok {rc=0} 22:14:57.479151 bus /sierra_3: Setting Powered False 22:14:58.579436 bus /sierra_3: Setting Powered False 22:14:59.695435 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:15:00.861256 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:15:00.874398 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:15:00.963453 tst mo_mt_call_osmux.py: using LAC 24021 22:15:01.090463 tst mo_mt_call_osmux.py: using RAC 51 22:15:01.238780 tst mo_mt_call_osmux.py: using CellId 24021 22:15:01.369528 tst mo_mt_call_osmux.py: using BVCI 24022 22:15:01.529109 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:15:01.544108 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:15:01.559281 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:15:01.575050 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:15:01.586947 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:15:01.599320 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:15:01.748910 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:15:01.901376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:02.423373 run create_hlr_db(pid=22943): Launched 22:15:02.554047 bus /sierra_2: Setting Powered False 22:15:03.618223 run create_hlr_db(pid=22943): Terminated: ok {rc=0} 22:15:04.046991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22945): Launched 22:15:04.347489 run osmo-hlr_10.42.42.2(pid=22946): Launched 22:15:04.462333 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:04.979216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22948): Launched 22:15:05.279425 run osmo-stp_10.42.42.5(pid=22949): Launched 22:15:05.394611 run osmo-msc_10.42.42.6: Starting osmo-msc 22:15:05.938234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22951): Launched 22:15:06.238393 run osmo-msc_10.42.42.6(pid=22952): Launched 22:15:06.407797 run osmo-stp_10.42.42.5(pid=22949): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22949)] 22:15:06.535971 run osmo-stp_10.42.42.5(pid=22949): stdout: | (launched: 2022-12-09_22:15:05.225097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:06.664387 run osmo-stp_10.42.42.5(pid=22949): stderr: | 20221209221505396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221505396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221505396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221505396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221505397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221505397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221505397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:06.790752 run osmo-stp_10.42.42.5(pid=22949): stdout: | (launched: 2022-12-09_22:15:05.225097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:06.911095 run osmo-stp_10.42.42.5(pid=22949): stderr: | 20221209221505396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221505396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221505396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221505396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221505397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221505397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221505397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:07.054884 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22949): Process ended prematurely: osmo-stp_10.42.42.5(pid=22949) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22949)] [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:15:07.063905 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:15:07.090560 run osmo-hlr_10.42.42.2(pid=22946): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22946)] 22:15:07.138545 run osmo-hlr_10.42.42.2(pid=22946): stdout: | (launched: 2022-12-09_22:15:04.293211) 22:15:07.188174 run osmo-hlr_10.42.42.2(pid=22946): stderr: | 20221209221504467 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221504467 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221504467 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221504467 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221504467 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221504468 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221504483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221504492 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221504492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221504492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:07.256781 run osmo-msc_10.42.42.6(pid=22952): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22952)] 22:15:07.304333 run osmo-msc_10.42.42.6(pid=22952): stdout: | (launched: 2022-12-09_22:15:06.183923) 22:15:07.353841 run osmo-msc_10.42.42.6(pid=22952): stderr: | 20221209221506456 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221506456 DLGLOBAL DEBUG validating counter group 0x7f72a9eb8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221506456 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221506456 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221506456 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221506456 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221506459 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221506459 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221506459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221506459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:15:07.403561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22945): Terminating (SIGTERM) 22:15:07.443210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22948): Terminating (SIGTERM) 22:15:07.483050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22951): Terminating (SIGTERM) 22:15:07.523055 --- ParallelTerminationStrategy: PID 22945 died... 22:15:07.542149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22945): Terminated: ok {rc=0} 22:15:07.586537 --- ParallelTerminationStrategy: PID 22948 died... 22:15:07.605153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22948): Terminated: ok {rc=0} 22:15:07.649045 --- ParallelTerminationStrategy: PID 22951 died... 22:15:07.667572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22951): Terminated: ok {rc=0} 22:15:07.753322 bus /sierra_3: Setting Powered False 22:15:08.853186 bus /sierra_3: Setting Powered False 22:15:09.969925 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 22:15:11.216626 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:15:11.221122 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:15:11.255167 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 22:15:11.281192 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 22:15:11.365425 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:15:11.398821 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 22:15:11.425333 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 22:15:12.010916 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2365 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 22:15:12.015843 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:12.026534 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:15:12.078319 tst emergency_mo_mt_call.py: using LAC 24022 22:15:12.194516 tst emergency_mo_mt_call.py: using RAC 52 22:15:12.317099 tst emergency_mo_mt_call.py: using CellId 24022 22:15:12.438645 tst emergency_mo_mt_call.py: using BVCI 24023 22:15:12.554927 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:12.566497 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:12.577735 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:12.589257 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:12.600474 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:12.611834 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:12.726537 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:12.843995 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:13.332293 run create_hlr_db(pid=22957): Launched 22:15:13.460056 bus /sierra_2: Setting Powered False 22:15:14.522066 run create_hlr_db(pid=22957): Terminated: ok {rc=0} 22:15:14.962437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22959): Launched 22:15:15.277465 run osmo-hlr_10.42.42.2(pid=22960): Launched 22:15:15.398729 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:15.968604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22962): Launched 22:15:16.309706 run osmo-stp_10.42.42.5(pid=22963): Launched 22:15:16.618199 tst emergency_mo_mt_call.py: using MSISDN 7403 22:15:16.797349 run osmo-msc_10.42.42.6: Starting osmo-msc 22:15:17.346181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22965): Launched 22:15:17.661474 run osmo-msc_10.42.42.6(pid=22966): Launched 22:15:17.839836 run osmo-stp_10.42.42.5(pid=22963): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22963)] 22:15:17.972809 run osmo-stp_10.42.42.5(pid=22963): stdout: | (launched: 2022-12-09_22:15:16.235958) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:18.106879 run osmo-stp_10.42.42.5(pid=22963): stderr: | 20221209221516486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221516487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221516487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221516487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221516488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221516488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221516488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:18.241207 run osmo-stp_10.42.42.5(pid=22963): stdout: | (launched: 2022-12-09_22:15:16.235958) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:18.367737 run osmo-stp_10.42.42.5(pid=22963): stderr: | 20221209221516486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221516487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221516487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221516487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221516488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221516488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221516488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:18.518615 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=22963): Process ended prematurely: osmo-stp_10.42.42.5(pid=22963) [trial-2365↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22963)] [trial-2365↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 22:15:18.527608 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 22:15:18.555098 run osmo-hlr_10.42.42.2(pid=22960): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22960)] 22:15:18.605595 run osmo-hlr_10.42.42.2(pid=22960): stdout: | (launched: 2022-12-09_22:15:15.220355) 22:15:18.657609 run osmo-hlr_10.42.42.2(pid=22960): stderr: | 20221209221515418 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221515418 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221515418 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221515418 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221515418 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221515418 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221515430 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221515439 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221515439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221515439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:18.729939 run osmo-msc_10.42.42.6(pid=22966): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22966)] 22:15:18.780016 run osmo-msc_10.42.42.6(pid=22966): stdout: | (launched: 2022-12-09_22:15:17.604753) 22:15:18.831519 run osmo-msc_10.42.42.6(pid=22966): stderr: | 20221209221517926 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221517926 DLGLOBAL DEBUG validating counter group 0x7f1bb60d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221517927 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221517927 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221517927 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221517927 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221517929 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221517929 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221517929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221517929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:15:18.883363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22959): Terminating (SIGTERM) 22:15:18.925439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22962): Terminating (SIGTERM) 22:15:18.967641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22965): Terminating (SIGTERM) 22:15:19.010277 --- ParallelTerminationStrategy: PID 22959 died... 22:15:19.030279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22959): Terminated: ok {rc=0} 22:15:19.077009 --- ParallelTerminationStrategy: PID 22962 died... 22:15:19.096753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22962): Terminated: ok {rc=0} 22:15:19.143035 --- ParallelTerminationStrategy: PID 22965 died... 22:15:19.162672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22965): Terminated: ok {rc=0} 22:15:19.251382 bus /sierra_3: Setting Powered False 22:15:20.350726 bus /sierra_3: Setting Powered False 22:15:21.470223 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 22:15:22.557751 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:22.569524 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:15:22.621833 tst emergency_preemptive_call.py: using LAC 24023 22:15:22.746798 tst emergency_preemptive_call.py: using RAC 53 22:15:22.870581 tst emergency_preemptive_call.py: using CellId 24023 22:15:22.997253 tst emergency_preemptive_call.py: using BVCI 24024 22:15:23.111146 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:23.122592 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:23.133808 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:23.145205 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:23.156715 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:23.168018 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:23.282810 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:23.397695 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:23.516202 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:23.631236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:24.088454 run create_hlr_db(pid=22968): Launched 22:15:24.202320 bus /sierra_2: Setting Powered False 22:15:25.261324 run create_hlr_db(pid=22968): Terminated: ok {rc=0} 22:15:25.694632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22970): Launched 22:15:26.010399 run osmo-hlr_10.42.42.2(pid=22971): Launched 22:15:26.131186 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:26.677234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22973): Launched 22:15:26.993249 run osmo-stp_10.42.42.5(pid=22974): Launched 22:15:27.125343 tst emergency_preemptive_call.py: using MSISDN 7404 22:15:27.288692 run osmo-msc_10.42.42.6: Starting osmo-msc 22:15:27.854335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22976): Launched 22:15:28.169682 run osmo-msc_10.42.42.6(pid=22977): Launched 22:15:28.347520 run osmo-stp_10.42.42.5(pid=22974): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22974)] 22:15:28.482894 run osmo-stp_10.42.42.5(pid=22974): stdout: | (launched: 2022-12-09_22:15:26.935279) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:28.617365 run osmo-stp_10.42.42.5(pid=22974): stderr: | 20221209221527126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221527126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221527127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221527127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221527127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221527128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221527128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:28.751833 run osmo-stp_10.42.42.5(pid=22974): stdout: | (launched: 2022-12-09_22:15:26.935279) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:28.878604 run osmo-stp_10.42.42.5(pid=22974): stderr: | 20221209221527126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221527126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221527127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221527127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221527127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221527128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221527128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:29.031014 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=22974): Process ended prematurely: osmo-stp_10.42.42.5(pid=22974) [trial-2365↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22974)] [trial-2365↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 22:15:29.040091 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 22:15:29.067735 run osmo-hlr_10.42.42.2(pid=22971): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22971)] 22:15:29.118453 run osmo-hlr_10.42.42.2(pid=22971): stdout: | (launched: 2022-12-09_22:15:25.953322) 22:15:29.170902 run osmo-hlr_10.42.42.2(pid=22971): stderr: | 20221209221526149 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221526149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221526149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221526149 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221526149 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221526149 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221526161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221526169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221526169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221526169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:29.244318 run osmo-msc_10.42.42.6(pid=22977): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22977)] 22:15:29.294778 run osmo-msc_10.42.42.6(pid=22977): stdout: | (launched: 2022-12-09_22:15:28.112504) 22:15:29.347210 run osmo-msc_10.42.42.6(pid=22977): stderr: | 20221209221528437 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209221528437 DLGLOBAL DEBUG validating counter group 0x7f7f0b718c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209221528438 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209221528438 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209221528438 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209221528438 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209221528440 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209221528440 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209221528440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209221528440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:15:29.399712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22970): Terminating (SIGTERM) 22:15:29.441578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22973): Terminating (SIGTERM) 22:15:29.483522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22976): Terminating (SIGTERM) 22:15:29.525836 --- ParallelTerminationStrategy: PID 22970 died... 22:15:29.546063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22970): Terminated: ok {rc=0} 22:15:29.592423 --- ParallelTerminationStrategy: PID 22973 died... 22:15:29.612341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22973): Terminated: ok {rc=0} 22:15:29.658638 --- ParallelTerminationStrategy: PID 22976 died... 22:15:29.678379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22976): Terminated: ok {rc=0} 22:15:29.765800 bus /sierra_9: Setting Powered False 22:15:30.871356 bus /sierra_9: Setting Powered False 22:15:32.011691 bus /sierra_8: Setting Powered False 22:15:33.121070 bus /sierra_8: Setting Powered False 22:15:34.238155 bus /sierra_3: Setting Powered False 22:15:35.337330 bus /sierra_3: Setting Powered False 22:15:36.455424 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 22:15:37.734358 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:15:37.738685 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:15:37.775467 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 22:15:37.814813 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 22:15:37.902373 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:15:37.936278 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 22:15:37.975269 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 22:15:38.570171 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 22:15:38.622223 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:38.633334 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:15:38.683145 tst cs_paging_gprs_active.py: using LAC 24024 22:15:38.822220 tst cs_paging_gprs_active.py: using RAC 54 22:15:38.948856 tst cs_paging_gprs_active.py: using CellId 24024 22:15:39.072711 tst cs_paging_gprs_active.py: using BVCI 24025 22:15:39.183792 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:39.194768 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:39.205503 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:39.216292 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:39.226912 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:39.237598 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:39.248879 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:39.259861 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:39.270832 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:39.387087 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:39.506144 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:15:39.724328 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:15:40.049163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22982): Launched 22:15:40.331244 run iperf3-srv_10.42.42.10(pid=22983): Launched 22:15:40.453152 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:15:40.671095 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:15:40.994807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22984): Launched 22:15:41.276930 run iperf3-srv_10.42.42.10(pid=22985): Launched 22:15:41.398486 tst cs_paging_gprs_active.py:38: start network... 22:15:41.616330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:42.116345 run create_hlr_db(pid=22986): Launched 22:15:42.249228 bus /sierra_2: Setting Powered False 22:15:43.313195 run create_hlr_db(pid=22986): Terminated: ok {rc=0} 22:15:43.746529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22988): Launched 22:15:44.049516 run osmo-hlr_10.42.42.2(pid=22989): Launched 22:15:44.166917 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:44.702275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22991): Launched 22:15:45.005793 run osmo-stp_10.42.42.5(pid=22992): Launched 22:15:45.122083 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:15:45.644251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22994): Launched 22:15:45.762122 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:15:46.070252 run patchelf(pid=22995): Launched 22:15:46.261832 run osmo-stp_10.42.42.5(pid=22992): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22992)] 22:15:46.405932 run osmo-stp_10.42.42.5(pid=22992): stdout: | (launched: 2022-12-09_22:15:44.950839) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:46.548919 run osmo-stp_10.42.42.5(pid=22992): stderr: | 20221209221545119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221545119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221545120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221545120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221545121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221545121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221545121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:46.693556 run osmo-stp_10.42.42.5(pid=22992): stdout: | (launched: 2022-12-09_22:15:44.950839) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:46.830725 run osmo-stp_10.42.42.5(pid=22992): stderr: | 20221209221545119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221545119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221545120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221545120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221545121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221545121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221545121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:46.992657 run patchelf(pid=22995): Terminating (SIGINT) 22:15:47.179219 run patchelf(pid=22995): Terminated: ok {rc=0} 22:15:47.312414 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22992): Process ended prematurely: osmo-stp_10.42.42.5(pid=22992) [trial-2365↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22992)] [trial-2365↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 22:15:47.322811 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:15:47.351848 run osmo-hlr_10.42.42.2(pid=22989): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22989)] 22:15:47.402886 run osmo-hlr_10.42.42.2(pid=22989): stdout: | (launched: 2022-12-09_22:15:43.994945) 22:15:47.455403 run osmo-hlr_10.42.42.2(pid=22989): stderr: | 20221209221544169 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221544169 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221544169 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221544169 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221544169 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221544170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221544181 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221544191 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221544192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221544192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:47.508335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22982): Terminating (SIGTERM) 22:15:47.550824 run iperf3-srv_10.42.42.10(pid=22983): Terminating (SIGTERM) 22:15:47.593144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22984): Terminating (SIGTERM) 22:15:47.635455 run iperf3-srv_10.42.42.10(pid=22985): Terminating (SIGTERM) 22:15:47.677742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22988): Terminating (SIGTERM) 22:15:47.720164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22991): Terminating (SIGTERM) 22:15:47.762508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22994): Terminating (SIGTERM) 22:15:47.805219 --- ParallelTerminationStrategy: PID 22982 died... 22:15:47.825567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22982): Terminated: ok {rc=0} 22:15:47.872468 --- ParallelTerminationStrategy: PID 22983 died... 22:15:47.892089 run iperf3-srv_10.42.42.10(pid=22983): Terminated {rc=256} 22:15:47.938800 --- ParallelTerminationStrategy: PID 22984 died... 22:15:47.958627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22984): Terminated: ok {rc=0} 22:15:48.005246 --- ParallelTerminationStrategy: PID 22985 died... 22:15:48.024853 run iperf3-srv_10.42.42.10(pid=22985): Terminated {rc=256} 22:15:48.071319 --- ParallelTerminationStrategy: PID 22988 died... 22:15:48.091169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22988): Terminated: ok {rc=0} 22:15:48.137576 --- ParallelTerminationStrategy: PID 22991 died... 22:15:48.157380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22991): Terminated: ok {rc=0} 22:15:48.204315 --- ParallelTerminationStrategy: PID 22994 died... 22:15:48.224266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22994): Terminated: ok {rc=0} 22:15:48.312298 bus /gobi_0: Setting Powered False 22:15:49.411880 bus /gobi_0: Setting Powered False 22:15:50.527137 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 22:15:51.676830 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:51.688705 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:15:51.742520 tst iperf3.py: using LAC 24025 22:15:51.870211 tst iperf3.py: using RAC 55 22:15:51.998737 tst iperf3.py: using CellId 24025 22:15:52.127009 tst iperf3.py: using BVCI 24026 22:15:52.246385 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:52.257610 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:52.268481 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:52.279456 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:52.290375 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:52.301256 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:52.312260 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:52.323043 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:52.334132 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:52.450883 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:15:52.654466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:15:52.957276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22996): Launched 22:15:53.220878 run iperf3-srv_10.42.42.10(pid=22997): Launched 22:15:53.334934 tst iperf3.py:8: start network... 22:15:53.537256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:54.004438 run create_hlr_db(pid=22998): Launched 22:15:54.121621 bus /gobi_6: Setting Powered False 22:15:55.181795 run create_hlr_db(pid=22998): Terminated: ok {rc=0} 22:15:55.624624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23000): Launched 22:15:55.947876 run osmo-hlr_10.42.42.2(pid=23001): Launched 22:15:56.071986 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:56.629365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23003): Launched 22:15:56.952470 run osmo-stp_10.42.42.5(pid=23004): Launched 22:15:57.075753 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:15:57.633738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23006): Launched 22:15:57.758957 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:15:58.033698 run patchelf(pid=23007): Launched 22:15:58.215910 run osmo-stp_10.42.42.5(pid=23004): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23004)] 22:15:58.354714 run osmo-stp_10.42.42.5(pid=23004): stdout: | (launched: 2022-12-09_22:15:56.894282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:58.494474 run osmo-stp_10.42.42.5(pid=23004): stderr: | 20221209221557087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221557087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221557087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221557087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221557088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221557088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221557088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:58.634076 run osmo-stp_10.42.42.5(pid=23004): stdout: | (launched: 2022-12-09_22:15:56.894282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:58.767629 run osmo-stp_10.42.42.5(pid=23004): stderr: | 20221209221557087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221557087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221557087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221557087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221557088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221557088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221557088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:58.925301 run patchelf(pid=23007): Terminating (SIGINT) 22:15:59.109987 run patchelf(pid=23007): Terminated: ok {rc=0} 22:15:59.243474 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23004): Process ended prematurely: osmo-stp_10.42.42.5(pid=23004) [trial-2365↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23004)] [trial-2365↪gprs:trx-sysmocell5000↪iperf3.py:8] 22:15:59.253924 tst iperf3.py:8: Test FAILED (7.6 sec) 22:15:59.282932 run osmo-hlr_10.42.42.2(pid=23001): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23001)] 22:15:59.333208 run osmo-hlr_10.42.42.2(pid=23001): stdout: | (launched: 2022-12-09_22:15:55.889891) 22:15:59.385509 run osmo-hlr_10.42.42.2(pid=23001): stderr: | 20221209221556088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221556088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221556089 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221556089 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221556089 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221556089 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221556100 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221556109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221556109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221556109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:59.438032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22996): Terminating (SIGTERM) 22:15:59.480162 run iperf3-srv_10.42.42.10(pid=22997): Terminating (SIGTERM) 22:15:59.522285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23000): Terminating (SIGTERM) 22:15:59.564486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23003): Terminating (SIGTERM) 22:15:59.606577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23006): Terminating (SIGTERM) 22:15:59.648723 --- ParallelTerminationStrategy: PID 22996 died... 22:15:59.668826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22996): Terminated: ok {rc=0} 22:15:59.715609 --- ParallelTerminationStrategy: PID 22997 died... 22:15:59.735243 run iperf3-srv_10.42.42.10(pid=22997): Terminated {rc=256} 22:15:59.781639 --- ParallelTerminationStrategy: PID 23000 died... 22:15:59.801221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23000): Terminated: ok {rc=0} 22:15:59.847459 --- ParallelTerminationStrategy: PID 23003 died... 22:15:59.867149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23003): Terminated: ok {rc=0} 22:15:59.913465 --- ParallelTerminationStrategy: PID 23006 died... 22:15:59.933220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23006): Terminated: ok {rc=0} 22:16:00.021166 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 22:16:01.193391 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:01.209978 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:16:01.271372 tst iperf3m4.py: using LAC 24026 22:16:01.420137 tst iperf3m4.py: using RAC 56 22:16:01.569894 tst iperf3m4.py: using CellId 24026 22:16:01.690144 tst iperf3m4.py: using BVCI 24027 22:16:01.808859 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:01.821584 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:01.833700 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:01.845290 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:01.856935 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:01.868629 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:01.880646 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:01.892158 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:01.903971 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:16:02.023440 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:16:02.151426 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:16:02.277915 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:16:02.395824 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:16:02.599470 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:02.901597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23008): Launched 22:16:03.166302 run iperf3-srv_10.42.42.10(pid=23009): Launched 22:16:03.280822 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:16:03.483337 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:03.785884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23010): Launched 22:16:04.048539 run iperf3-srv_10.42.42.10(pid=23011): Launched 22:16:04.162818 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:16:04.364589 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:04.667387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23012): Launched 22:16:04.930008 run iperf3-srv_10.42.42.10(pid=23013): Launched 22:16:05.043693 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:16:05.245921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:05.548697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23014): Launched 22:16:05.811000 run iperf3-srv_10.42.42.10(pid=23015): Launched 22:16:05.924605 tst iperf3m4.py:8: start network... 22:16:06.126706 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:06.593349 run create_hlr_db(pid=23016): Launched 22:16:06.710180 bus /gobi_6: Setting Powered False 22:16:07.770822 run create_hlr_db(pid=23016): Terminated: ok {rc=0} 22:16:08.213963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23018): Launched 22:16:08.539304 run osmo-hlr_10.42.42.2(pid=23019): Launched 22:16:08.663835 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:09.220685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23021): Launched 22:16:09.545063 run osmo-stp_10.42.42.5(pid=23022): Launched 22:16:09.669749 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:16:10.228546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23024): Launched 22:16:10.352634 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:16:10.625311 run patchelf(pid=23025): Launched 22:16:10.805905 run osmo-stp_10.42.42.5(pid=23022): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23022)] 22:16:10.943931 run osmo-stp_10.42.42.5(pid=23022): stdout: | (launched: 2022-12-09_22:16:09.486366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:11.082825 run osmo-stp_10.42.42.5(pid=23022): stderr: | 20221209221609681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221609681 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221609681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221609682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221609682 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221609682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221609682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:11.222385 run osmo-stp_10.42.42.5(pid=23022): stdout: | (launched: 2022-12-09_22:16:09.486366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:11.355445 run osmo-stp_10.42.42.5(pid=23022): stderr: | 20221209221609681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221609681 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221609681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221609682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221609682 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221609682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221609682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:11.512692 run patchelf(pid=23025): Terminating (SIGINT) 22:16:11.696584 run patchelf(pid=23025): Terminated: ok {rc=0} 22:16:11.828376 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23022): Process ended prematurely: osmo-stp_10.42.42.5(pid=23022) [trial-2365↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23022)] [trial-2365↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 22:16:11.838615 tst iperf3m4.py:8: Test FAILED (10.7 sec) 22:16:11.867422 run osmo-hlr_10.42.42.2(pid=23019): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23019)] 22:16:11.917835 run osmo-hlr_10.42.42.2(pid=23019): stdout: | (launched: 2022-12-09_22:16:08.480653) 22:16:11.969714 run osmo-hlr_10.42.42.2(pid=23019): stderr: | 20221209221608678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221608678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221608678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221608678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221608679 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221608679 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221608691 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221608699 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221608699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221608699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:12.022069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23008): Terminating (SIGTERM) 22:16:12.064031 run iperf3-srv_10.42.42.10(pid=23009): Terminating (SIGTERM) 22:16:12.105825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23010): Terminating (SIGTERM) 22:16:12.147713 run iperf3-srv_10.42.42.10(pid=23011): Terminating (SIGTERM) 22:16:12.189762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23012): Terminating (SIGTERM) 22:16:12.231952 run iperf3-srv_10.42.42.10(pid=23013): Terminating (SIGTERM) 22:16:12.273788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23014): Terminating (SIGTERM) 22:16:12.315730 run iperf3-srv_10.42.42.10(pid=23015): Terminating (SIGTERM) 22:16:12.357586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23018): Terminating (SIGTERM) 22:16:12.399454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23021): Terminating (SIGTERM) 22:16:12.441650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23024): Terminating (SIGTERM) 22:16:12.483941 --- ParallelTerminationStrategy: PID 23008 died... 22:16:12.504149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23008): Terminated: ok {rc=0} 22:16:12.550859 --- ParallelTerminationStrategy: PID 23009 died... 22:16:12.570468 run iperf3-srv_10.42.42.10(pid=23009): Terminated {rc=256} 22:16:12.616769 --- ParallelTerminationStrategy: PID 23010 died... 22:16:12.636236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23010): Terminated: ok {rc=0} 22:16:12.682854 --- ParallelTerminationStrategy: PID 23011 died... 22:16:12.702408 run iperf3-srv_10.42.42.10(pid=23011): Terminated {rc=256} 22:16:12.748535 --- ParallelTerminationStrategy: PID 23012 died... 22:16:12.768212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23012): Terminated: ok {rc=0} 22:16:12.814646 --- ParallelTerminationStrategy: PID 23013 died... 22:16:12.834295 run iperf3-srv_10.42.42.10(pid=23013): Terminated {rc=256} 22:16:12.880239 --- ParallelTerminationStrategy: PID 23014 died... 22:16:12.899999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23014): Terminated: ok {rc=0} 22:16:12.946284 --- ParallelTerminationStrategy: PID 23015 died... 22:16:12.965889 run iperf3-srv_10.42.42.10(pid=23015): Terminated {rc=256} 22:16:13.011669 --- ParallelTerminationStrategy: PID 23018 died... 22:16:13.031274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23018): Terminated: ok {rc=0} 22:16:13.077314 --- ParallelTerminationStrategy: PID 23021 died... 22:16:13.096494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23021): Terminated: ok {rc=0} 22:16:13.142713 --- ParallelTerminationStrategy: PID 23024 died... 22:16:13.162506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23024): Terminated: ok {rc=0} 22:16:13.251013 bus /gobi_4: Setting Powered False 22:16:14.351884 bus /gobi_4: Setting Powered False 22:16:15.467561 bus /gobi_1: Setting Powered False 22:16:16.564186 bus /gobi_1: Setting Powered False 22:16:17.682337 bus /gobi_0: Setting Powered False 22:16:18.781534 bus /gobi_0: Setting Powered False 22:16:19.895115 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 22:16:20.998893 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:21.010951 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:16:21.062570 tst ping.py: using LAC 24027 22:16:21.187866 tst ping.py: using RAC 57 22:16:21.305842 tst ping.py: using CellId 24027 22:16:21.423791 tst ping.py: using BVCI 24028 22:16:21.530981 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:21.542126 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:21.553225 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:21.564099 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:21.574852 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:21.585681 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:21.596439 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:21.607232 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:16:21.725472 tst ping.py:19: start network... 22:16:21.940412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:22.429505 run create_hlr_db(pid=23026): Launched 22:16:22.559779 bus /gobi_6: Setting Powered False 22:16:23.622588 run create_hlr_db(pid=23026): Terminated: ok {rc=0} 22:16:24.046276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23028): Launched 22:16:24.342651 run osmo-hlr_10.42.42.2(pid=23029): Launched 22:16:24.458368 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:24.970106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23031): Launched 22:16:25.266402 run osmo-stp_10.42.42.5(pid=23032): Launched 22:16:25.379583 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:16:25.889063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23034): Launched 22:16:26.002960 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:16:26.253162 run patchelf(pid=23035): Launched 22:16:26.419232 run osmo-stp_10.42.42.5(pid=23032): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23032)] 22:16:26.545772 run osmo-stp_10.42.42.5(pid=23032): stdout: | (launched: 2022-12-09_22:16:25.212775) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:26.674208 run osmo-stp_10.42.42.5(pid=23032): stderr: | 20221209221625381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221625381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221625381 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221625382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221625382 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221625382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221625382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:26.802577 run osmo-stp_10.42.42.5(pid=23032): stdout: | (launched: 2022-12-09_22:16:25.212775) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:26.924539 run osmo-stp_10.42.42.5(pid=23032): stderr: | 20221209221625381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221625381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221625381 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221625382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221625382 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221625382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221625382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:27.068807 run patchelf(pid=23035): Terminating (SIGINT) 22:16:27.237572 run patchelf(pid=23035): Terminated: ok {rc=0} 22:16:27.358483 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23032): Process ended prematurely: osmo-stp_10.42.42.5(pid=23032) [trial-2365↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23032)] [trial-2365↪gprs:trx-sysmocell5000↪ping.py:22] 22:16:27.367248 tst ping.py:22: Test FAILED (6.4 sec) 22:16:27.394611 run osmo-hlr_10.42.42.2(pid=23029): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23029)] 22:16:27.442884 run osmo-hlr_10.42.42.2(pid=23029): stdout: | (launched: 2022-12-09_22:16:24.288654) 22:16:27.493115 run osmo-hlr_10.42.42.2(pid=23029): stderr: | 20221209221624465 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221624465 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221624465 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221624465 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221624465 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221624465 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221624478 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221624489 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221624489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221624489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:27.543404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23028): Terminating (SIGTERM) 22:16:27.583526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23031): Terminating (SIGTERM) 22:16:27.623624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23034): Terminating (SIGTERM) 22:16:27.664197 --- ParallelTerminationStrategy: PID 23028 died... 22:16:27.683472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23028): Terminated: ok {rc=0} 22:16:27.728706 --- ParallelTerminationStrategy: PID 23031 died... 22:16:27.747537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23031): Terminated: ok {rc=0} 22:16:27.792348 --- ParallelTerminationStrategy: PID 23034 died... 22:16:27.811217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23034): Terminated: ok {rc=0} 22:16:27.897657 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 22:16:28.987105 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:28.998954 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:16:29.052874 tst ping_idle_ping.py: using LAC 24028 22:16:29.170137 tst ping_idle_ping.py: using RAC 58 22:16:29.286434 tst ping_idle_ping.py: using CellId 24028 22:16:29.401629 tst ping_idle_ping.py: using BVCI 24029 22:16:29.519460 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:29.531357 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:29.542972 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:29.554597 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:29.566173 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:29.577419 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:29.589105 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:29.599895 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:16:29.714480 tst ping_idle_ping.py:24: start network... 22:16:29.913937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:30.374419 run create_hlr_db(pid=23036): Launched 22:16:30.488207 bus /gobi_6: Setting Powered False 22:16:31.546547 run create_hlr_db(pid=23036): Terminated: ok {rc=0} 22:16:31.976351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23038): Launched 22:16:32.284224 run osmo-hlr_10.42.42.2(pid=23039): Launched 22:16:32.397834 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:32.910886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23041): Launched 22:16:33.208177 run osmo-stp_10.42.42.5(pid=23042): Launched 22:16:33.321509 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:16:33.833806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23044): Launched 22:16:33.948699 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:16:34.201682 run patchelf(pid=23045): Launched 22:16:34.367568 run osmo-stp_10.42.42.5(pid=23042): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23042)] 22:16:34.493728 run osmo-stp_10.42.42.5(pid=23042): stdout: | (launched: 2022-12-09_22:16:33.153869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:34.621590 run osmo-stp_10.42.42.5(pid=23042): stderr: | 20221209221633324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221633324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221633324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221633325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221633325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221633325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221633325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:34.749879 run osmo-stp_10.42.42.5(pid=23042): stdout: | (launched: 2022-12-09_22:16:33.153869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:34.871824 run osmo-stp_10.42.42.5(pid=23042): stderr: | 20221209221633324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221633324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221633324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221633325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221633325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221633325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221633325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:35.015818 run patchelf(pid=23045): Terminating (SIGINT) 22:16:35.184070 run patchelf(pid=23045): Terminated: ok {rc=0} 22:16:35.305378 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23042): Process ended prematurely: osmo-stp_10.42.42.5(pid=23042) [trial-2365↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23042)] [trial-2365↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 22:16:35.314203 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 22:16:35.341409 run osmo-hlr_10.42.42.2(pid=23039): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23039)] 22:16:35.389152 run osmo-hlr_10.42.42.2(pid=23039): stdout: | (launched: 2022-12-09_22:16:32.229753) 22:16:35.438590 run osmo-hlr_10.42.42.2(pid=23039): stderr: | 20221209221632405 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221632405 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221632405 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221632405 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221632405 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221632406 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221632420 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221632430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221632430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221632430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:35.488720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23038): Terminating (SIGTERM) 22:16:35.528811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23041): Terminating (SIGTERM) 22:16:35.569246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23044): Terminating (SIGTERM) 22:16:35.610062 --- ParallelTerminationStrategy: PID 23038 died... 22:16:35.629190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23038): Terminated: ok {rc=0} 22:16:35.673842 --- ParallelTerminationStrategy: PID 23041 died... 22:16:35.692301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23041): Terminated: ok {rc=0} 22:16:35.736872 --- ParallelTerminationStrategy: PID 23044 died... 22:16:35.755924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23044): Terminated: ok {rc=0} 22:16:35.840719 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 22:16:37.155794 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:16:37.162097 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:16:37.198339 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:16:37.238305 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:16:37.327002 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:16:37.361658 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:16:37.401206 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:16:37.997938 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:16:38.049550 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:38.060591 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:16:38.114695 tst cs_paging_gprs_active.py: using LAC 24029 22:16:38.233926 tst cs_paging_gprs_active.py: using RAC 59 22:16:38.352933 tst cs_paging_gprs_active.py: using CellId 24029 22:16:38.469640 tst cs_paging_gprs_active.py: using BVCI 24030 22:16:38.589330 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:38.600640 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:38.611858 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:38.623551 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:38.635078 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:38.646806 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:38.658670 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:38.670225 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:38.682405 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:16:38.798936 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:16:38.921900 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:16:39.142089 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:39.466283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23050): Launched 22:16:39.747976 run iperf3-srv_10.42.42.10(pid=23051): Launched 22:16:39.869199 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:16:40.086696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:40.410340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23052): Launched 22:16:40.691481 run iperf3-srv_10.42.42.10(pid=23053): Launched 22:16:40.812716 tst cs_paging_gprs_active.py:38: start network... 22:16:41.030662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:41.530610 run create_hlr_db(pid=23054): Launched 22:16:41.661904 bus /gobi_6: Setting Powered False 22:16:42.725414 run create_hlr_db(pid=23054): Terminated: ok {rc=0} 22:16:43.156483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23056): Launched 22:16:43.459891 run osmo-hlr_10.42.42.2(pid=23057): Launched 22:16:43.576840 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:44.111410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23059): Launched 22:16:44.414971 run osmo-stp_10.42.42.5(pid=23060): Launched 22:16:44.531832 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:16:45.054301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23062): Launched 22:16:45.171432 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:16:45.428042 run patchelf(pid=23063): Launched 22:16:45.598482 run osmo-stp_10.42.42.5(pid=23060): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23060)] 22:16:45.727831 run osmo-stp_10.42.42.5(pid=23060): stdout: | (launched: 2022-12-09_22:16:44.360201) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:45.858616 run osmo-stp_10.42.42.5(pid=23060): stderr: | 20221209221644529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221644529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221644529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221644530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221644530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221644530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221644530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:45.992375 run osmo-stp_10.42.42.5(pid=23060): stdout: | (launched: 2022-12-09_22:16:44.360201) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:46.120831 run osmo-stp_10.42.42.5(pid=23060): stderr: | 20221209221644529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221644529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221644529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221644530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221644530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221644530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221644530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:46.273825 run patchelf(pid=23063): Terminating (SIGINT) 22:16:46.450245 run patchelf(pid=23063): Terminated: ok {rc=0} 22:16:46.578132 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23060): Process ended prematurely: osmo-stp_10.42.42.5(pid=23060) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23060)] [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:16:46.589058 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:16:46.619492 run osmo-hlr_10.42.42.2(pid=23057): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23057)] 22:16:46.669819 run osmo-hlr_10.42.42.2(pid=23057): stdout: | (launched: 2022-12-09_22:16:43.405156) 22:16:46.721763 run osmo-hlr_10.42.42.2(pid=23057): stderr: | 20221209221643579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221643579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221643579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221643579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221643579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221643579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221643592 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221643601 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221643601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221643601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:46.774224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23050): Terminating (SIGTERM) 22:16:46.817149 run iperf3-srv_10.42.42.10(pid=23051): Terminating (SIGTERM) 22:16:46.862107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23052): Terminating (SIGTERM) 22:16:46.905480 run iperf3-srv_10.42.42.10(pid=23053): Terminating (SIGTERM) 22:16:46.950710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23056): Terminating (SIGTERM) 22:16:46.993990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23059): Terminating (SIGTERM) 22:16:47.038242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23062): Terminating (SIGTERM) 22:16:47.082109 --- ParallelTerminationStrategy: PID 23050 died... 22:16:47.101793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23050): Terminated: ok {rc=0} 22:16:47.149315 --- ParallelTerminationStrategy: PID 23051 died... 22:16:47.168764 run iperf3-srv_10.42.42.10(pid=23051): Terminated {rc=256} 22:16:47.215834 --- ParallelTerminationStrategy: PID 23052 died... 22:16:47.234548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23052): Terminated: ok {rc=0} 22:16:47.278832 --- ParallelTerminationStrategy: PID 23053 died... 22:16:47.297575 run iperf3-srv_10.42.42.10(pid=23053): Terminated {rc=256} 22:16:47.341718 --- ParallelTerminationStrategy: PID 23056 died... 22:16:47.360283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23056): Terminated: ok {rc=0} 22:16:47.404459 --- ParallelTerminationStrategy: PID 23059 died... 22:16:47.422971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23059): Terminated: ok {rc=0} 22:16:47.467540 --- ParallelTerminationStrategy: PID 23062 died... 22:16:47.486208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23062): Terminated: ok {rc=0} 22:16:47.572292 bus /gobi_0: Setting Powered False 22:16:48.671057 bus /gobi_0: Setting Powered False 22:16:49.787448 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:16:50.937688 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:50.949603 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:16:51.004760 tst iperf3.py: using LAC 24030 22:16:51.133247 tst iperf3.py: using RAC 60 22:16:51.259265 tst iperf3.py: using CellId 24030 22:16:51.385731 tst iperf3.py: using BVCI 24031 22:16:51.502182 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:51.513617 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:51.524771 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:51.535988 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:51.547144 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:51.558364 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:51.569682 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:51.580695 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:51.592034 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:16:51.715180 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:16:51.932547 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:52.254961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23064): Launched 22:16:52.534240 run iperf3-srv_10.42.42.10(pid=23065): Launched 22:16:52.654816 tst iperf3.py:8: start network... 22:16:52.871231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:53.369703 run create_hlr_db(pid=23066): Launched 22:16:53.500134 bus /gobi_6: Setting Powered False 22:16:54.564268 run create_hlr_db(pid=23066): Terminated: ok {rc=0} 22:16:54.995475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23068): Launched 22:16:55.300718 run osmo-hlr_10.42.42.2(pid=23069): Launched 22:16:55.417141 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:55.950716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23071): Launched 22:16:56.252468 run osmo-stp_10.42.42.5(pid=23072): Launched 22:16:56.367954 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:16:56.888144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23074): Launched 22:16:57.005563 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:16:57.261689 run patchelf(pid=23075): Launched 22:16:57.430498 run osmo-stp_10.42.42.5(pid=23072): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23072)] 22:16:57.559395 run osmo-stp_10.42.42.5(pid=23072): stdout: | (launched: 2022-12-09_22:16:56.197830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:57.689243 run osmo-stp_10.42.42.5(pid=23072): stderr: | 20221209221656369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221656369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221656369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221656370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221656370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221656370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221656370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:57.819614 run osmo-stp_10.42.42.5(pid=23072): stdout: | (launched: 2022-12-09_22:16:56.197830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:57.943349 run osmo-stp_10.42.42.5(pid=23072): stderr: | 20221209221656369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221656369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221656369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221656370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221656370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221656370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221656370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:58.090037 run patchelf(pid=23075): Terminating (SIGINT) 22:16:58.261662 run patchelf(pid=23075): Terminated: ok {rc=0} 22:16:58.385120 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23072): Process ended prematurely: osmo-stp_10.42.42.5(pid=23072) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23072)] [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 22:16:58.394620 tst iperf3.py:8: Test FAILED (7.5 sec) 22:16:58.422188 run osmo-hlr_10.42.42.2(pid=23069): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23069)] 22:16:58.470062 run osmo-hlr_10.42.42.2(pid=23069): stdout: | (launched: 2022-12-09_22:16:55.245478) 22:16:58.519495 run osmo-hlr_10.42.42.2(pid=23069): stderr: | 20221209221655422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221655422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221655422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221655423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221655423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221655423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221655435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221655444 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221655444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221655444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:58.569403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23064): Terminating (SIGTERM) 22:16:58.609786 run iperf3-srv_10.42.42.10(pid=23065): Terminating (SIGTERM) 22:16:58.650316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23068): Terminating (SIGTERM) 22:16:58.690318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23071): Terminating (SIGTERM) 22:16:58.730481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23074): Terminating (SIGTERM) 22:16:58.770709 --- ParallelTerminationStrategy: PID 23064 died... 22:16:58.789854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23064): Terminated: ok {rc=0} 22:16:58.834519 --- ParallelTerminationStrategy: PID 23065 died... 22:16:58.853092 run iperf3-srv_10.42.42.10(pid=23065): Terminated {rc=256} 22:16:58.897377 --- ParallelTerminationStrategy: PID 23068 died... 22:16:58.915947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23068): Terminated: ok {rc=0} 22:16:58.960566 --- ParallelTerminationStrategy: PID 23071 died... 22:16:58.979326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23071): Terminated: ok {rc=0} 22:16:59.024267 --- ParallelTerminationStrategy: PID 23074 died... 22:16:59.042924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23074): Terminated: ok {rc=0} 22:16:59.127924 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:17:00.272898 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:00.284510 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:17:00.337369 tst iperf3m4.py: using LAC 24031 22:17:00.457290 tst iperf3m4.py: using RAC 61 22:17:00.577421 tst iperf3m4.py: using CellId 24031 22:17:00.695659 tst iperf3m4.py: using BVCI 24032 22:17:00.806712 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:00.817833 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:00.828820 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:00.840485 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:00.852316 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:00.864025 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:00.876467 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:00.889256 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:00.902079 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:17:01.027915 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:17:01.152785 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:17:01.305360 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:17:01.458375 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:17:01.703099 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:02.053496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23079): Launched 22:17:02.372607 run iperf3-srv_10.42.42.10(pid=23080): Launched 22:17:02.495528 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:17:02.714809 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:03.038276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23081): Launched 22:17:03.319426 run iperf3-srv_10.42.42.10(pid=23082): Launched 22:17:03.440680 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:17:03.658266 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:03.982592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23083): Launched 22:17:04.263418 run iperf3-srv_10.42.42.10(pid=23084): Launched 22:17:04.384940 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:17:04.602227 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:04.925477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23085): Launched 22:17:05.209110 run iperf3-srv_10.42.42.10(pid=23086): Launched 22:17:05.331478 tst iperf3m4.py:8: start network... 22:17:05.548699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:06.048570 run create_hlr_db(pid=23087): Launched 22:17:06.179528 bus /gobi_6: Setting Powered False 22:17:07.243393 run create_hlr_db(pid=23087): Terminated: ok {rc=0} 22:17:07.674935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23089): Launched 22:17:07.977265 run osmo-hlr_10.42.42.2(pid=23090): Launched 22:17:08.092694 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:08.612568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23092): Launched 22:17:08.916778 run osmo-stp_10.42.42.5(pid=23093): Launched 22:17:09.033264 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:17:09.553742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23095): Launched 22:17:09.670137 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:17:09.925500 run patchelf(pid=23096): Launched 22:17:10.096327 run osmo-stp_10.42.42.5(pid=23093): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23093)] 22:17:10.225903 run osmo-stp_10.42.42.5(pid=23093): stdout: | (launched: 2022-12-09_22:17:08.861640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:10.357206 run osmo-stp_10.42.42.5(pid=23093): stderr: | 20221209221709030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221709030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221709030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221709031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221709031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221709031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221709031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:10.488465 run osmo-stp_10.42.42.5(pid=23093): stdout: | (launched: 2022-12-09_22:17:08.861640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:10.613124 run osmo-stp_10.42.42.5(pid=23093): stderr: | 20221209221709030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221709030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221709030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221709031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221709031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221709031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221709031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:10.761691 run patchelf(pid=23096): Terminating (SIGINT) 22:17:10.935189 run patchelf(pid=23096): Terminated: ok {rc=0} 22:17:11.059705 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23093): Process ended prematurely: osmo-stp_10.42.42.5(pid=23093) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23093)] [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 22:17:11.069221 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:17:11.097511 run osmo-hlr_10.42.42.2(pid=23090): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23090)] 22:17:11.145471 run osmo-hlr_10.42.42.2(pid=23090): stdout: | (launched: 2022-12-09_22:17:07.922269) 22:17:11.195143 run osmo-hlr_10.42.42.2(pid=23090): stderr: | 20221209221708097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221708097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221708097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221708097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221708097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221708097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221708113 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221708123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221708123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221708123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:11.245317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23079): Terminating (SIGTERM) 22:17:11.285334 run iperf3-srv_10.42.42.10(pid=23080): Terminating (SIGTERM) 22:17:11.325043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23081): Terminating (SIGTERM) 22:17:11.365106 run iperf3-srv_10.42.42.10(pid=23082): Terminating (SIGTERM) 22:17:11.404786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23083): Terminating (SIGTERM) 22:17:11.444385 run iperf3-srv_10.42.42.10(pid=23084): Terminating (SIGTERM) 22:17:11.484187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23085): Terminating (SIGTERM) 22:17:11.524606 run iperf3-srv_10.42.42.10(pid=23086): Terminating (SIGTERM) 22:17:11.564583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23089): Terminating (SIGTERM) 22:17:11.604473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23092): Terminating (SIGTERM) 22:17:11.644428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23095): Terminating (SIGTERM) 22:17:11.684778 --- ParallelTerminationStrategy: PID 23079 died... 22:17:11.703866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23079): Terminated: ok {rc=0} 22:17:11.748490 --- ParallelTerminationStrategy: PID 23080 died... 22:17:11.767125 run iperf3-srv_10.42.42.10(pid=23080): Terminated {rc=256} 22:17:11.811292 --- ParallelTerminationStrategy: PID 23081 died... 22:17:11.830116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23081): Terminated: ok {rc=0} 22:17:11.874443 --- ParallelTerminationStrategy: PID 23082 died... 22:17:11.893037 run iperf3-srv_10.42.42.10(pid=23082): Terminated {rc=256} 22:17:11.936934 --- ParallelTerminationStrategy: PID 23083 died... 22:17:11.955578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23083): Terminated: ok {rc=0} 22:17:11.999895 --- ParallelTerminationStrategy: PID 23084 died... 22:17:12.018596 run iperf3-srv_10.42.42.10(pid=23084): Terminated {rc=256} 22:17:12.062756 --- ParallelTerminationStrategy: PID 23085 died... 22:17:12.081406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23085): Terminated: ok {rc=0} 22:17:12.125974 --- ParallelTerminationStrategy: PID 23086 died... 22:17:12.144598 run iperf3-srv_10.42.42.10(pid=23086): Terminated {rc=256} 22:17:12.188868 --- ParallelTerminationStrategy: PID 23089 died... 22:17:12.207840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23089): Terminated: ok {rc=0} 22:17:12.252176 --- ParallelTerminationStrategy: PID 23092 died... 22:17:12.270890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23092): Terminated: ok {rc=0} 22:17:12.315307 --- ParallelTerminationStrategy: PID 23095 died... 22:17:12.334136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23095): Terminated: ok {rc=0} 22:17:12.419405 bus /gobi_4: Setting Powered False 22:17:13.518260 bus /gobi_4: Setting Powered False 22:17:14.638255 bus /gobi_1: Setting Powered False 22:17:15.737389 bus /gobi_1: Setting Powered False 22:17:16.849358 bus /gobi_0: Setting Powered False 22:17:17.945833 bus /gobi_0: Setting Powered False 22:17:19.062492 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 22:17:20.166873 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:20.178516 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:17:20.229556 tst ping.py: using LAC 24032 22:17:20.356176 tst ping.py: using RAC 62 22:17:20.480610 tst ping.py: using CellId 24032 22:17:20.605654 tst ping.py: using BVCI 24033 22:17:20.720625 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:20.732287 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:20.743812 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:20.755235 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:20.766533 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:20.777997 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:20.789540 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:20.800869 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:17:20.916528 tst ping.py:19: start network... 22:17:21.116399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:21.598678 run create_hlr_db(pid=23097): Launched 22:17:21.726926 bus /gobi_6: Setting Powered False 22:17:22.789994 run create_hlr_db(pid=23097): Terminated: ok {rc=0} 22:17:23.231920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23099): Launched 22:17:23.548717 run osmo-hlr_10.42.42.2(pid=23100): Launched 22:17:23.669505 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:24.221946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23102): Launched 22:17:24.539046 run osmo-stp_10.42.42.5(pid=23103): Launched 22:17:24.659482 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:17:25.205834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23105): Launched 22:17:25.329071 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:17:25.598813 run patchelf(pid=23106): Launched 22:17:25.775340 run osmo-stp_10.42.42.5(pid=23103): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23103)] 22:17:25.912139 run osmo-stp_10.42.42.5(pid=23103): stdout: | (launched: 2022-12-09_22:17:24.481922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:26.049693 run osmo-stp_10.42.42.5(pid=23103): stderr: | 20221209221724675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221724675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221724676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221724676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221724676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221724676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221724677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:26.186714 run osmo-stp_10.42.42.5(pid=23103): stdout: | (launched: 2022-12-09_22:17:24.481922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:26.317191 run osmo-stp_10.42.42.5(pid=23103): stderr: | 20221209221724675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221724675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221724676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221724676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221724676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221724676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221724677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:26.471149 run patchelf(pid=23106): Terminating (SIGINT) 22:17:26.651011 run patchelf(pid=23106): Terminated: ok {rc=0} 22:17:26.780113 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23103): Process ended prematurely: osmo-stp_10.42.42.5(pid=23103) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23103)] [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 22:17:26.789856 tst ping.py:22: Test FAILED (6.6 sec) 22:17:26.818306 run osmo-hlr_10.42.42.2(pid=23100): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23100)] 22:17:26.868321 run osmo-hlr_10.42.42.2(pid=23100): stdout: | (launched: 2022-12-09_22:17:23.491376) 22:17:26.920269 run osmo-hlr_10.42.42.2(pid=23100): stderr: | 20221209221723689 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221723689 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221723689 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221723690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221723690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221723690 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221723702 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221723710 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221723710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221723711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:26.972610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23099): Terminating (SIGTERM) 22:17:27.014622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23102): Terminating (SIGTERM) 22:17:27.056817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23105): Terminating (SIGTERM) 22:17:27.099399 --- ParallelTerminationStrategy: PID 23099 died... 22:17:27.119607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23099): Terminated: ok {rc=0} 22:17:27.166367 --- ParallelTerminationStrategy: PID 23102 died... 22:17:27.186061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23102): Terminated: ok {rc=0} 22:17:27.232463 --- ParallelTerminationStrategy: PID 23105 died... 22:17:27.252403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23105): Terminated: ok {rc=0} 22:17:27.340913 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:17:28.429737 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:28.441700 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:17:28.494212 tst ping_idle_ping.py: using LAC 24033 22:17:28.611515 tst ping_idle_ping.py: using RAC 63 22:17:28.733453 tst ping_idle_ping.py: using CellId 24033 22:17:28.849545 tst ping_idle_ping.py: using BVCI 24034 22:17:28.966480 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:28.978192 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:28.989720 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:29.001537 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:29.013475 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:29.025139 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:29.037732 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:29.049415 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:17:29.166304 tst ping_idle_ping.py:24: start network... 22:17:29.367150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:29.830613 run create_hlr_db(pid=23107): Launched 22:17:29.945320 bus /gobi_6: Setting Powered False 22:17:31.004912 run create_hlr_db(pid=23107): Terminated: ok {rc=0} 22:17:31.439522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23109): Launched 22:17:31.889695 run osmo-hlr_10.42.42.2(pid=23110): Launched 22:17:32.085845 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:32.732845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23112): Launched 22:17:33.050108 run osmo-stp_10.42.42.5(pid=23113): Launched 22:17:33.171423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:17:33.720395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23115): Launched 22:17:33.842941 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:17:34.112400 run patchelf(pid=23116): Launched 22:17:34.291117 run osmo-stp_10.42.42.5(pid=23113): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23113)] 22:17:34.426962 run osmo-stp_10.42.42.5(pid=23113): stdout: | (launched: 2022-12-09_22:17:32.992615) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:34.564077 run osmo-stp_10.42.42.5(pid=23113): stderr: | 20221209221733182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221733182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221733183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221733183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221733183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221733183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221733184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:34.701133 run osmo-stp_10.42.42.5(pid=23113): stdout: | (launched: 2022-12-09_22:17:32.992615) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:34.831411 run osmo-stp_10.42.42.5(pid=23113): stderr: | 20221209221733182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221733182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221733183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221733183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221733183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221733183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221733184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:34.986458 run patchelf(pid=23116): Terminating (SIGINT) 22:17:35.166745 run patchelf(pid=23116): Terminated: ok {rc=0} 22:17:35.296542 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23113): Process ended prematurely: osmo-stp_10.42.42.5(pid=23113) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23113)] [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 22:17:35.306333 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 22:17:35.334708 run osmo-hlr_10.42.42.2(pid=23110): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23110)] 22:17:35.384812 run osmo-hlr_10.42.42.2(pid=23110): stdout: | (launched: 2022-12-09_22:17:31.810033) 22:17:35.436895 run osmo-hlr_10.42.42.2(pid=23110): stderr: | 20221209221732186 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221732186 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221732186 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221732186 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221732186 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221732186 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221732209 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221732223 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221732224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221732224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:35.489278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23109): Terminating (SIGTERM) 22:17:35.531097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23112): Terminating (SIGTERM) 22:17:35.573161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23115): Terminating (SIGTERM) 22:17:35.615410 --- ParallelTerminationStrategy: PID 23109 died... 22:17:35.635564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23109): Terminated: ok {rc=0} 22:17:35.682350 --- ParallelTerminationStrategy: PID 23112 died... 22:17:35.702025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23112): Terminated: ok {rc=0} 22:17:35.748444 --- ParallelTerminationStrategy: PID 23115 died... 22:17:35.768066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23115): Terminated: ok {rc=0} 22:17:35.856996 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:17:37.180159 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:17:37.186825 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:17:37.222650 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:17:37.262676 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:17:37.349943 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:17:37.384547 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:17:37.424081 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:17:38.023598 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:17:38.076541 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:38.087923 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:17:38.159527 tst cs_paging_gprs_active.py: using LAC 24034 22:17:38.286600 tst cs_paging_gprs_active.py: using RAC 64 22:17:38.413953 tst cs_paging_gprs_active.py: using CellId 24034 22:17:38.538859 tst cs_paging_gprs_active.py: using BVCI 24035 22:17:38.656389 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:38.668352 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:38.680105 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:38.693506 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:38.705093 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:38.715950 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:38.727597 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:38.738868 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:38.750514 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:17:38.872356 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:17:38.994292 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:17:39.213556 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:39.538368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23123): Launched 22:17:39.819768 run iperf3-srv_10.42.42.10(pid=23124): Launched 22:17:39.941738 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:17:40.160713 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:40.485818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23125): Launched 22:17:40.767360 run iperf3-srv_10.42.42.10(pid=23126): Launched 22:17:40.889006 tst cs_paging_gprs_active.py:38: start network... 22:17:41.107261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:41.608896 run create_hlr_db(pid=23127): Launched 22:17:41.741279 bus /gobi_6: Setting Powered False 22:17:42.805042 run create_hlr_db(pid=23127): Terminated: ok {rc=0} 22:17:43.237043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23129): Launched 22:17:43.540782 run osmo-hlr_10.42.42.2(pid=23130): Launched 22:17:43.657234 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:44.177219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23132): Launched 22:17:44.480290 run osmo-stp_10.42.42.5(pid=23133): Launched 22:17:44.597152 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:17:45.119044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23135): Launched 22:17:45.235945 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:17:45.492149 run patchelf(pid=23136): Launched 22:17:45.662460 run osmo-stp_10.42.42.5(pid=23133): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23133)] 22:17:45.791201 run osmo-stp_10.42.42.5(pid=23133): stdout: | (launched: 2022-12-09_22:17:44.425636) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:45.943590 run osmo-stp_10.42.42.5(pid=23133): stderr: | 20221209221744596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221744596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221744597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221744597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221744597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221744598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221744598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:46.077660 run osmo-stp_10.42.42.5(pid=23133): stdout: | (launched: 2022-12-09_22:17:44.425636) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:46.206095 run osmo-stp_10.42.42.5(pid=23133): stderr: | 20221209221744596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221744596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221744597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221744597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221744597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221744598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221744598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:46.359261 run patchelf(pid=23136): Terminating (SIGINT) 22:17:46.535582 run patchelf(pid=23136): Terminated: ok {rc=0} 22:17:46.663173 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23133): Process ended prematurely: osmo-stp_10.42.42.5(pid=23133) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23133)] [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:17:46.673895 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:17:46.704676 run osmo-hlr_10.42.42.2(pid=23130): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23130)] 22:17:46.755453 run osmo-hlr_10.42.42.2(pid=23130): stdout: | (launched: 2022-12-09_22:17:43.485676) 22:17:46.807548 run osmo-hlr_10.42.42.2(pid=23130): stderr: | 20221209221743661 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221743661 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221743661 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221743661 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221743661 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221743661 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221743699 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221743709 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221743710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221743710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:46.860134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23123): Terminating (SIGTERM) 22:17:46.902954 run iperf3-srv_10.42.42.10(pid=23124): Terminating (SIGTERM) 22:17:46.946908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23125): Terminating (SIGTERM) 22:17:46.991479 run iperf3-srv_10.42.42.10(pid=23126): Terminating (SIGTERM) 22:17:47.036701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23129): Terminating (SIGTERM) 22:17:47.079623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23132): Terminating (SIGTERM) 22:17:47.121951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23135): Terminating (SIGTERM) 22:17:47.164266 --- ParallelTerminationStrategy: PID 23123 died... 22:17:47.183951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23123): Terminated: ok {rc=0} 22:17:47.230900 --- ParallelTerminationStrategy: PID 23124 died... 22:17:47.249549 run iperf3-srv_10.42.42.10(pid=23124): Terminated {rc=256} 22:17:47.294210 --- ParallelTerminationStrategy: PID 23125 died... 22:17:47.313018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23125): Terminated: ok {rc=0} 22:17:47.357549 --- ParallelTerminationStrategy: PID 23126 died... 22:17:47.376120 run iperf3-srv_10.42.42.10(pid=23126): Terminated {rc=256} 22:17:47.420586 --- ParallelTerminationStrategy: PID 23129 died... 22:17:47.439382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23129): Terminated: ok {rc=0} 22:17:47.484246 --- ParallelTerminationStrategy: PID 23132 died... 22:17:47.502995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23132): Terminated: ok {rc=0} 22:17:47.547705 --- ParallelTerminationStrategy: PID 23135 died... 22:17:47.566397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23135): Terminated: ok {rc=0} 22:17:47.651903 bus /gobi_0: Setting Powered False 22:17:48.751944 bus /gobi_0: Setting Powered False 22:17:49.868531 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:17:51.016226 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:51.027880 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:17:51.101142 tst iperf3.py: using LAC 24035 22:17:51.220401 tst iperf3.py: using RAC 65 22:17:51.340923 tst iperf3.py: using CellId 24035 22:17:51.459690 tst iperf3.py: using BVCI 24036 22:17:51.568914 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:51.579969 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:51.590735 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:51.601763 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:51.612674 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:51.623678 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:51.634762 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:51.645651 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:51.656716 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:17:51.776153 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:17:51.995134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:52.319682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23137): Launched 22:17:52.601041 run iperf3-srv_10.42.42.10(pid=23138): Launched 22:17:52.722243 tst iperf3.py:8: start network... 22:17:52.939945 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:53.438956 run create_hlr_db(pid=23139): Launched 22:17:53.571108 bus /gobi_6: Setting Powered False 22:17:54.634675 run create_hlr_db(pid=23139): Terminated: ok {rc=0} 22:17:55.083604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23141): Launched 22:17:55.406894 run osmo-hlr_10.42.42.2(pid=23142): Launched 22:17:55.529584 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:56.087578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23144): Launched 22:17:56.410580 run osmo-stp_10.42.42.5(pid=23145): Launched 22:17:56.535807 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:17:57.090419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23147): Launched 22:17:57.214081 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:17:57.486965 run patchelf(pid=23148): Launched 22:17:57.667299 run osmo-stp_10.42.42.5(pid=23145): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23145)] 22:17:57.804302 run osmo-stp_10.42.42.5(pid=23145): stdout: | (launched: 2022-12-09_22:17:56.352443) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:57.942656 run osmo-stp_10.42.42.5(pid=23145): stderr: | 20221209221756545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221756545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221756545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221756545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221756546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221756546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221756546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:58.081413 run osmo-stp_10.42.42.5(pid=23145): stdout: | (launched: 2022-12-09_22:17:56.352443) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:58.214123 run osmo-stp_10.42.42.5(pid=23145): stderr: | 20221209221756545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221756545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221756545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221756545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221756546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221756546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221756546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:58.371308 run patchelf(pid=23148): Terminating (SIGINT) 22:17:58.554223 run patchelf(pid=23148): Terminated: ok {rc=0} 22:17:58.685751 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23145): Process ended prematurely: osmo-stp_10.42.42.5(pid=23145) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23145)] [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 22:17:58.695924 tst iperf3.py:8: Test FAILED (7.7 sec) 22:17:58.724503 run osmo-hlr_10.42.42.2(pid=23142): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23142)] 22:17:58.774491 run osmo-hlr_10.42.42.2(pid=23142): stdout: | (launched: 2022-12-09_22:17:55.348855) 22:17:58.826101 run osmo-hlr_10.42.42.2(pid=23142): stderr: | 20221209221755548 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221755548 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221755548 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221755548 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221755548 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221755548 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221755560 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221755569 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221755569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221755569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:58.878225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23137): Terminating (SIGTERM) 22:17:58.920141 run iperf3-srv_10.42.42.10(pid=23138): Terminating (SIGTERM) 22:17:58.961991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23141): Terminating (SIGTERM) 22:17:59.004003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23144): Terminating (SIGTERM) 22:17:59.045896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23147): Terminating (SIGTERM) 22:17:59.088151 --- ParallelTerminationStrategy: PID 23137 died... 22:17:59.108275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23137): Terminated: ok {rc=0} 22:17:59.154940 --- ParallelTerminationStrategy: PID 23138 died... 22:17:59.174544 run iperf3-srv_10.42.42.10(pid=23138): Terminated {rc=256} 22:17:59.220364 --- ParallelTerminationStrategy: PID 23141 died... 22:17:59.240072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23141): Terminated: ok {rc=0} 22:17:59.286503 --- ParallelTerminationStrategy: PID 23144 died... 22:17:59.306365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23144): Terminated: ok {rc=0} 22:17:59.352197 --- ParallelTerminationStrategy: PID 23147 died... 22:17:59.371856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23147): Terminated: ok {rc=0} 22:17:59.459544 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:18:00.611321 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:00.623554 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:18:00.694818 tst iperf3m4.py: using LAC 24036 22:18:00.822184 tst iperf3m4.py: using RAC 66 22:18:00.967974 tst iperf3m4.py: using CellId 24036 22:18:01.090190 tst iperf3m4.py: using BVCI 24037 22:18:01.204015 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:01.216303 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:01.229091 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:01.240906 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:01.254083 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:01.268186 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:01.281715 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:01.293554 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:01.306775 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:18:01.434335 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:18:01.575115 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:18:01.699098 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:18:01.826132 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:18:02.038001 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:02.348315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23149): Launched 22:18:02.614391 run iperf3-srv_10.42.42.10(pid=23150): Launched 22:18:02.729209 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:18:02.933644 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:03.237593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23151): Launched 22:18:03.503858 run iperf3-srv_10.42.42.10(pid=23152): Launched 22:18:03.618397 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:18:03.821762 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:04.125699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23153): Launched 22:18:04.390308 run iperf3-srv_10.42.42.10(pid=23154): Launched 22:18:04.505141 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:18:04.709593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:05.015546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23155): Launched 22:18:05.279750 run iperf3-srv_10.42.42.10(pid=23156): Launched 22:18:05.394117 tst iperf3m4.py:8: start network... 22:18:05.596395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:06.063354 run create_hlr_db(pid=23157): Launched 22:18:06.180159 bus /gobi_6: Setting Powered False 22:18:07.241471 run create_hlr_db(pid=23157): Terminated: ok {rc=0} 22:18:07.684456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23159): Launched 22:18:08.008156 run osmo-hlr_10.42.42.2(pid=23160): Launched 22:18:08.131383 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:08.688005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23162): Launched 22:18:09.009980 run osmo-stp_10.42.42.5(pid=23163): Launched 22:18:09.132831 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:18:09.689940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23165): Launched 22:18:09.813831 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:18:10.087076 run patchelf(pid=23166): Launched 22:18:10.267669 run osmo-stp_10.42.42.5(pid=23163): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23163)] 22:18:10.406018 run osmo-stp_10.42.42.5(pid=23163): stdout: | (launched: 2022-12-09_22:18:08.951656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:10.544393 run osmo-stp_10.42.42.5(pid=23163): stderr: | 20221209221809142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221809142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221809142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221809143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221809143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221809143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221809143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:10.683020 run osmo-stp_10.42.42.5(pid=23163): stdout: | (launched: 2022-12-09_22:18:08.951656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:10.815305 run osmo-stp_10.42.42.5(pid=23163): stderr: | 20221209221809142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221809142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221809142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221809143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221809143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221809143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221809143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:10.971961 run patchelf(pid=23166): Terminating (SIGINT) 22:18:11.155125 run patchelf(pid=23166): Terminated: ok {rc=0} 22:18:11.286966 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23163): Process ended prematurely: osmo-stp_10.42.42.5(pid=23163) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23163)] [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:18:11.297148 tst iperf3m4.py:8: Test FAILED (10.7 sec) 22:18:11.326321 run osmo-hlr_10.42.42.2(pid=23160): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23160)] 22:18:11.376759 run osmo-hlr_10.42.42.2(pid=23160): stdout: | (launched: 2022-12-09_22:18:07.949634) 22:18:11.428856 run osmo-hlr_10.42.42.2(pid=23160): stderr: | 20221209221808150 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221808150 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221808150 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221808150 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221808150 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221808150 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221808163 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221808173 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221808173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221808173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:11.481351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23149): Terminating (SIGTERM) 22:18:11.523395 run iperf3-srv_10.42.42.10(pid=23150): Terminating (SIGTERM) 22:18:11.565640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23151): Terminating (SIGTERM) 22:18:11.607844 run iperf3-srv_10.42.42.10(pid=23152): Terminating (SIGTERM) 22:18:11.649788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23153): Terminating (SIGTERM) 22:18:11.691951 run iperf3-srv_10.42.42.10(pid=23154): Terminating (SIGTERM) 22:18:11.733890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23155): Terminating (SIGTERM) 22:18:11.775928 run iperf3-srv_10.42.42.10(pid=23156): Terminating (SIGTERM) 22:18:11.818063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23159): Terminating (SIGTERM) 22:18:11.860196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23162): Terminating (SIGTERM) 22:18:11.902470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23165): Terminating (SIGTERM) 22:18:11.944649 --- ParallelTerminationStrategy: PID 23149 died... 22:18:11.964698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23149): Terminated: ok {rc=0} 22:18:12.011238 --- ParallelTerminationStrategy: PID 23150 died... 22:18:12.030697 run iperf3-srv_10.42.42.10(pid=23150): Terminated {rc=256} 22:18:12.077150 --- ParallelTerminationStrategy: PID 23151 died... 22:18:12.096714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23151): Terminated: ok {rc=0} 22:18:12.143423 --- ParallelTerminationStrategy: PID 23152 died... 22:18:12.162895 run iperf3-srv_10.42.42.10(pid=23152): Terminated {rc=256} 22:18:12.209075 --- ParallelTerminationStrategy: PID 23153 died... 22:18:12.228600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23153): Terminated: ok {rc=0} 22:18:12.275144 --- ParallelTerminationStrategy: PID 23154 died... 22:18:12.294653 run iperf3-srv_10.42.42.10(pid=23154): Terminated {rc=256} 22:18:12.341451 --- ParallelTerminationStrategy: PID 23155 died... 22:18:12.361073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23155): Terminated: ok {rc=0} 22:18:12.407321 --- ParallelTerminationStrategy: PID 23156 died... 22:18:12.426867 run iperf3-srv_10.42.42.10(pid=23156): Terminated {rc=256} 22:18:12.473638 --- ParallelTerminationStrategy: PID 23159 died... 22:18:12.493212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23159): Terminated: ok {rc=0} 22:18:12.539559 --- ParallelTerminationStrategy: PID 23162 died... 22:18:12.559180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23162): Terminated: ok {rc=0} 22:18:12.605648 --- ParallelTerminationStrategy: PID 23165 died... 22:18:12.625379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23165): Terminated: ok {rc=0} 22:18:12.714247 bus /gobi_4: Setting Powered False 22:18:13.814432 bus /gobi_4: Setting Powered False 22:18:14.931437 bus /gobi_1: Setting Powered False 22:18:16.029736 bus /gobi_1: Setting Powered False 22:18:17.150655 bus /gobi_0: Setting Powered False 22:18:18.257306 bus /gobi_0: Setting Powered False 22:18:19.374791 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:18:20.479768 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:20.491796 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:18:20.564088 tst ping.py: using LAC 24037 22:18:20.688828 tst ping.py: using RAC 67 22:18:20.815429 tst ping.py: using CellId 24037 22:18:20.940376 tst ping.py: using BVCI 24038 22:18:21.055710 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:21.067119 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:21.078524 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:21.089847 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:21.101005 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:21.112209 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:21.123574 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:21.134733 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:18:21.253457 tst ping.py:19: start network... 22:18:21.467405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:21.955426 run create_hlr_db(pid=23167): Launched 22:18:22.084217 bus /gobi_6: Setting Powered False 22:18:23.147647 run create_hlr_db(pid=23167): Terminated: ok {rc=0} 22:18:23.590294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23169): Launched 22:18:23.908005 run osmo-hlr_10.42.42.2(pid=23170): Launched 22:18:24.028677 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:24.573681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23172): Launched 22:18:24.890765 run osmo-stp_10.42.42.5(pid=23173): Launched 22:18:25.011579 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:18:25.557733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23175): Launched 22:18:25.679879 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:18:25.949354 run patchelf(pid=23176): Launched 22:18:26.126780 run osmo-stp_10.42.42.5(pid=23173): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23173)] 22:18:26.261396 run osmo-stp_10.42.42.5(pid=23173): stdout: | (launched: 2022-12-09_22:18:24.833574) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:26.398938 run osmo-stp_10.42.42.5(pid=23173): stderr: | 20221209221825024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221825024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221825025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221825025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221825026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221825026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221825026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:26.536128 run osmo-stp_10.42.42.5(pid=23173): stdout: | (launched: 2022-12-09_22:18:24.833574) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:26.666393 run osmo-stp_10.42.42.5(pid=23173): stderr: | 20221209221825024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221825024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221825025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221825025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221825026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221825026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221825026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:26.820344 run patchelf(pid=23176): Terminating (SIGINT) 22:18:26.999869 run patchelf(pid=23176): Terminated: ok {rc=0} 22:18:27.128771 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23173): Process ended prematurely: osmo-stp_10.42.42.5(pid=23173) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23173)] [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 22:18:27.138463 tst ping.py:22: Test FAILED (6.7 sec) 22:18:27.166595 run osmo-hlr_10.42.42.2(pid=23170): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23170)] 22:18:27.216789 run osmo-hlr_10.42.42.2(pid=23170): stdout: | (launched: 2022-12-09_22:18:23.850651) 22:18:27.269564 run osmo-hlr_10.42.42.2(pid=23170): stderr: | 20221209221824046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221824046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221824047 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221824047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221824047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221824047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221824060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221824068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221824068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221824069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:27.322116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23169): Terminating (SIGTERM) 22:18:27.364274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23172): Terminating (SIGTERM) 22:18:27.406536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23175): Terminating (SIGTERM) 22:18:27.448861 --- ParallelTerminationStrategy: PID 23169 died... 22:18:27.469098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23169): Terminated: ok {rc=0} 22:18:27.515592 --- ParallelTerminationStrategy: PID 23172 died... 22:18:27.535353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23172): Terminated: ok {rc=0} 22:18:27.581699 --- ParallelTerminationStrategy: PID 23175 died... 22:18:27.601374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23175): Terminated: ok {rc=0} 22:18:27.689722 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:18:28.777626 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:28.789928 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:18:28.862349 tst ping_idle_ping.py: using LAC 24038 22:18:28.981810 tst ping_idle_ping.py: using RAC 68 22:18:29.099911 tst ping_idle_ping.py: using CellId 24038 22:18:29.216883 tst ping_idle_ping.py: using BVCI 24039 22:18:29.324769 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:29.336077 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:29.347179 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:29.359406 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:29.370716 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:29.382154 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:29.394084 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:29.405653 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:18:29.519323 tst ping_idle_ping.py:24: start network... 22:18:29.720057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:30.188012 run create_hlr_db(pid=23177): Launched 22:18:30.301359 bus /gobi_6: Setting Powered False 22:18:31.359689 run create_hlr_db(pid=23177): Terminated: ok {rc=0} 22:18:31.794505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23179): Launched 22:18:32.119593 run osmo-hlr_10.42.42.2(pid=23180): Launched 22:18:32.238505 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:32.762060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23182): Launched 22:18:33.058415 run osmo-stp_10.42.42.5(pid=23183): Launched 22:18:33.171962 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:18:33.681682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23185): Launched 22:18:33.796591 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:18:34.049049 run patchelf(pid=23186): Launched 22:18:34.215089 run osmo-stp_10.42.42.5(pid=23183): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23183)] 22:18:34.341473 run osmo-stp_10.42.42.5(pid=23183): stdout: | (launched: 2022-12-09_22:18:33.004848) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:34.469729 run osmo-stp_10.42.42.5(pid=23183): stderr: | 20221209221833173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221833174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221833174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221833174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221833175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221833175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221833175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:34.598277 run osmo-stp_10.42.42.5(pid=23183): stdout: | (launched: 2022-12-09_22:18:33.004848) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:34.720003 run osmo-stp_10.42.42.5(pid=23183): stderr: | 20221209221833173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221833174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221833174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221833174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221833175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221833175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221833175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:34.864174 run patchelf(pid=23186): Terminating (SIGINT) 22:18:35.032269 run patchelf(pid=23186): Terminated: ok {rc=0} 22:18:35.153336 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23183): Process ended prematurely: osmo-stp_10.42.42.5(pid=23183) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23183)] [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:18:35.162240 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:18:35.189238 run osmo-hlr_10.42.42.2(pid=23180): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23180)] 22:18:35.237414 run osmo-hlr_10.42.42.2(pid=23180): stdout: | (launched: 2022-12-09_22:18:32.058237) 22:18:35.287003 run osmo-hlr_10.42.42.2(pid=23180): stderr: | 20221209221832349 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221832349 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221832349 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221832350 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221832350 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221832350 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221832362 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221832371 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221832371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221832371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:35.336894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23179): Terminating (SIGTERM) 22:18:35.377018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23182): Terminating (SIGTERM) 22:18:35.417295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23185): Terminating (SIGTERM) 22:18:35.458021 --- ParallelTerminationStrategy: PID 23179 died... 22:18:35.477003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23179): Terminated: ok {rc=0} 22:18:35.521618 --- ParallelTerminationStrategy: PID 23182 died... 22:18:35.540248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23182): Terminated: ok {rc=0} 22:18:35.584817 --- ParallelTerminationStrategy: PID 23185 died... 22:18:35.603773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23185): Terminated: ok {rc=0} 22:18:35.689673 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:18:36.998900 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:18:37.006684 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:18:37.041505 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:18:37.080818 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:18:37.167760 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:18:37.202384 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:18:37.241629 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:18:37.842360 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:18:37.894502 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:37.906114 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:18:37.976908 tst cs_paging_gprs_active.py: using LAC 24039 22:18:38.096144 tst cs_paging_gprs_active.py: using RAC 69 22:18:38.216642 tst cs_paging_gprs_active.py: using CellId 24039 22:18:38.335624 tst cs_paging_gprs_active.py: using BVCI 24040 22:18:38.445861 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:38.456793 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:38.467714 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:38.478965 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:38.490127 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:38.501265 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:38.512673 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:38.523847 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:38.535154 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:18:38.653092 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:18:38.769694 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:18:38.973563 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:39.276931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23192): Launched 22:18:39.541433 run iperf3-srv_10.42.42.10(pid=23193): Launched 22:18:39.656914 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:18:39.862457 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:40.168864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23194): Launched 22:18:40.433273 run iperf3-srv_10.42.42.10(pid=23195): Launched 22:18:40.547576 tst cs_paging_gprs_active.py:38: start network... 22:18:40.750569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:41.218676 run create_hlr_db(pid=23196): Launched 22:18:41.335066 bus /gobi_6: Setting Powered False 22:18:42.395058 run create_hlr_db(pid=23196): Terminated: ok {rc=0} 22:18:42.816772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23198): Launched 22:18:43.120310 run osmo-hlr_10.42.42.2(pid=23199): Launched 22:18:43.236793 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:43.769381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23201): Launched 22:18:44.072620 run osmo-stp_10.42.42.5(pid=23202): Launched 22:18:44.188480 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:18:44.709777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23204): Launched 22:18:44.826212 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:18:45.080610 run patchelf(pid=23205): Launched 22:18:45.250172 run osmo-stp_10.42.42.5(pid=23202): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23202)] 22:18:45.378945 run osmo-stp_10.42.42.5(pid=23202): stdout: | (launched: 2022-12-09_22:18:44.017633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:45.508897 run osmo-stp_10.42.42.5(pid=23202): stderr: | 20221209221844185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221844185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221844186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221844186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221844187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221844187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221844187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:45.638985 run osmo-stp_10.42.42.5(pid=23202): stdout: | (launched: 2022-12-09_22:18:44.017633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:45.763104 run osmo-stp_10.42.42.5(pid=23202): stderr: | 20221209221844185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221844185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221844186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221844186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221844187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221844187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221844187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:45.922202 run patchelf(pid=23205): Terminating (SIGINT) 22:18:46.112681 run patchelf(pid=23205): Terminated: ok {rc=0} 22:18:46.248712 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23202): Process ended prematurely: osmo-stp_10.42.42.5(pid=23202) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23202)] [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:18:46.260694 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 22:18:46.291431 run osmo-hlr_10.42.42.2(pid=23199): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23199)] 22:18:46.343304 run osmo-hlr_10.42.42.2(pid=23199): stdout: | (launched: 2022-12-09_22:18:43.065355) 22:18:46.399149 run osmo-hlr_10.42.42.2(pid=23199): stderr: | 20221209221843242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221843242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221843242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221843242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221843243 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221843243 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221843255 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221843265 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221843266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221843266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:46.453267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23192): Terminating (SIGTERM) 22:18:46.497318 run iperf3-srv_10.42.42.10(pid=23193): Terminating (SIGTERM) 22:18:46.543365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23194): Terminating (SIGTERM) 22:18:46.588106 run iperf3-srv_10.42.42.10(pid=23195): Terminating (SIGTERM) 22:18:46.636127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23198): Terminating (SIGTERM) 22:18:46.680381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23201): Terminating (SIGTERM) 22:18:46.723848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23204): Terminating (SIGTERM) 22:18:46.765980 --- ParallelTerminationStrategy: PID 23192 died... 22:18:46.785360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23192): Terminated: ok {rc=0} 22:18:46.832754 --- ParallelTerminationStrategy: PID 23193 died... 22:18:46.852360 run iperf3-srv_10.42.42.10(pid=23193): Terminated {rc=256} 22:18:46.899608 --- ParallelTerminationStrategy: PID 23194 died... 22:18:46.919131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23194): Terminated: ok {rc=0} 22:18:46.966046 --- ParallelTerminationStrategy: PID 23195 died... 22:18:46.985490 run iperf3-srv_10.42.42.10(pid=23195): Terminated {rc=256} 22:18:47.032653 --- ParallelTerminationStrategy: PID 23198 died... 22:18:47.052114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23198): Terminated: ok {rc=0} 22:18:47.099342 --- ParallelTerminationStrategy: PID 23201 died... 22:18:47.118970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23201): Terminated: ok {rc=0} 22:18:47.166186 --- ParallelTerminationStrategy: PID 23204 died... 22:18:47.185717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23204): Terminated: ok {rc=0} 22:18:47.276100 bus /gobi_0: Setting Powered False 22:18:48.373394 bus /gobi_0: Setting Powered False 22:18:49.489016 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:18:50.640185 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:50.652558 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:18:50.727970 tst iperf3.py: using LAC 24040 22:18:50.854604 tst iperf3.py: using RAC 70 22:18:50.982667 tst iperf3.py: using CellId 24040 22:18:51.109252 tst iperf3.py: using BVCI 24041 22:18:51.226071 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:51.237519 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:51.248698 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:51.259981 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:51.271138 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:51.282743 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:51.294151 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:51.305508 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:51.316665 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:18:51.432505 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:18:51.636026 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:51.939628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23206): Launched 22:18:52.204009 run iperf3-srv_10.42.42.10(pid=23207): Launched 22:18:52.318465 tst iperf3.py:8: start network... 22:18:52.521704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:52.989501 run create_hlr_db(pid=23208): Launched 22:18:53.107526 bus /gobi_6: Setting Powered False 22:18:54.167365 run create_hlr_db(pid=23208): Terminated: ok {rc=0} 22:18:54.608936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23210): Launched 22:18:54.932140 run osmo-hlr_10.42.42.2(pid=23211): Launched 22:18:55.055238 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:55.615407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23213): Launched 22:18:55.937719 run osmo-stp_10.42.42.5(pid=23214): Launched 22:18:56.061561 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:18:56.621142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23216): Launched 22:18:56.745394 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:18:57.017323 run patchelf(pid=23217): Launched 22:18:57.197912 run osmo-stp_10.42.42.5(pid=23214): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23214)] 22:18:57.336394 run osmo-stp_10.42.42.5(pid=23214): stdout: | (launched: 2022-12-09_22:18:55.879625) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:57.475513 run osmo-stp_10.42.42.5(pid=23214): stderr: | 20221209221856070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221856070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221856071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221856071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221856071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221856071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221856072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:57.615028 run osmo-stp_10.42.42.5(pid=23214): stdout: | (launched: 2022-12-09_22:18:55.879625) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:57.747558 run osmo-stp_10.42.42.5(pid=23214): stderr: | 20221209221856070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221856070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221856071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221856071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221856071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221856071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221856072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:57.904848 run patchelf(pid=23217): Terminating (SIGINT) 22:18:58.089380 run patchelf(pid=23217): Terminated: ok {rc=0} 22:18:58.221531 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23214): Process ended prematurely: osmo-stp_10.42.42.5(pid=23214) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23214)] [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 22:18:58.231676 tst iperf3.py:8: Test FAILED (7.6 sec) 22:18:58.260569 run osmo-hlr_10.42.42.2(pid=23211): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23211)] 22:18:58.311377 run osmo-hlr_10.42.42.2(pid=23211): stdout: | (launched: 2022-12-09_22:18:54.873966) 22:18:58.363768 run osmo-hlr_10.42.42.2(pid=23211): stderr: | 20221209221855072 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221855072 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221855072 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221855072 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221855072 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221855072 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221855084 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221855092 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221855092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221855092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:58.416114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23206): Terminating (SIGTERM) 22:18:58.458263 run iperf3-srv_10.42.42.10(pid=23207): Terminating (SIGTERM) 22:18:58.500419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23210): Terminating (SIGTERM) 22:18:58.542639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23213): Terminating (SIGTERM) 22:18:58.584696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23216): Terminating (SIGTERM) 22:18:58.627309 --- ParallelTerminationStrategy: PID 23206 died... 22:18:58.647459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23206): Terminated: ok {rc=0} 22:18:58.694507 --- ParallelTerminationStrategy: PID 23207 died... 22:18:58.714198 run iperf3-srv_10.42.42.10(pid=23207): Terminated {rc=256} 22:18:58.760786 --- ParallelTerminationStrategy: PID 23210 died... 22:18:58.780788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23210): Terminated: ok {rc=0} 22:18:58.827185 --- ParallelTerminationStrategy: PID 23213 died... 22:18:58.846933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23213): Terminated: ok {rc=0} 22:18:58.893394 --- ParallelTerminationStrategy: PID 23216 died... 22:18:58.913087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23216): Terminated: ok {rc=0} 22:18:59.000785 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:19:00.151249 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:00.163268 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:19:00.234545 tst iperf3m4.py: using LAC 24041 22:19:00.359481 tst iperf3m4.py: using RAC 71 22:19:00.478290 tst iperf3m4.py: using CellId 24041 22:19:00.597157 tst iperf3m4.py: using BVCI 24042 22:19:00.707753 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:00.718902 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:00.729985 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:00.741945 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:00.753622 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:00.765686 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:00.777497 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:00.789148 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:00.801288 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:19:00.954105 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:19:01.106641 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:19:01.233545 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:19:01.360788 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:19:01.598897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:19:01.918504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23218): Launched 22:19:02.237906 run iperf3-srv_10.42.42.10(pid=23219): Launched 22:19:02.370274 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:19:02.588677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:19:02.914034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23220): Launched 22:19:03.195757 run iperf3-srv_10.42.42.10(pid=23221): Launched 22:19:03.318072 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:19:03.535899 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:19:03.860147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23222): Launched 22:19:04.141263 run iperf3-srv_10.42.42.10(pid=23223): Launched 22:19:04.262838 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:19:04.481141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:19:04.805815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23224): Launched 22:19:05.089099 run iperf3-srv_10.42.42.10(pid=23225): Launched 22:19:05.210531 tst iperf3m4.py:8: start network... 22:19:05.428320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:05.927247 run create_hlr_db(pid=23226): Launched 22:19:06.058876 bus /gobi_6: Setting Powered False 22:19:07.122630 run create_hlr_db(pid=23226): Terminated: ok {rc=0} 22:19:07.554097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23228): Launched 22:19:07.856179 run osmo-hlr_10.42.42.2(pid=23229): Launched 22:19:07.971949 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:08.507549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23231): Launched 22:19:08.809795 run osmo-stp_10.42.42.5(pid=23232): Launched 22:19:08.926466 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:09.447787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23234): Launched 22:19:09.564621 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:09.819492 run patchelf(pid=23235): Launched 22:19:09.990022 run osmo-stp_10.42.42.5(pid=23232): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23232)] 22:19:10.119996 run osmo-stp_10.42.42.5(pid=23232): stdout: | (launched: 2022-12-09_22:19:08.754711) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:10.250736 run osmo-stp_10.42.42.5(pid=23232): stderr: | 20221209221908924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221908924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221908924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221908925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221908925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221908925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221908925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:10.381554 run osmo-stp_10.42.42.5(pid=23232): stdout: | (launched: 2022-12-09_22:19:08.754711) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:10.505879 run osmo-stp_10.42.42.5(pid=23232): stderr: | 20221209221908924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221908924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221908924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221908925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221908925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221908925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221908925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:10.653413 run patchelf(pid=23235): Terminating (SIGINT) 22:19:10.827271 run patchelf(pid=23235): Terminated: ok {rc=0} 22:19:10.952098 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23232): Process ended prematurely: osmo-stp_10.42.42.5(pid=23232) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23232)] [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:19:10.961744 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:19:10.989586 run osmo-hlr_10.42.42.2(pid=23229): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23229)] 22:19:11.037889 run osmo-hlr_10.42.42.2(pid=23229): stdout: | (launched: 2022-12-09_22:19:07.801351) 22:19:11.087347 run osmo-hlr_10.42.42.2(pid=23229): stderr: | 20221209221907975 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221907975 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221907975 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221907975 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221907975 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221907975 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221907998 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221908006 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221908007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221908007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:11.137513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23218): Terminating (SIGTERM) 22:19:11.177874 run iperf3-srv_10.42.42.10(pid=23219): Terminating (SIGTERM) 22:19:11.218106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23220): Terminating (SIGTERM) 22:19:11.258470 run iperf3-srv_10.42.42.10(pid=23221): Terminating (SIGTERM) 22:19:11.298431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23222): Terminating (SIGTERM) 22:19:11.339294 run iperf3-srv_10.42.42.10(pid=23223): Terminating (SIGTERM) 22:19:11.379244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23224): Terminating (SIGTERM) 22:19:11.419799 run iperf3-srv_10.42.42.10(pid=23225): Terminating (SIGTERM) 22:19:11.459721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23228): Terminating (SIGTERM) 22:19:11.499896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23231): Terminating (SIGTERM) 22:19:11.540036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23234): Terminating (SIGTERM) 22:19:11.580195 --- ParallelTerminationStrategy: PID 23218 died... 22:19:11.599291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23218): Terminated: ok {rc=0} 22:19:11.643951 --- ParallelTerminationStrategy: PID 23219 died... 22:19:11.662590 run iperf3-srv_10.42.42.10(pid=23219): Terminated {rc=256} 22:19:11.706851 --- ParallelTerminationStrategy: PID 23220 died... 22:19:11.725444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23220): Terminated: ok {rc=0} 22:19:11.769799 --- ParallelTerminationStrategy: PID 23221 died... 22:19:11.788281 run iperf3-srv_10.42.42.10(pid=23221): Terminated {rc=256} 22:19:11.832581 --- ParallelTerminationStrategy: PID 23222 died... 22:19:11.851166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23222): Terminated: ok {rc=0} 22:19:11.895820 --- ParallelTerminationStrategy: PID 23223 died... 22:19:11.914855 run iperf3-srv_10.42.42.10(pid=23223): Terminated {rc=256} 22:19:11.959882 --- ParallelTerminationStrategy: PID 23224 died... 22:19:11.978456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23224): Terminated: ok {rc=0} 22:19:12.023059 --- ParallelTerminationStrategy: PID 23225 died... 22:19:12.041655 run iperf3-srv_10.42.42.10(pid=23225): Terminated {rc=256} 22:19:12.085919 --- ParallelTerminationStrategy: PID 23228 died... 22:19:12.104606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23228): Terminated: ok {rc=0} 22:19:12.149214 --- ParallelTerminationStrategy: PID 23231 died... 22:19:12.167796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23231): Terminated: ok {rc=0} 22:19:12.212403 --- ParallelTerminationStrategy: PID 23234 died... 22:19:12.231068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23234): Terminated: ok {rc=0} 22:19:12.317456 bus /gobi_4: Setting Powered False 22:19:13.422341 bus /gobi_4: Setting Powered False 22:19:14.536273 bus /gobi_1: Setting Powered False 22:19:15.635315 bus /gobi_1: Setting Powered False 22:19:16.763076 bus /gobi_0: Setting Powered False 22:19:17.869506 bus /gobi_0: Setting Powered False 22:19:18.986721 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:19:20.091202 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:20.103026 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:19:20.174843 tst ping.py: using LAC 24042 22:19:20.293217 tst ping.py: using RAC 72 22:19:20.419310 tst ping.py: using CellId 24042 22:19:20.544810 tst ping.py: using BVCI 24043 22:19:20.659670 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:20.671321 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:20.682766 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:20.694329 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:20.705811 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:20.717258 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:20.728582 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:20.739912 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:19:20.855527 tst ping.py:19: start network... 22:19:21.055069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:21.513397 run create_hlr_db(pid=23236): Launched 22:19:21.636287 bus /gobi_6: Setting Powered False 22:19:22.695817 run create_hlr_db(pid=23236): Terminated: ok {rc=0} 22:19:23.129538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23238): Launched 22:19:23.448741 run osmo-hlr_10.42.42.2(pid=23239): Launched 22:19:23.570121 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:24.119766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23241): Launched 22:19:24.435422 run osmo-stp_10.42.42.5(pid=23242): Launched 22:19:24.555715 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:25.099710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23244): Launched 22:19:25.221321 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:25.489176 run patchelf(pid=23245): Launched 22:19:25.665774 run osmo-stp_10.42.42.5(pid=23242): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23242)] 22:19:25.800021 run osmo-stp_10.42.42.5(pid=23242): stdout: | (launched: 2022-12-09_22:19:24.378421) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:25.936371 run osmo-stp_10.42.42.5(pid=23242): stderr: | 20221209221924568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221924569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221924569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221924570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221924570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221924570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221924570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:26.072617 run osmo-stp_10.42.42.5(pid=23242): stdout: | (launched: 2022-12-09_22:19:24.378421) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:26.202533 run osmo-stp_10.42.42.5(pid=23242): stderr: | 20221209221924568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221924569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221924569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221924570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221924570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221924570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221924570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:26.356760 run patchelf(pid=23245): Terminating (SIGINT) 22:19:26.535898 run patchelf(pid=23245): Terminated: ok {rc=0} 22:19:26.664837 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23242): Process ended prematurely: osmo-stp_10.42.42.5(pid=23242) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23242)] [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 22:19:26.674362 tst ping.py:22: Test FAILED (6.6 sec) 22:19:26.702614 run osmo-hlr_10.42.42.2(pid=23239): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23239)] 22:19:26.752581 run osmo-hlr_10.42.42.2(pid=23239): stdout: | (launched: 2022-12-09_22:19:23.391278) 22:19:26.804334 run osmo-hlr_10.42.42.2(pid=23239): stderr: | 20221209221923591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221923591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221923591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221923591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221923591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221923592 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221923602 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221923610 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221923611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221923611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:26.856483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23238): Terminating (SIGTERM) 22:19:26.898931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23241): Terminating (SIGTERM) 22:19:26.941480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23244): Terminating (SIGTERM) 22:19:26.983891 --- ParallelTerminationStrategy: PID 23238 died... 22:19:27.004111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23238): Terminated: ok {rc=0} 22:19:27.051035 --- ParallelTerminationStrategy: PID 23241 died... 22:19:27.070995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23241): Terminated: ok {rc=0} 22:19:27.117847 --- ParallelTerminationStrategy: PID 23244 died... 22:19:27.137652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23244): Terminated: ok {rc=0} 22:19:27.227158 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:19:28.316593 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:28.329326 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:19:28.408190 tst ping_idle_ping.py: using LAC 24043 22:19:28.532477 tst ping_idle_ping.py: using RAC 73 22:19:28.655647 tst ping_idle_ping.py: using CellId 24043 22:19:28.779738 tst ping_idle_ping.py: using BVCI 24044 22:19:28.895366 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:28.907016 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:28.918288 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:28.930088 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:28.941809 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:28.953304 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:28.964732 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:28.976136 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:19:29.092338 tst ping_idle_ping.py:24: start network... 22:19:29.293897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:29.757660 run create_hlr_db(pid=23246): Launched 22:19:29.873658 bus /gobi_6: Setting Powered False 22:19:30.944241 run create_hlr_db(pid=23246): Terminated: ok {rc=0} 22:19:31.376074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23248): Launched 22:19:31.701780 run osmo-hlr_10.42.42.2(pid=23249): Launched 22:19:31.927054 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:32.636228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23251): Launched 22:19:32.935104 run osmo-stp_10.42.42.5(pid=23252): Launched 22:19:33.050172 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:33.562494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23254): Launched 22:19:33.677388 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:33.929252 run patchelf(pid=23255): Launched 22:19:34.096181 run osmo-stp_10.42.42.5(pid=23252): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23252)] 22:19:34.222841 run osmo-stp_10.42.42.5(pid=23252): stdout: | (launched: 2022-12-09_22:19:32.880745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:34.351365 run osmo-stp_10.42.42.5(pid=23252): stderr: | 20221209221933052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221933052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221933052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221933053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221933053 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221933053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221933053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:34.480263 run osmo-stp_10.42.42.5(pid=23252): stdout: | (launched: 2022-12-09_22:19:32.880745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:34.602512 run osmo-stp_10.42.42.5(pid=23252): stderr: | 20221209221933052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221933052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221933052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221933053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221933053 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221933053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221933053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:34.747326 run patchelf(pid=23255): Terminating (SIGINT) 22:19:34.916519 run patchelf(pid=23255): Terminated: ok {rc=0} 22:19:35.038982 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23252): Process ended prematurely: osmo-stp_10.42.42.5(pid=23252) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23252)] [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:19:35.048051 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 22:19:35.075410 run osmo-hlr_10.42.42.2(pid=23249): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23249)] 22:19:35.123573 run osmo-hlr_10.42.42.2(pid=23249): stdout: | (launched: 2022-12-09_22:19:31.632136) 22:19:35.173077 run osmo-hlr_10.42.42.2(pid=23249): stderr: | 20221209221931974 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221931974 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221931974 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221931974 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221931974 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221931974 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221931991 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221931999 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221931999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221931999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:35.223148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23248): Terminating (SIGTERM) 22:19:35.263295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23251): Terminating (SIGTERM) 22:19:35.303576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23254): Terminating (SIGTERM) 22:19:35.344014 --- ParallelTerminationStrategy: PID 23248 died... 22:19:35.363068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23248): Terminated: ok {rc=0} 22:19:35.407899 --- ParallelTerminationStrategy: PID 23251 died... 22:19:35.426789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23251): Terminated: ok {rc=0} 22:19:35.471497 --- ParallelTerminationStrategy: PID 23254 died... 22:19:35.490209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23254): Terminated: ok {rc=0} 22:19:35.576559 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:19:36.882361 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:19:36.890731 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:19:36.926772 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:19:36.962527 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:19:37.017956 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:19:37.052497 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:19:37.087863 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:19:37.649944 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2365 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:19:37.655112 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:37.666872 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:19:37.740657 tst switch_tch_pdch.py: using LAC 24044 22:19:37.867230 tst switch_tch_pdch.py: using RAC 74 22:19:37.991460 tst switch_tch_pdch.py: using CellId 24044 22:19:38.115042 tst switch_tch_pdch.py: using BVCI 24045 22:19:38.229495 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:38.241198 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:38.252675 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:38.264228 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:38.275829 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:38.287268 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:38.298894 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:38.310751 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:19:38.427302 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:19:38.547531 tst switch_tch_pdch.py:51: start network... 22:19:38.761292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:39.250543 run create_hlr_db(pid=23259): Launched 22:19:39.371083 bus /gobi_6: Setting Powered False 22:19:40.430381 run create_hlr_db(pid=23259): Terminated: ok {rc=0} 22:19:40.845593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23261): Launched 22:19:41.145524 run osmo-hlr_10.42.42.2(pid=23262): Launched 22:19:41.259993 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:41.772229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23264): Launched 22:19:42.069133 run osmo-stp_10.42.42.5(pid=23265): Launched 22:19:42.182505 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:42.691770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23267): Launched 22:19:42.806008 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:43.055886 run patchelf(pid=23268): Launched 22:19:43.221342 run osmo-stp_10.42.42.5(pid=23265): ERR: Terminated: ERROR {rc=1} [trial-2365↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23265)] 22:19:43.347482 run osmo-stp_10.42.42.5(pid=23265): stdout: | (launched: 2022-12-09_22:19:42.014768) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:43.475470 run osmo-stp_10.42.42.5(pid=23265): stderr: | 20221209221942183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221942183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221942183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221942184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221942184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221942184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221942184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:43.603508 run osmo-stp_10.42.42.5(pid=23265): stdout: | (launched: 2022-12-09_22:19:42.014768) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:43.724776 run osmo-stp_10.42.42.5(pid=23265): stderr: | 20221209221942183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221942183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221942183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221942184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221942184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221942184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221942184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:43.868872 run patchelf(pid=23268): Terminating (SIGINT) 22:19:44.036930 run patchelf(pid=23268): Terminated: ok {rc=0} 22:19:44.158277 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23265): Process ended prematurely: osmo-stp_10.42.42.5(pid=23265) [trial-2365↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23265)] [trial-2365↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:19:44.167001 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 22:19:44.194179 run osmo-hlr_10.42.42.2(pid=23262): ERR: Terminated: ERROR {rc=237} [trial-2365↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23262)] 22:19:44.241829 run osmo-hlr_10.42.42.2(pid=23262): stdout: | (launched: 2022-12-09_22:19:41.091277) 22:19:44.290949 run osmo-hlr_10.42.42.2(pid=23262): stderr: | 20221209221941269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221941269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221941269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221941269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221941269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221941269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221941304 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221941315 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221941315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221941315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:44.340661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23261): Terminating (SIGTERM) 22:19:44.380564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23264): Terminating (SIGTERM) 22:19:44.420275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23267): Terminating (SIGTERM) 22:19:44.460457 --- ParallelTerminationStrategy: PID 23261 died... 22:19:44.479550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23261): Terminated: ok {rc=0} 22:19:44.524257 --- ParallelTerminationStrategy: PID 23264 died... 22:19:44.543032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23264): Terminated: ok {rc=0} 22:19:44.587613 --- ParallelTerminationStrategy: PID 23267 died... 22:19:44.606218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23267): Terminated: ok {rc=0} 22:19:44.691367 bus /gobi_0: Setting Powered False 22:19:45.791645 bus /gobi_0: Setting Powered False 22:19:46.931909 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:19:48.191177 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:19:48.197520 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:19:48.232039 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:19:48.267087 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:19:48.322306 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:19:48.357385 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:19:48.392073 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:19:48.953494 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2365 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:19:48.958952 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:48.972304 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:19:49.056879 tst switch_tch_pdch.py: using LAC 24045 22:19:49.182199 tst switch_tch_pdch.py: using RAC 75 22:19:49.306927 tst switch_tch_pdch.py: using CellId 24045 22:19:49.436015 tst switch_tch_pdch.py: using BVCI 24046 22:19:49.552127 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:49.563647 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:49.574896 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:49.586214 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:49.597524 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:49.608774 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:49.620165 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:49.631377 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:19:49.750059 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:19:49.868844 tst switch_tch_pdch.py:51: start network... 22:19:50.083086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:50.546384 run create_hlr_db(pid=23273): Launched 22:19:50.676016 bus /gobi_6: Setting Powered False 22:19:51.739920 run create_hlr_db(pid=23273): Terminated: ok {rc=0} 22:19:52.155647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23275): Launched 22:19:52.474098 run osmo-hlr_10.42.42.2(pid=23276): Launched 22:19:52.594955 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:53.119569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23278): Launched 22:19:53.436493 run osmo-stp_10.42.42.5(pid=23279): Launched 22:19:53.557254 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:54.073406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23281): Launched 22:19:54.195446 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:54.465406 run patchelf(pid=23282): Launched 22:19:54.643358 run osmo-stp_10.42.42.5(pid=23279): ERR: Terminated: ERROR {rc=1} [trial-2365↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23279)] 22:19:54.779035 run osmo-stp_10.42.42.5(pid=23279): stdout: | (launched: 2022-12-09_22:19:53.379083) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:54.915886 run osmo-stp_10.42.42.5(pid=23279): stderr: | 20221209221953571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221953571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221953572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221953572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221953572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221953573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221953573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:55.053331 run osmo-stp_10.42.42.5(pid=23279): stdout: | (launched: 2022-12-09_22:19:53.379083) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:55.184057 run osmo-stp_10.42.42.5(pid=23279): stderr: | 20221209221953571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209221953571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209221953572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209221953572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209221953572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209221953573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209221953573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:55.339843 run patchelf(pid=23282): Terminating (SIGINT) 22:19:55.521734 run patchelf(pid=23282): Terminated: ok {rc=0} 22:19:55.652207 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23279): Process ended prematurely: osmo-stp_10.42.42.5(pid=23279) [trial-2365↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23279)] [trial-2365↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:19:55.661689 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 22:19:55.689912 run osmo-hlr_10.42.42.2(pid=23276): ERR: Terminated: ERROR {rc=237} [trial-2365↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23276)] 22:19:55.740319 run osmo-hlr_10.42.42.2(pid=23276): stdout: | (launched: 2022-12-09_22:19:52.416384) 22:19:55.791940 run osmo-hlr_10.42.42.2(pid=23276): stderr: | 20221209221952613 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209221952613 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209221952613 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209221952613 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209221952613 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209221952613 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209221952626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209221952634 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209221952635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209221952635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:55.843869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23275): Terminating (SIGTERM) 22:19:55.885562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23278): Terminating (SIGTERM) 22:19:55.927236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23281): Terminating (SIGTERM) 22:19:55.969648 --- ParallelTerminationStrategy: PID 23275 died... 22:19:55.989239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23275): Terminated: ok {rc=0} 22:19:56.035331 --- ParallelTerminationStrategy: PID 23278 died... 22:19:56.054769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23278): Terminated: ok {rc=0} 22:19:56.100615 --- ParallelTerminationStrategy: PID 23281 died... 22:19:56.120177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23281): Terminated: ok {rc=0} 22:19:56.207886 bus /gobi_0: Setting Powered False 22:19:57.308627 bus /gobi_0: Setting Powered False 22:19:58.425920 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_sms:trx-umtrx --------------------------------------------------------------------- 22:19:59.678816 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:19:59.683764 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:19:59.718052 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 22:19:59.725141 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 22:19:59.778721 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:19:59.812086 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 22:19:59.819117 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 22:20:00.357793 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 22:20:00.363008 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 22:20:00.374363 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 22:20:00.422284 tst mo_mt_sms.py: using LAC 24046 22:20:00.539663 tst mo_mt_sms.py: using RAC 76 22:20:00.657753 tst mo_mt_sms.py: using CellId 24046 22:20:00.783878 tst mo_mt_sms.py: using BVCI 24047 22:20:00.909932 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 22:20:01.057077 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 22:20:01.200207 tst mo_mt_sms.py:9: start nitb and bts... 22:20:01.432421 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:20:02.083229 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23289): Launched 22:20:02.396916 run osmo-nitb_10.42.42.2(pid=23290): Launched 22:20:02.562718 run osmo-nitb_10.42.42.2(pid=23290): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23290)] 22:20:02.696688 run osmo-nitb_10.42.42.2(pid=23290): stdout: | (launched: 2022-12-09_22:20:02.343027) 22:20:02.833108 run osmo-nitb_10.42.42.2(pid=23290): stderr: | (launched: 2022-12-09_22:20:02.387351) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:20:02.968603 run osmo-nitb_10.42.42.2(pid=23290): stdout: | (launched: 2022-12-09_22:20:02.343027) 22:20:03.098429 run osmo-nitb_10.42.42.2(pid=23290): stderr: | (launched: 2022-12-09_22:20:02.387351) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23290): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23290) [trial-2365↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23290)] 22:20:03.509858 tst osmo-nitb_10.42.42.2(pid=23290): stdout: | (launched: 2022-12-09_22:20:02.343027) 22:20:03.630417 tst osmo-nitb_10.42.42.2(pid=23290): stderr: | (launched: 2022-12-09_22:20:02.387351) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:20:03.773415 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=23290): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23290) [trial-2365↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23290)] [trial-2365↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 22:20:03.781917 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 22:20:03.788614 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23289): Terminating (SIGTERM) 22:20:03.998173 --- ParallelTerminationStrategy: PID 23289 died... 22:20:04.017057 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23289): Terminated: ok {rc=0} 22:20:04.103601 bus /sierra_3: Setting Powered False 22:20:05.204686 bus /sierra_3: Setting Powered False 22:20:06.323965 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 sms:trx-umtrx --------------------------------------------------------------------- 22:20:07.522191 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:07.526576 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:20:07.559914 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:20:07.587188 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 22:20:07.645009 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:20:07.677701 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:20:07.704131 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 22:20:08.251479 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 22:20:08.256828 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:08.267941 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 22:20:08.318073 tst mo_mt_sms.py: using LAC 24047 22:20:08.441881 tst mo_mt_sms.py: using RAC 77 22:20:08.565470 tst mo_mt_sms.py: using CellId 24047 22:20:08.690543 tst mo_mt_sms.py: using BVCI 24048 22:20:08.805742 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:08.816701 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:08.827544 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:08.838324 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:08.849082 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:08.859832 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 22:20:08.974771 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 22:20:09.093092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:09.585043 run create_hlr_db(pid=23294): Launched 22:20:09.711173 bus /sierra_2: Setting Powered False 22:20:10.770644 run create_hlr_db(pid=23294): Terminated: ok {rc=0} 22:20:11.185177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23296): Launched 22:20:11.481456 run osmo-hlr_10.42.42.2(pid=23297): Launched 22:20:11.595014 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:12.103487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23299): Launched 22:20:12.402098 run osmo-stp_10.42.42.5(pid=23300): Launched 22:20:12.516252 run osmo-msc_10.42.42.6: Starting osmo-msc 22:20:13.052860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23302): Launched 22:20:13.353186 run osmo-msc_10.42.42.6(pid=23303): Launched 22:20:13.520623 run osmo-stp_10.42.42.5(pid=23300): ERR: Terminated: ERROR {rc=1} [trial-2365↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23300)] 22:20:13.648090 run osmo-stp_10.42.42.5(pid=23300): stdout: | (launched: 2022-12-09_22:20:12.347664) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:13.775376 run osmo-stp_10.42.42.5(pid=23300): stderr: | 20221209222012518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222012518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222012518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222012518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222012519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222012519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222012519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:13.899839 run osmo-stp_10.42.42.5(pid=23300): stdout: | (launched: 2022-12-09_22:20:12.347664) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:14.018376 run osmo-stp_10.42.42.5(pid=23300): stderr: | 20221209222012518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222012518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222012518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222012518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222012519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222012519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222012519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:14.160387 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23300): Process ended prematurely: osmo-stp_10.42.42.5(pid=23300) [trial-2365↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23300)] [trial-2365↪sms:trx-umtrx↪mo_mt_sms.py:16] 22:20:14.168830 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 22:20:14.195491 run osmo-hlr_10.42.42.2(pid=23297): ERR: Terminated: ERROR {rc=237} [trial-2365↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23297)] 22:20:14.244420 run osmo-hlr_10.42.42.2(pid=23297): stdout: | (launched: 2022-12-09_22:20:11.427814) 22:20:14.294751 run osmo-hlr_10.42.42.2(pid=23297): stderr: | 20221209222011604 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222011604 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222011604 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222011605 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222011605 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222011605 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222011617 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222011626 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222011626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222011626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:14.364778 run osmo-msc_10.42.42.6(pid=23303): ERR: Terminated: ERROR {rc=2} [trial-2365↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23303)] 22:20:14.413246 run osmo-msc_10.42.42.6(pid=23303): stdout: | (launched: 2022-12-09_22:20:13.298670) 22:20:14.463474 run osmo-msc_10.42.42.6(pid=23303): stderr: | 20221209222013572 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222013572 DLGLOBAL DEBUG validating counter group 0x7f0fd9704c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222013572 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222013572 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222013572 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222013573 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222013574 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222013575 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222013575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222013575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:20:14.514019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23296): Terminating (SIGTERM) 22:20:14.554687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23299): Terminating (SIGTERM) 22:20:14.594948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23302): Terminating (SIGTERM) 22:20:14.635216 --- ParallelTerminationStrategy: PID 23296 died... 22:20:14.654797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23296): Terminated: ok {rc=0} 22:20:14.700031 --- ParallelTerminationStrategy: PID 23299 died... 22:20:14.718867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23299): Terminated: ok {rc=0} 22:20:14.763752 --- ParallelTerminationStrategy: PID 23302 died... 22:20:14.782512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23302): Terminated: ok {rc=0} 22:20:14.869261 bus /sierra_3: Setting Powered False 22:20:15.986169 bus /sierra_3: Setting Powered False 22:20:17.131393 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 22:20:18.364237 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:18.368329 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:20:18.401570 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 22:20:18.408497 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 22:20:18.444920 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:20:18.477717 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 22:20:18.484540 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 22:20:19.002654 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2365 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 22:20:19.008032 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 22:20:19.018890 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 22:20:19.066755 tst assert_extension.py: using LAC 24048 22:20:19.182242 tst assert_extension.py: using RAC 78 22:20:19.298266 tst assert_extension.py: using CellId 24048 22:20:19.414697 tst assert_extension.py: using BVCI 24049 22:20:19.521397 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 22:20:19.638670 tst assert_extension.py:10: start nitb and bts... 22:20:19.852916 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:20:20.501731 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23309): Launched 22:20:20.817506 run osmo-nitb_10.42.42.2(pid=23310): Launched 22:20:20.994264 run osmo-nitb_10.42.42.2(pid=23310): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23310)] 22:20:21.137242 run osmo-nitb_10.42.42.2(pid=23310): stdout: | (launched: 2022-12-09_22:20:20.760481) 22:20:21.281862 run osmo-nitb_10.42.42.2(pid=23310): stderr: | (launched: 2022-12-09_22:20:20.807545) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:20:21.427599 run osmo-nitb_10.42.42.2(pid=23310): stdout: | (launched: 2022-12-09_22:20:20.760481) 22:20:21.566260 run osmo-nitb_10.42.42.2(pid=23310): stderr: | (launched: 2022-12-09_22:20:20.807545) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23310): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23310) [trial-2365↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23310)] 22:20:21.938317 tst osmo-nitb_10.42.42.2(pid=23310): stdout: | (launched: 2022-12-09_22:20:20.760481) 22:20:22.067156 tst osmo-nitb_10.42.42.2(pid=23310): stderr: | (launched: 2022-12-09_22:20:20.807545) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:20:22.218951 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23310): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23310) [trial-2365↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23310)] [trial-2365↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 22:20:22.227939 tst assert_extension.py:12: Test FAILED (3.2 sec) 22:20:22.235149 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23309): Terminating (SIGTERM) 22:20:22.445950 --- ParallelTerminationStrategy: PID 23309 died... 22:20:22.467961 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23309): Terminated: ok {rc=0} 22:20:22.555852 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 ussd:trx-umtrx --------------------------------------------------------------------- 22:20:23.736461 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:23.740782 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:20:23.774281 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:20:23.801634 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 22:20:23.837632 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:20:23.871248 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:20:23.899016 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 22:20:24.431038 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2365 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 22:20:24.438605 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:24.450146 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 22:20:24.497471 tst assert_extension.py: using LAC 24049 22:20:24.615150 tst assert_extension.py: using RAC 79 22:20:24.729390 tst assert_extension.py: using CellId 24049 22:20:24.846437 tst assert_extension.py: using BVCI 24050 22:20:24.954869 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:24.965414 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:24.975771 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:24.986329 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:24.996596 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:25.007127 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 22:20:25.124884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:25.616850 run create_hlr_db(pid=23314): Launched 22:20:25.746638 bus /sierra_2: Setting Powered False 22:20:26.810110 run create_hlr_db(pid=23314): Terminated: ok {rc=0} 22:20:27.234855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23316): Launched 22:20:27.532115 run osmo-hlr_10.42.42.2(pid=23317): Launched 22:20:27.645425 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:28.159086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23319): Launched 22:20:28.454940 run osmo-stp_10.42.42.5(pid=23320): Launched 22:20:28.569104 run osmo-msc_10.42.42.6: Starting osmo-msc 22:20:29.103632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23322): Launched 22:20:29.400523 run osmo-msc_10.42.42.6(pid=23323): Launched 22:20:29.566101 run osmo-stp_10.42.42.5(pid=23320): ERR: Terminated: ERROR {rc=1} [trial-2365↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23320)] 22:20:29.692331 run osmo-stp_10.42.42.5(pid=23320): stdout: | (launched: 2022-12-09_22:20:28.401224) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:29.818594 run osmo-stp_10.42.42.5(pid=23320): stderr: | 20221209222028570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222028570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222028571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222028571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222028571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222028572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222028572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:29.942433 run osmo-stp_10.42.42.5(pid=23320): stdout: | (launched: 2022-12-09_22:20:28.401224) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:30.060375 run osmo-stp_10.42.42.5(pid=23320): stderr: | 20221209222028570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222028570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222028571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222028571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222028571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222028572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222028572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:30.201438 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=23320): Process ended prematurely: osmo-stp_10.42.42.5(pid=23320) [trial-2365↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23320)] [trial-2365↪ussd:trx-umtrx↪assert_extension.py:17] 22:20:30.209630 tst assert_extension.py:17: Test FAILED (5.8 sec) 22:20:30.236240 run osmo-hlr_10.42.42.2(pid=23317): ERR: Terminated: ERROR {rc=237} [trial-2365↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23317)] 22:20:30.284108 run osmo-hlr_10.42.42.2(pid=23317): stdout: | (launched: 2022-12-09_22:20:27.478377) 22:20:30.333533 run osmo-hlr_10.42.42.2(pid=23317): stderr: | 20221209222027653 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222027653 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222027653 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222027653 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222027653 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222027653 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222027665 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222027674 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222027674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222027674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:30.402295 run osmo-msc_10.42.42.6(pid=23323): ERR: Terminated: ERROR {rc=2} [trial-2365↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23323)] 22:20:30.450080 run osmo-msc_10.42.42.6(pid=23323): stdout: | (launched: 2022-12-09_22:20:29.346034) 22:20:30.499275 run osmo-msc_10.42.42.6(pid=23323): stderr: | 20221209222029619 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222029619 DLGLOBAL DEBUG validating counter group 0x7fe87977ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222029619 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222029619 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222029619 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222029619 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222029621 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222029622 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222029622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222029622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:20:30.549238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23316): Terminating (SIGTERM) 22:20:30.588998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23319): Terminating (SIGTERM) 22:20:30.628900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23322): Terminating (SIGTERM) 22:20:30.669283 --- ParallelTerminationStrategy: PID 23316 died... 22:20:30.688258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23316): Terminated: ok {rc=0} 22:20:30.732644 --- ParallelTerminationStrategy: PID 23319 died... 22:20:30.751229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23319): Terminated: ok {rc=0} 22:20:30.795385 --- ParallelTerminationStrategy: PID 23322 died... 22:20:30.814083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23322): Terminated: ok {rc=0} 22:20:30.912808 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:20:32.149508 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:32.158243 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:20:32.199616 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:20:32.226971 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:20:32.278102 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:20:32.311223 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:20:32.337508 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:20:32.892065 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:20:32.945804 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:32.956889 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:20:33.025272 tst mo_mt_call.py: using LAC 24050 22:20:33.145050 tst mo_mt_call.py: using RAC 80 22:20:33.265167 tst mo_mt_call.py: using CellId 24050 22:20:33.384012 tst mo_mt_call.py: using BVCI 24051 22:20:33.494167 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:33.505142 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:33.515904 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:33.527025 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:33.538319 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:33.549567 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:20:33.669023 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:20:33.789678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:34.290833 run create_hlr_db(pid=23328): Launched 22:20:34.423737 bus /sierra_2: Setting Powered False 22:20:35.488407 run create_hlr_db(pid=23328): Terminated: ok {rc=0} 22:20:35.921636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23330): Launched 22:20:36.227215 run osmo-hlr_10.42.42.2(pid=23331): Launched 22:20:36.342295 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:36.861041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23333): Launched 22:20:37.164041 run osmo-stp_10.42.42.5(pid=23334): Launched 22:20:37.279748 run osmo-msc_10.42.42.6: Starting osmo-msc 22:20:37.827677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23336): Launched 22:20:38.130147 run osmo-msc_10.42.42.6(pid=23337): Launched 22:20:38.299817 run osmo-stp_10.42.42.5(pid=23334): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23334)] 22:20:38.427835 run osmo-stp_10.42.42.5(pid=23334): stdout: | (launched: 2022-12-09_22:20:37.109356) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:38.556301 run osmo-stp_10.42.42.5(pid=23334): stderr: | 20221209222037279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222037279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222037279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222037280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222037280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222037280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222037280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:38.682427 run osmo-stp_10.42.42.5(pid=23334): stdout: | (launched: 2022-12-09_22:20:37.109356) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:38.802432 run osmo-stp_10.42.42.5(pid=23334): stderr: | 20221209222037279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222037279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222037279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222037280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222037280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222037280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222037280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:38.946587 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23334): Process ended prematurely: osmo-stp_10.42.42.5(pid=23334) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23334)] [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:20:38.955407 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:20:38.982259 run osmo-hlr_10.42.42.2(pid=23331): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23331)] 22:20:39.030374 run osmo-hlr_10.42.42.2(pid=23331): stdout: | (launched: 2022-12-09_22:20:36.171363) 22:20:39.079733 run osmo-hlr_10.42.42.2(pid=23331): stderr: | 20221209222036348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222036348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222036348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222036349 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222036349 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222036349 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222036360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222036369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222036369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222036369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:39.148201 run osmo-msc_10.42.42.6(pid=23337): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23337)] 22:20:39.195659 run osmo-msc_10.42.42.6(pid=23337): stdout: | (launched: 2022-12-09_22:20:38.074962) 22:20:39.244756 run osmo-msc_10.42.42.6(pid=23337): stderr: | 20221209222038344 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222038344 DLGLOBAL DEBUG validating counter group 0x7fb34ad94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222038344 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222038344 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222038345 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222038345 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222038347 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222038347 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222038347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222038347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:20:39.294435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23330): Terminating (SIGTERM) 22:20:39.333916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23333): Terminating (SIGTERM) 22:20:39.373947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23336): Terminating (SIGTERM) 22:20:39.413908 --- ParallelTerminationStrategy: PID 23330 died... 22:20:39.432837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23330): Terminated: ok {rc=0} 22:20:39.477471 --- ParallelTerminationStrategy: PID 23333 died... 22:20:39.496137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23333): Terminated: ok {rc=0} 22:20:39.540550 --- ParallelTerminationStrategy: PID 23336 died... 22:20:39.559211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23336): Terminated: ok {rc=0} 22:20:39.642795 bus /sierra_3: Setting Powered False 22:20:40.741666 bus /sierra_3: Setting Powered False 22:20:41.858247 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:20:43.007853 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:43.020119 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:20:43.090658 tst mo_mt_call_osmux.py: using LAC 24051 22:20:43.217162 tst mo_mt_call_osmux.py: using RAC 81 22:20:43.345132 tst mo_mt_call_osmux.py: using CellId 24051 22:20:43.471597 tst mo_mt_call_osmux.py: using BVCI 24052 22:20:43.589573 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:43.601025 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:43.612231 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:43.623560 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:43.634913 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:43.646165 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:20:43.762359 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:20:43.882332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:44.380114 run create_hlr_db(pid=23339): Launched 22:20:44.511330 bus /sierra_2: Setting Powered False 22:20:45.572069 run create_hlr_db(pid=23339): Terminated: ok {rc=0} 22:20:46.018401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23341): Launched 22:20:46.352862 run osmo-hlr_10.42.42.2(pid=23342): Launched 22:20:46.599210 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:47.302026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23344): Launched 22:20:47.610276 run osmo-stp_10.42.42.5(pid=23345): Launched 22:20:47.726796 run osmo-msc_10.42.42.6: Starting osmo-msc 22:20:48.272409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23347): Launched 22:20:48.574359 run osmo-msc_10.42.42.6(pid=23348): Launched 22:20:48.744026 run osmo-stp_10.42.42.5(pid=23345): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23345)] 22:20:48.872153 run osmo-stp_10.42.42.5(pid=23345): stdout: | (launched: 2022-12-09_22:20:47.555254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:49.000643 run osmo-stp_10.42.42.5(pid=23345): stderr: | 20221209222047723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222047723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222047723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222047724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222047724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222047724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222047724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:49.127067 run osmo-stp_10.42.42.5(pid=23345): stdout: | (launched: 2022-12-09_22:20:47.555254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:49.247360 run osmo-stp_10.42.42.5(pid=23345): stderr: | 20221209222047723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222047723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222047723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222047724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222047724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222047724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222047724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:49.391073 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23345): Process ended prematurely: osmo-stp_10.42.42.5(pid=23345) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23345)] [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:20:49.400173 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:20:49.426931 run osmo-hlr_10.42.42.2(pid=23342): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23342)] 22:20:49.474913 run osmo-hlr_10.42.42.2(pid=23342): stdout: | (launched: 2022-12-09_22:20:46.284204) 22:20:49.524350 run osmo-hlr_10.42.42.2(pid=23342): stderr: | 20221209222046572 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222046572 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222046573 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222046573 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222046573 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222046573 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222046587 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222046612 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222046612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222046612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:49.593645 run osmo-msc_10.42.42.6(pid=23348): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23348)] 22:20:49.641275 run osmo-msc_10.42.42.6(pid=23348): stdout: | (launched: 2022-12-09_22:20:48.519891) 22:20:49.690619 run osmo-msc_10.42.42.6(pid=23348): stderr: | 20221209222048792 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222048792 DLGLOBAL DEBUG validating counter group 0x7f7672a56c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222048792 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222048792 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222048792 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222048793 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222048795 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222048795 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222048795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222048795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:20:49.740416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23341): Terminating (SIGTERM) 22:20:49.780309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23344): Terminating (SIGTERM) 22:20:49.820254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23347): Terminating (SIGTERM) 22:20:49.860542 --- ParallelTerminationStrategy: PID 23341 died... 22:20:49.879793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23341): Terminated: ok {rc=0} 22:20:49.924655 --- ParallelTerminationStrategy: PID 23344 died... 22:20:49.943470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23344): Terminated: ok {rc=0} 22:20:49.988337 --- ParallelTerminationStrategy: PID 23347 died... 22:20:50.006951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23347): Terminated: ok {rc=0} 22:20:50.091594 bus /sierra_3: Setting Powered False 22:20:51.190746 bus /sierra_3: Setting Powered False 22:20:52.309347 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:20:53.559052 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:53.565567 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:20:53.598660 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:20:53.625140 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:20:53.678063 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:20:53.710872 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:20:53.737463 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:20:54.286955 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:20:54.335351 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:54.346490 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:20:54.421839 tst mo_mt_call.py: using LAC 24052 22:20:54.541145 tst mo_mt_call.py: using RAC 82 22:20:54.658862 tst mo_mt_call.py: using CellId 24052 22:20:54.776659 tst mo_mt_call.py: using BVCI 24053 22:20:54.885428 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:54.896374 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:54.907188 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:54.918343 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:54.929526 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:54.940510 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:20:55.055333 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:20:55.171151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:55.637919 run create_hlr_db(pid=23353): Launched 22:20:55.753108 bus /sierra_2: Setting Powered False 22:20:56.814256 run create_hlr_db(pid=23353): Terminated: ok {rc=0} 22:20:57.255650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23355): Launched 22:20:57.579632 run osmo-hlr_10.42.42.2(pid=23356): Launched 22:20:57.705915 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:58.269388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23358): Launched 22:20:58.593067 run osmo-stp_10.42.42.5(pid=23359): Launched 22:20:58.716398 run osmo-msc_10.42.42.6: Starting osmo-msc 22:20:59.300634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23361): Launched 22:20:59.623608 run osmo-msc_10.42.42.6(pid=23362): Launched 22:20:59.804202 run osmo-stp_10.42.42.5(pid=23359): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23359)] 22:20:59.939593 run osmo-stp_10.42.42.5(pid=23359): stdout: | (launched: 2022-12-09_22:20:58.534543) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:00.075743 run osmo-stp_10.42.42.5(pid=23359): stderr: | 20221209222058725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222058725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222058725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222058725 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222058728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222058728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222058728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:00.211742 run osmo-stp_10.42.42.5(pid=23359): stdout: | (launched: 2022-12-09_22:20:58.534543) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:00.340297 run osmo-stp_10.42.42.5(pid=23359): stderr: | 20221209222058725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222058725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222058725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222058725 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222058728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222058728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222058728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:00.494938 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23359): Process ended prematurely: osmo-stp_10.42.42.5(pid=23359) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23359)] [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:21:00.504327 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:21:00.532478 run osmo-hlr_10.42.42.2(pid=23356): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23356)] 22:21:00.582421 run osmo-hlr_10.42.42.2(pid=23356): stdout: | (launched: 2022-12-09_22:20:57.521546) 22:21:00.634027 run osmo-hlr_10.42.42.2(pid=23356): stderr: | 20221209222057718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222057718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222057718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222057718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222057718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222057718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222057731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222057739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222057739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222057739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:00.705834 run osmo-msc_10.42.42.6(pid=23362): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23362)] 22:21:00.755709 run osmo-msc_10.42.42.6(pid=23362): stdout: | (launched: 2022-12-09_22:20:59.565103) 22:21:00.807514 run osmo-msc_10.42.42.6(pid=23362): stderr: | 20221209222059886 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222059886 DLGLOBAL DEBUG validating counter group 0x7f9ea25ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222059886 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222059886 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222059887 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222059887 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222059888 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222059889 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222059889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222059889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:00.878883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23355): Terminating (SIGTERM) 22:21:00.926310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23358): Terminating (SIGTERM) 22:21:00.971708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23361): Terminating (SIGTERM) 22:21:01.018619 --- ParallelTerminationStrategy: PID 23355 died... 22:21:01.039323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23355): Terminated: ok {rc=0} 22:21:01.089310 --- ParallelTerminationStrategy: PID 23358 died... 22:21:01.109531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23358): Terminated: ok {rc=0} 22:21:01.158038 --- ParallelTerminationStrategy: PID 23361 died... 22:21:01.178238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23361): Terminated: ok {rc=0} 22:21:01.268713 bus /sierra_3: Setting Powered False 22:21:02.366550 bus /sierra_3: Setting Powered False 22:21:03.483734 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:21:04.630639 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:04.642572 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:21:04.712382 tst mo_mt_call_osmux.py: using LAC 24053 22:21:04.830903 tst mo_mt_call_osmux.py: using RAC 83 22:21:04.948729 tst mo_mt_call_osmux.py: using CellId 24053 22:21:05.066327 tst mo_mt_call_osmux.py: using BVCI 24054 22:21:05.175978 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:05.187258 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:05.198165 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:05.209835 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:05.221518 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:05.233070 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:21:05.353373 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:21:05.475850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:05.944421 run create_hlr_db(pid=23364): Launched 22:21:06.060137 bus /sierra_2: Setting Powered False 22:21:07.120833 run create_hlr_db(pid=23364): Terminated: ok {rc=0} 22:21:07.542658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23366): Launched 22:21:07.845377 run osmo-hlr_10.42.42.2(pid=23367): Launched 22:21:07.962747 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:08.494057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23369): Launched 22:21:08.797431 run osmo-stp_10.42.42.5(pid=23370): Launched 22:21:08.914507 run osmo-msc_10.42.42.6: Starting osmo-msc 22:21:09.463739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23372): Launched 22:21:09.767193 run osmo-msc_10.42.42.6(pid=23373): Launched 22:21:09.935816 run osmo-stp_10.42.42.5(pid=23370): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23370)] 22:21:10.062919 run osmo-stp_10.42.42.5(pid=23370): stdout: | (launched: 2022-12-09_22:21:08.741740) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:10.190591 run osmo-stp_10.42.42.5(pid=23370): stderr: | 20221209222108910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222108910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222108911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222108911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222108913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222108913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222108914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:10.317444 run osmo-stp_10.42.42.5(pid=23370): stdout: | (launched: 2022-12-09_22:21:08.741740) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:10.437594 run osmo-stp_10.42.42.5(pid=23370): stderr: | 20221209222108910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222108910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222108911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222108911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222108913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222108913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222108914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:10.581643 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23370): Process ended prematurely: osmo-stp_10.42.42.5(pid=23370) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23370)] [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:21:10.590621 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:21:10.617561 run osmo-hlr_10.42.42.2(pid=23367): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23367)] 22:21:10.665354 run osmo-hlr_10.42.42.2(pid=23367): stdout: | (launched: 2022-12-09_22:21:07.790408) 22:21:10.714635 run osmo-hlr_10.42.42.2(pid=23367): stderr: | 20221209222107964 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222107964 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222107965 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222107965 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222107965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222107965 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222107977 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222107987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222107988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222107988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:10.783384 run osmo-msc_10.42.42.6(pid=23373): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23373)] 22:21:10.831034 run osmo-msc_10.42.42.6(pid=23373): stdout: | (launched: 2022-12-09_22:21:09.711882) 22:21:10.880171 run osmo-msc_10.42.42.6(pid=23373): stderr: | 20221209222109984 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222109984 DLGLOBAL DEBUG validating counter group 0x7fec8c43ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222109984 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222109984 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222109985 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222109985 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222109987 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222109988 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222109988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222109988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:10.929708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23366): Terminating (SIGTERM) 22:21:10.969319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23369): Terminating (SIGTERM) 22:21:11.008929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23372): Terminating (SIGTERM) 22:21:11.048833 --- ParallelTerminationStrategy: PID 23366 died... 22:21:11.067872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23366): Terminated: ok {rc=0} 22:21:11.112840 --- ParallelTerminationStrategy: PID 23369 died... 22:21:11.131807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23369): Terminated: ok {rc=0} 22:21:11.176042 --- ParallelTerminationStrategy: PID 23372 died... 22:21:11.194699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23372): Terminated: ok {rc=0} 22:21:11.280480 bus /sierra_3: Setting Powered False 22:21:12.379105 bus /sierra_3: Setting Powered False 22:21:13.494323 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:21:14.740063 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:21:14.746486 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:21:14.779251 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:21:14.805949 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:21:14.857230 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:21:14.889379 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:21:14.915937 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:21:15.467201 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:21:15.516382 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:15.527593 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:21:15.595813 tst mo_mt_call.py: using LAC 24054 22:21:15.723776 tst mo_mt_call.py: using RAC 84 22:21:15.859314 tst mo_mt_call.py: using CellId 24054 22:21:15.992001 tst mo_mt_call.py: using BVCI 24055 22:21:16.106964 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:16.118872 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:16.130633 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:16.143602 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:16.156679 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:16.170521 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:21:16.296083 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:21:16.424284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:16.951496 run create_hlr_db(pid=23378): Launched 22:21:17.128420 bus /sierra_2: Setting Powered False 22:21:18.188872 run create_hlr_db(pid=23378): Terminated: ok {rc=0} 22:21:18.635290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23380): Launched 22:21:18.958637 run osmo-hlr_10.42.42.2(pid=23381): Launched 22:21:19.082148 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:19.637115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23383): Launched 22:21:19.960746 run osmo-stp_10.42.42.5(pid=23384): Launched 22:21:20.084120 run osmo-msc_10.42.42.6: Starting osmo-msc 22:21:20.668601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23386): Launched 22:21:20.992406 run osmo-msc_10.42.42.6(pid=23387): Launched 22:21:21.172419 run osmo-stp_10.42.42.5(pid=23384): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23384)] 22:21:21.309254 run osmo-stp_10.42.42.5(pid=23384): stdout: | (launched: 2022-12-09_22:21:19.902373) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:21.450137 run osmo-stp_10.42.42.5(pid=23384): stderr: | 20221209222120097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222120097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222120097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222120098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222120098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222120098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222120098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:21.586557 run osmo-stp_10.42.42.5(pid=23384): stdout: | (launched: 2022-12-09_22:21:19.902373) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:21.715455 run osmo-stp_10.42.42.5(pid=23384): stderr: | 20221209222120097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222120097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222120097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222120098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222120098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222120098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222120098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:21.870039 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23384): Process ended prematurely: osmo-stp_10.42.42.5(pid=23384) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23384)] [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:21:21.879459 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:21:21.913899 run osmo-hlr_10.42.42.2(pid=23381): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23381)] 22:21:21.964613 run osmo-hlr_10.42.42.2(pid=23381): stdout: | (launched: 2022-12-09_22:21:18.900352) 22:21:22.015804 run osmo-hlr_10.42.42.2(pid=23381): stderr: | 20221209222119097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222119097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222119097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222119097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222119097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222119097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222119114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222119124 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222119124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222119124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:22.087019 run osmo-msc_10.42.42.6(pid=23387): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23387)] 22:21:22.136238 run osmo-msc_10.42.42.6(pid=23387): stdout: | (launched: 2022-12-09_22:21:20.933845) 22:21:22.187138 run osmo-msc_10.42.42.6(pid=23387): stderr: | 20221209222121255 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222121255 DLGLOBAL DEBUG validating counter group 0x7fac6297dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222121255 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222121255 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222121255 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222121255 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222121257 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222121257 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222121258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222121258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:22.238825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23380): Terminating (SIGTERM) 22:21:22.280034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23383): Terminating (SIGTERM) 22:21:22.321595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23386): Terminating (SIGTERM) 22:21:22.363152 --- ParallelTerminationStrategy: PID 23380 died... 22:21:22.382685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23380): Terminated: ok {rc=0} 22:21:22.428846 --- ParallelTerminationStrategy: PID 23383 died... 22:21:22.447754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23383): Terminated: ok {rc=0} 22:21:22.493999 --- ParallelTerminationStrategy: PID 23386 died... 22:21:22.512915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23386): Terminated: ok {rc=0} 22:21:22.601404 bus /sierra_3: Setting Powered False 22:21:23.701536 bus /sierra_3: Setting Powered False 22:21:24.819735 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:21:25.968050 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:25.979735 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:21:26.048444 tst mo_mt_call_osmux.py: using LAC 24055 22:21:26.168788 tst mo_mt_call_osmux.py: using RAC 85 22:21:26.296410 tst mo_mt_call_osmux.py: using CellId 24055 22:21:26.424478 tst mo_mt_call_osmux.py: using BVCI 24056 22:21:26.542857 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:26.554514 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:26.566042 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:26.577693 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:26.589548 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:26.600867 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:21:26.719766 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:21:26.833943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:27.301748 run create_hlr_db(pid=23389): Launched 22:21:27.419159 bus /sierra_2: Setting Powered False 22:21:28.479683 run create_hlr_db(pid=23389): Terminated: ok {rc=0} 22:21:28.901940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23391): Launched 22:21:29.204111 run osmo-hlr_10.42.42.2(pid=23392): Launched 22:21:29.320357 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:29.861301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23394): Launched 22:21:30.164245 run osmo-stp_10.42.42.5(pid=23395): Launched 22:21:30.280637 run osmo-msc_10.42.42.6: Starting osmo-msc 22:21:30.826094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23397): Launched 22:21:31.165177 run osmo-msc_10.42.42.6(pid=23398): Launched 22:21:31.650211 run osmo-stp_10.42.42.5(pid=23395): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23395)] 22:21:31.816063 run osmo-stp_10.42.42.5(pid=23395): stdout: | (launched: 2022-12-09_22:21:30.109150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:31.946398 run osmo-stp_10.42.42.5(pid=23395): stderr: | 20221209222130278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222130278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222130278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222130279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222130281 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222130281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222130281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:32.076035 run osmo-stp_10.42.42.5(pid=23395): stdout: | (launched: 2022-12-09_22:21:30.109150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:32.199516 run osmo-stp_10.42.42.5(pid=23395): stderr: | 20221209222130278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222130278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222130278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222130279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222130281 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222130281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222130281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:32.346753 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23395): Process ended prematurely: osmo-stp_10.42.42.5(pid=23395) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23395)] [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:21:32.356512 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:21:32.386492 run osmo-hlr_10.42.42.2(pid=23392): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23392)] 22:21:32.437142 run osmo-hlr_10.42.42.2(pid=23392): stdout: | (launched: 2022-12-09_22:21:29.148889) 22:21:32.487281 run osmo-hlr_10.42.42.2(pid=23392): stderr: | 20221209222129322 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222129322 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222129322 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222129322 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222129322 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222129322 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222129334 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222129343 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222129343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222129343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:32.556915 run osmo-msc_10.42.42.6(pid=23398): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23398)] 22:21:32.605394 run osmo-msc_10.42.42.6(pid=23398): stdout: | (launched: 2022-12-09_22:21:31.101123) 22:21:32.655376 run osmo-msc_10.42.42.6(pid=23398): stderr: | 20221209222131425 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222131425 DLGLOBAL DEBUG validating counter group 0x7feca239ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222131425 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222131425 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222131426 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222131426 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222131428 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222131429 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222131429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222131429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:32.705941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23391): Terminating (SIGTERM) 22:21:32.745500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23394): Terminating (SIGTERM) 22:21:32.786967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23397): Terminating (SIGTERM) 22:21:32.827832 --- ParallelTerminationStrategy: PID 23391 died... 22:21:32.847426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23391): Terminated: ok {rc=0} 22:21:32.893133 --- ParallelTerminationStrategy: PID 23394 died... 22:21:32.911742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23394): Terminated: ok {rc=0} 22:21:32.957413 --- ParallelTerminationStrategy: PID 23397 died... 22:21:32.975982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23397): Terminated: ok {rc=0} 22:21:33.063519 bus /sierra_3: Setting Powered False 22:21:34.162394 bus /sierra_3: Setting Powered False 22:21:35.275474 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:21:36.526159 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:21:36.533073 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:21:36.566343 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:21:36.593686 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:21:36.646765 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:21:36.680450 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:21:36.707827 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:21:37.258920 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:21:37.310330 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:37.321874 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:21:37.390887 tst mo_mt_call.py: using LAC 24056 22:21:37.515409 tst mo_mt_call.py: using RAC 86 22:21:37.639840 tst mo_mt_call.py: using CellId 24056 22:21:37.764174 tst mo_mt_call.py: using BVCI 24057 22:21:37.881616 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:37.892934 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:37.904301 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:37.915558 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:37.926902 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:37.938377 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:21:38.056941 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:21:38.177551 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:38.645496 run create_hlr_db(pid=23403): Launched 22:21:38.763031 bus /sierra_2: Setting Powered False 22:21:39.823364 run create_hlr_db(pid=23403): Terminated: ok {rc=0} 22:21:40.244680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23405): Launched 22:21:40.547438 run osmo-hlr_10.42.42.2(pid=23406): Launched 22:21:40.663259 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:41.180922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23408): Launched 22:21:41.483569 run osmo-stp_10.42.42.5(pid=23409): Launched 22:21:41.599549 run osmo-msc_10.42.42.6: Starting osmo-msc 22:21:42.146432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23411): Launched 22:21:42.448321 run osmo-msc_10.42.42.6(pid=23412): Launched 22:21:42.617868 run osmo-stp_10.42.42.5(pid=23409): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23409)] 22:21:42.746301 run osmo-stp_10.42.42.5(pid=23409): stdout: | (launched: 2022-12-09_22:21:41.428409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:42.874993 run osmo-stp_10.42.42.5(pid=23409): stderr: | 20221209222141600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222141600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222141600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222141601 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222141601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222141601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222141601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:43.001362 run osmo-stp_10.42.42.5(pid=23409): stdout: | (launched: 2022-12-09_22:21:41.428409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:43.122217 run osmo-stp_10.42.42.5(pid=23409): stderr: | 20221209222141600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222141600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222141600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222141601 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222141601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222141601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222141601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:43.266323 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23409): Process ended prematurely: osmo-stp_10.42.42.5(pid=23409) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23409)] [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:21:43.275059 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:21:43.302252 run osmo-hlr_10.42.42.2(pid=23406): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23406)] 22:21:43.350307 run osmo-hlr_10.42.42.2(pid=23406): stdout: | (launched: 2022-12-09_22:21:40.492186) 22:21:43.400270 run osmo-hlr_10.42.42.2(pid=23406): stderr: | 20221209222140667 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222140667 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222140667 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222140667 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222140667 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222140668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222140718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222140728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222140728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222140729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:43.469452 run osmo-msc_10.42.42.6(pid=23412): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23412)] 22:21:43.517403 run osmo-msc_10.42.42.6(pid=23412): stdout: | (launched: 2022-12-09_22:21:42.393662) 22:21:43.567143 run osmo-msc_10.42.42.6(pid=23412): stderr: | 20221209222142665 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222142665 DLGLOBAL DEBUG validating counter group 0x7fab7afddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222142665 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222142665 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222142665 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222142665 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222142668 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222142668 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222142668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222142668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:43.617090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23405): Terminating (SIGTERM) 22:21:43.656831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23408): Terminating (SIGTERM) 22:21:43.696489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23411): Terminating (SIGTERM) 22:21:43.736669 --- ParallelTerminationStrategy: PID 23405 died... 22:21:43.755775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23405): Terminated: ok {rc=0} 22:21:43.800485 --- ParallelTerminationStrategy: PID 23408 died... 22:21:43.819105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23408): Terminated: ok {rc=0} 22:21:43.863768 --- ParallelTerminationStrategy: PID 23411 died... 22:21:43.882524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23411): Terminated: ok {rc=0} 22:21:43.969710 bus /sierra_3: Setting Powered False 22:21:45.069255 bus /sierra_3: Setting Powered False 22:21:46.185588 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:21:47.336577 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:47.348665 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:21:47.424353 tst mo_mt_call_osmux.py: using LAC 24057 22:21:47.550546 tst mo_mt_call_osmux.py: using RAC 87 22:21:47.676907 tst mo_mt_call_osmux.py: using CellId 24057 22:21:47.802913 tst mo_mt_call_osmux.py: using BVCI 24058 22:21:47.920664 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:47.932089 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:47.943363 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:47.954691 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:47.966095 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:47.977371 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:21:48.099411 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:21:48.217109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:48.684420 run create_hlr_db(pid=23414): Launched 22:21:48.800940 bus /sierra_2: Setting Powered False 22:21:49.864904 run create_hlr_db(pid=23414): Terminated: ok {rc=0} 22:21:50.296251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23416): Launched 22:21:50.599183 run osmo-hlr_10.42.42.2(pid=23417): Launched 22:21:50.715777 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:51.248453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23419): Launched 22:21:51.551435 run osmo-stp_10.42.42.5(pid=23420): Launched 22:21:51.666580 run osmo-msc_10.42.42.6: Starting osmo-msc 22:21:52.212105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23422): Launched 22:21:52.514160 run osmo-msc_10.42.42.6(pid=23423): Launched 22:21:52.683535 run osmo-stp_10.42.42.5(pid=23420): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23420)] 22:21:52.811535 run osmo-stp_10.42.42.5(pid=23420): stdout: | (launched: 2022-12-09_22:21:51.496561) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:52.940170 run osmo-stp_10.42.42.5(pid=23420): stderr: | 20221209222151668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222151668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222151669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222151669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222151669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222151670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222151670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:53.066246 run osmo-stp_10.42.42.5(pid=23420): stdout: | (launched: 2022-12-09_22:21:51.496561) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:53.186065 run osmo-stp_10.42.42.5(pid=23420): stderr: | 20221209222151668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222151668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222151669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222151669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222151669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222151670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222151670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:53.329786 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23420): Process ended prematurely: osmo-stp_10.42.42.5(pid=23420) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23420)] [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:21:53.338684 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:21:53.365356 run osmo-hlr_10.42.42.2(pid=23417): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23417)] 22:21:53.413452 run osmo-hlr_10.42.42.2(pid=23417): stdout: | (launched: 2022-12-09_22:21:50.544157) 22:21:53.462989 run osmo-hlr_10.42.42.2(pid=23417): stderr: | 20221209222150718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222150719 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222150719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222150719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222150719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222150719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222150731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222150740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222150740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222150740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:53.531978 run osmo-msc_10.42.42.6(pid=23423): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23423)] 22:21:53.579604 run osmo-msc_10.42.42.6(pid=23423): stdout: | (launched: 2022-12-09_22:21:52.459360) 22:21:53.628682 run osmo-msc_10.42.42.6(pid=23423): stderr: | 20221209222152732 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222152732 DLGLOBAL DEBUG validating counter group 0x7f34a60d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222152732 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222152732 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222152733 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222152733 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222152735 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222152735 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222152735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222152735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:53.678325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23416): Terminating (SIGTERM) 22:21:53.718051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23419): Terminating (SIGTERM) 22:21:53.757639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23422): Terminating (SIGTERM) 22:21:53.797743 --- ParallelTerminationStrategy: PID 23416 died... 22:21:53.816773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23416): Terminated: ok {rc=0} 22:21:53.861097 --- ParallelTerminationStrategy: PID 23419 died... 22:21:53.879652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23419): Terminated: ok {rc=0} 22:21:53.924766 --- ParallelTerminationStrategy: PID 23422 died... 22:21:53.943379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23422): Terminated: ok {rc=0} 22:21:54.029722 bus /sierra_3: Setting Powered False 22:21:55.129835 bus /sierra_3: Setting Powered False 22:21:56.246141 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:21:57.489507 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:21:57.496062 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:21:57.531646 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:21:57.559270 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:21:57.610908 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:21:57.644093 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:21:57.671432 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:21:58.224699 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:21:58.276673 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:21:58.288300 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:21:58.357041 tst mo_mt_call.py: using LAC 24058 22:21:58.483692 tst mo_mt_call.py: using RAC 88 22:21:58.610616 tst mo_mt_call.py: using CellId 24058 22:21:58.735626 tst mo_mt_call.py: using BVCI 24059 22:21:58.847030 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:21:58.858006 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:21:58.868719 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:21:58.879755 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:21:58.890912 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:21:58.901944 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:21:59.020227 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:21:59.141416 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:59.639839 run create_hlr_db(pid=23430): Launched 22:21:59.771441 bus /sierra_2: Setting Powered False 22:22:00.835870 run create_hlr_db(pid=23430): Terminated: ok {rc=0} 22:22:01.313672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23432): Launched 22:22:01.637312 run osmo-hlr_10.42.42.2(pid=23433): Launched 22:22:01.872427 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:02.571300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23435): Launched 22:22:02.893673 run osmo-stp_10.42.42.5(pid=23436): Launched 22:22:03.015961 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:03.598893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23438): Launched 22:22:03.921384 run osmo-msc_10.42.42.6(pid=23439): Launched 22:22:04.103098 run osmo-stp_10.42.42.5(pid=23436): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23436)] 22:22:04.240760 run osmo-stp_10.42.42.5(pid=23436): stdout: | (launched: 2022-12-09_22:22:02.835521) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:04.378852 run osmo-stp_10.42.42.5(pid=23436): stderr: | 20221209222203028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222203028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222203028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222203029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222203029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222203029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222203029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:04.515961 run osmo-stp_10.42.42.5(pid=23436): stdout: | (launched: 2022-12-09_22:22:02.835521) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:04.645273 run osmo-stp_10.42.42.5(pid=23436): stderr: | 20221209222203028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222203028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222203028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222203029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222203029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222203029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222203029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:04.799652 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23436): Process ended prematurely: osmo-stp_10.42.42.5(pid=23436) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23436)] [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:22:04.809287 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 22:22:04.837003 run osmo-hlr_10.42.42.2(pid=23433): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23433)] 22:22:04.887019 run osmo-hlr_10.42.42.2(pid=23433): stdout: | (launched: 2022-12-09_22:22:01.574081) 22:22:04.938522 run osmo-hlr_10.42.42.2(pid=23433): stderr: | 20221209222201923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222201923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222201923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222201923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222201923 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222201923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222201942 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222201950 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222201951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222201951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:05.010500 run osmo-msc_10.42.42.6(pid=23439): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23439)] 22:22:05.060664 run osmo-msc_10.42.42.6(pid=23439): stdout: | (launched: 2022-12-09_22:22:03.863088) 22:22:05.112457 run osmo-msc_10.42.42.6(pid=23439): stderr: | 20221209222204184 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222204184 DLGLOBAL DEBUG validating counter group 0x7f4e4b127c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222204184 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222204184 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222204184 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222204185 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222204186 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222204187 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222204187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222204187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:05.164337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23432): Terminating (SIGTERM) 22:22:05.206221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23435): Terminating (SIGTERM) 22:22:05.247878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23438): Terminating (SIGTERM) 22:22:05.289835 --- ParallelTerminationStrategy: PID 23432 died... 22:22:05.309814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23432): Terminated: ok {rc=0} 22:22:05.355987 --- ParallelTerminationStrategy: PID 23435 died... 22:22:05.375562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23435): Terminated: ok {rc=0} 22:22:05.422190 --- ParallelTerminationStrategy: PID 23438 died... 22:22:05.441730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23438): Terminated: ok {rc=0} 22:22:05.528564 bus /sierra_3: Setting Powered False 22:22:06.627949 bus /sierra_3: Setting Powered False 22:22:07.744013 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:22:08.895087 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:08.907311 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:22:08.978871 tst mo_mt_call_osmux.py: using LAC 24059 22:22:09.110684 tst mo_mt_call_osmux.py: using RAC 89 22:22:09.239664 tst mo_mt_call_osmux.py: using CellId 24059 22:22:09.366356 tst mo_mt_call_osmux.py: using BVCI 24060 22:22:09.484163 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:09.495668 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:09.506953 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:09.518292 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:09.529779 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:09.541559 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:22:09.661487 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:22:09.778275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:10.246868 run create_hlr_db(pid=23441): Launched 22:22:10.364002 bus /sierra_2: Setting Powered False 22:22:11.425470 run create_hlr_db(pid=23441): Terminated: ok {rc=0} 22:22:11.867786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23443): Launched 22:22:12.191264 run osmo-hlr_10.42.42.2(pid=23444): Launched 22:22:12.315691 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:12.872910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23446): Launched 22:22:13.196451 run osmo-stp_10.42.42.5(pid=23447): Launched 22:22:13.319491 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:13.903175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23449): Launched 22:22:14.227393 run osmo-msc_10.42.42.6(pid=23450): Launched 22:22:14.408572 run osmo-stp_10.42.42.5(pid=23447): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23447)] 22:22:14.544698 run osmo-stp_10.42.42.5(pid=23447): stdout: | (launched: 2022-12-09_22:22:13.137234) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:14.681285 run osmo-stp_10.42.42.5(pid=23447): stderr: | 20221209222213328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222213328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222213329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222213329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222213332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222213332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222213332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:14.817398 run osmo-stp_10.42.42.5(pid=23447): stdout: | (launched: 2022-12-09_22:22:13.137234) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:14.945437 run osmo-stp_10.42.42.5(pid=23447): stderr: | 20221209222213328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222213328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222213329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222213329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222213332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222213332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222213332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:15.099653 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23447): Process ended prematurely: osmo-stp_10.42.42.5(pid=23447) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23447)] [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:22:15.109207 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:22:15.137055 run osmo-hlr_10.42.42.2(pid=23444): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23444)] 22:22:15.187436 run osmo-hlr_10.42.42.2(pid=23444): stdout: | (launched: 2022-12-09_22:22:12.132669) 22:22:15.239921 run osmo-hlr_10.42.42.2(pid=23444): stderr: | 20221209222212332 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222212332 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222212332 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222212332 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222212332 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222212332 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222212344 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222212352 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222212352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222212352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:15.312819 run osmo-msc_10.42.42.6(pid=23450): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23450)] 22:22:15.363029 run osmo-msc_10.42.42.6(pid=23450): stdout: | (launched: 2022-12-09_22:22:14.168378) 22:22:15.415595 run osmo-msc_10.42.42.6(pid=23450): stderr: | 20221209222214492 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222214492 DLGLOBAL DEBUG validating counter group 0x7f2ce035ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222214492 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222214492 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222214492 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222214493 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222214494 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222214495 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222214495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222214495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:15.467947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23443): Terminating (SIGTERM) 22:22:15.509844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23446): Terminating (SIGTERM) 22:22:15.551695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23449): Terminating (SIGTERM) 22:22:15.594272 --- ParallelTerminationStrategy: PID 23443 died... 22:22:15.614522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23443): Terminated: ok {rc=0} 22:22:15.661150 --- ParallelTerminationStrategy: PID 23446 died... 22:22:15.680851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23446): Terminated: ok {rc=0} 22:22:15.727146 --- ParallelTerminationStrategy: PID 23449 died... 22:22:15.746845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23449): Terminated: ok {rc=0} 22:22:15.835454 bus /sierra_3: Setting Powered False 22:22:16.952753 bus /sierra_3: Setting Powered False 22:22:18.081113 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:22:19.336750 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:22:19.343853 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:22:19.376784 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:22:19.404449 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:22:19.458771 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:22:19.491627 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:22:19.518632 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:22:20.070874 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:22:20.122424 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:20.133921 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:22:20.204845 tst mo_mt_call.py: using LAC 24060 22:22:20.337551 tst mo_mt_call.py: using RAC 90 22:22:20.465201 tst mo_mt_call.py: using CellId 24060 22:22:20.593656 tst mo_mt_call.py: using BVCI 24061 22:22:20.712069 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:20.723578 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:20.734970 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:20.746355 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:20.757763 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:20.769068 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:22:20.886080 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:22:21.005999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:21.506066 run create_hlr_db(pid=23455): Launched 22:22:21.636932 bus /sierra_2: Setting Powered False 22:22:22.701558 run create_hlr_db(pid=23455): Terminated: ok {rc=0} 22:22:23.134828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23457): Launched 22:22:23.437903 run osmo-hlr_10.42.42.2(pid=23458): Launched 22:22:23.554867 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:24.085669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23460): Launched 22:22:24.387392 run osmo-stp_10.42.42.5(pid=23461): Launched 22:22:24.502688 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:25.049452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23463): Launched 22:22:25.355636 run osmo-msc_10.42.42.6(pid=23464): Launched 22:22:25.526617 run osmo-stp_10.42.42.5(pid=23461): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23461)] 22:22:25.655954 run osmo-stp_10.42.42.5(pid=23461): stdout: | (launched: 2022-12-09_22:22:24.332606) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:25.785146 run osmo-stp_10.42.42.5(pid=23461): stderr: | 20221209222224503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222224503 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222224503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222224504 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222224504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222224504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222224504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:25.911645 run osmo-stp_10.42.42.5(pid=23461): stdout: | (launched: 2022-12-09_22:22:24.332606) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:26.031610 run osmo-stp_10.42.42.5(pid=23461): stderr: | 20221209222224503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222224503 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222224503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222224504 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222224504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222224504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222224504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:26.175771 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23461): Process ended prematurely: osmo-stp_10.42.42.5(pid=23461) [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23461)] [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:22:26.184580 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:22:26.211298 run osmo-hlr_10.42.42.2(pid=23458): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23458)] 22:22:26.258933 run osmo-hlr_10.42.42.2(pid=23458): stdout: | (launched: 2022-12-09_22:22:23.382636) 22:22:26.308005 run osmo-hlr_10.42.42.2(pid=23458): stderr: | 20221209222223557 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222223557 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222223557 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222223557 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222223557 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222223557 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222223568 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222223577 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222223577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222223577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:26.377125 run osmo-msc_10.42.42.6(pid=23464): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23464)] 22:22:26.424701 run osmo-msc_10.42.42.6(pid=23464): stdout: | (launched: 2022-12-09_22:22:25.299632) 22:22:26.473832 run osmo-msc_10.42.42.6(pid=23464): stderr: | 20221209222225573 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222225573 DLGLOBAL DEBUG validating counter group 0x7fd725c77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222225573 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222225573 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222225573 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222225574 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222225577 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222225578 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222225578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222225578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:26.523497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23457): Terminating (SIGTERM) 22:22:26.562974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23460): Terminating (SIGTERM) 22:22:26.602604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23463): Terminating (SIGTERM) 22:22:26.642121 --- ParallelTerminationStrategy: PID 23457 died... 22:22:26.661130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23457): Terminated: ok {rc=0} 22:22:26.705315 --- ParallelTerminationStrategy: PID 23460 died... 22:22:26.723624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23460): Terminated: ok {rc=0} 22:22:26.767715 --- ParallelTerminationStrategy: PID 23463 died... 22:22:26.786314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23463): Terminated: ok {rc=0} 22:22:26.872255 bus /sierra_3: Setting Powered False 22:22:27.971272 bus /sierra_3: Setting Powered False 22:22:29.086822 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:22:30.238291 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:30.250609 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:22:30.322433 tst mo_mt_call_osmux.py: using LAC 24061 22:22:30.452441 tst mo_mt_call_osmux.py: using RAC 91 22:22:30.571643 tst mo_mt_call_osmux.py: using CellId 24061 22:22:30.690001 tst mo_mt_call_osmux.py: using BVCI 24062 22:22:30.798869 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:30.810202 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:30.821251 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:30.833602 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:30.845540 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:30.858781 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:22:30.986455 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:22:31.113816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:31.631589 run create_hlr_db(pid=23466): Launched 22:22:31.784618 bus /sierra_2: Setting Powered False 22:22:32.845090 run create_hlr_db(pid=23466): Terminated: ok {rc=0} 22:22:33.305333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23468): Launched 22:22:33.629262 run osmo-hlr_10.42.42.2(pid=23469): Launched 22:22:33.752517 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:34.311931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23471): Launched 22:22:34.636245 run osmo-stp_10.42.42.5(pid=23472): Launched 22:22:34.759408 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:35.342570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23474): Launched 22:22:35.666509 run osmo-msc_10.42.42.6(pid=23475): Launched 22:22:35.846837 run osmo-stp_10.42.42.5(pid=23472): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23472)] 22:22:35.985991 run osmo-stp_10.42.42.5(pid=23472): stdout: | (launched: 2022-12-09_22:22:34.577814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:36.122723 run osmo-stp_10.42.42.5(pid=23472): stderr: | 20221209222234771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222234771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222234771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222234772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222234772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222234772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222234772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:36.259323 run osmo-stp_10.42.42.5(pid=23472): stdout: | (launched: 2022-12-09_22:22:34.577814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:36.388167 run osmo-stp_10.42.42.5(pid=23472): stderr: | 20221209222234771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222234771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222234771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222234772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222234772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222234772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222234772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:36.543905 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23472): Process ended prematurely: osmo-stp_10.42.42.5(pid=23472) [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23472)] [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:22:36.553730 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:22:36.581868 run osmo-hlr_10.42.42.2(pid=23469): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23469)] 22:22:36.632723 run osmo-hlr_10.42.42.2(pid=23469): stdout: | (launched: 2022-12-09_22:22:33.571084) 22:22:36.684726 run osmo-hlr_10.42.42.2(pid=23469): stderr: | 20221209222233770 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222233770 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222233771 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222233771 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222233771 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222233771 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222233783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222233793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222233793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222233793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:36.757127 run osmo-msc_10.42.42.6(pid=23475): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23475)] 22:22:36.806980 run osmo-msc_10.42.42.6(pid=23475): stdout: | (launched: 2022-12-09_22:22:35.608005) 22:22:36.858689 run osmo-msc_10.42.42.6(pid=23475): stderr: | 20221209222235937 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222235937 DLGLOBAL DEBUG validating counter group 0x7f4812d01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222235937 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222235937 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222235938 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222235938 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222235939 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222235940 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222235940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222235940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:36.910448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23468): Terminating (SIGTERM) 22:22:36.952482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23471): Terminating (SIGTERM) 22:22:36.994282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23474): Terminating (SIGTERM) 22:22:37.036519 --- ParallelTerminationStrategy: PID 23468 died... 22:22:37.056792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23468): Terminated: ok {rc=0} 22:22:37.103464 --- ParallelTerminationStrategy: PID 23471 died... 22:22:37.123047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23471): Terminated: ok {rc=0} 22:22:37.169410 --- ParallelTerminationStrategy: PID 23474 died... 22:22:37.189070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23474): Terminated: ok {rc=0} 22:22:37.276686 bus /sierra_3: Setting Powered False 22:22:38.376371 bus /sierra_3: Setting Powered False 22:22:39.494810 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:22:40.741767 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:22:40.747431 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:22:40.780541 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:22:40.807030 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:22:40.859498 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:22:40.891907 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:22:40.918363 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:22:41.465501 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:22:41.514155 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:41.525068 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:22:41.593880 tst mo_mt_call.py: using LAC 24062 22:22:41.711173 tst mo_mt_call.py: using RAC 92 22:22:41.830231 tst mo_mt_call.py: using CellId 24062 22:22:41.950414 tst mo_mt_call.py: using BVCI 24063 22:22:42.059314 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:42.070132 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:42.080715 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:42.091804 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:42.102681 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:42.113556 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:22:42.233382 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:22:42.349930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:42.819968 run create_hlr_db(pid=23480): Launched 22:22:42.936154 bus /sierra_2: Setting Powered False 22:22:43.997302 run create_hlr_db(pid=23480): Terminated: ok {rc=0} 22:22:44.440883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23482): Launched 22:22:44.765463 run osmo-hlr_10.42.42.2(pid=23483): Launched 22:22:44.890813 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:45.450519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23485): Launched 22:22:45.773702 run osmo-stp_10.42.42.5(pid=23486): Launched 22:22:45.961140 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:46.637425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23488): Launched 22:22:46.974975 run osmo-msc_10.42.42.6(pid=23489): Launched 22:22:47.242922 run osmo-stp_10.42.42.5(pid=23486): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23486)] 22:22:47.420819 run osmo-stp_10.42.42.5(pid=23486): stdout: | (launched: 2022-12-09_22:22:45.715423) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:47.571123 run osmo-stp_10.42.42.5(pid=23486): stderr: | 20221209222245993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222245994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222245994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222245994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222245995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222245995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222245995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:47.708706 run osmo-stp_10.42.42.5(pid=23486): stdout: | (launched: 2022-12-09_22:22:45.715423) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:47.838534 run osmo-stp_10.42.42.5(pid=23486): stderr: | 20221209222245993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222245994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222245994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222245994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222245995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222245995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222245995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:47.993558 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23486): Process ended prematurely: osmo-stp_10.42.42.5(pid=23486) [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23486)] [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:22:48.003141 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 22:22:48.031799 run osmo-hlr_10.42.42.2(pid=23483): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23483)] 22:22:48.082965 run osmo-hlr_10.42.42.2(pid=23483): stdout: | (launched: 2022-12-09_22:22:44.707132) 22:22:48.136156 run osmo-hlr_10.42.42.2(pid=23483): stderr: | 20221209222244905 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222244905 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222244905 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222244905 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222244905 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222244905 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222244918 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222244926 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222244926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222244926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:48.209870 run osmo-msc_10.42.42.6(pid=23489): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23489)] 22:22:48.260840 run osmo-msc_10.42.42.6(pid=23489): stdout: | (launched: 2022-12-09_22:22:46.914422) 22:22:48.313685 run osmo-msc_10.42.42.6(pid=23489): stderr: | 20221209222247480 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222247480 DLGLOBAL DEBUG validating counter group 0x7f1554affc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222247480 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222247480 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222247480 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222247480 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222247482 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222247489 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222247489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222247489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:48.367063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23482): Terminating (SIGTERM) 22:22:48.409772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23485): Terminating (SIGTERM) 22:22:48.452241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23488): Terminating (SIGTERM) 22:22:48.495258 --- ParallelTerminationStrategy: PID 23482 died... 22:22:48.515585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23482): Terminated: ok {rc=0} 22:22:48.563072 --- ParallelTerminationStrategy: PID 23485 died... 22:22:48.583097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23485): Terminated: ok {rc=0} 22:22:48.630265 --- ParallelTerminationStrategy: PID 23488 died... 22:22:48.650329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23488): Terminated: ok {rc=0} 22:22:48.739173 bus /sierra_3: Setting Powered False 22:22:49.838798 bus /sierra_3: Setting Powered False 22:22:50.954603 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:22:52.098251 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:52.109909 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:22:52.179066 tst mo_mt_call_osmux.py: using LAC 24063 22:22:52.298937 tst mo_mt_call_osmux.py: using RAC 93 22:22:52.416660 tst mo_mt_call_osmux.py: using CellId 24063 22:22:52.535292 tst mo_mt_call_osmux.py: using BVCI 24064 22:22:52.646772 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:52.657743 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:52.668455 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:52.679443 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:52.690563 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:52.701524 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:22:52.816139 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:22:52.935299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:53.437894 run create_hlr_db(pid=23491): Launched 22:22:53.573073 bus /sierra_2: Setting Powered False 22:22:54.637058 run create_hlr_db(pid=23491): Terminated: ok {rc=0} 22:22:55.071085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23493): Launched 22:22:55.374670 run osmo-hlr_10.42.42.2(pid=23494): Launched 22:22:55.490926 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:56.015845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23496): Launched 22:22:56.320258 run osmo-stp_10.42.42.5(pid=23497): Launched 22:22:56.437242 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:56.989938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23499): Launched 22:22:57.293563 run osmo-msc_10.42.42.6(pid=23500): Launched 22:22:57.465714 run osmo-stp_10.42.42.5(pid=23497): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23497)] 22:22:57.596774 run osmo-stp_10.42.42.5(pid=23497): stdout: | (launched: 2022-12-09_22:22:56.264721) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:57.726352 run osmo-stp_10.42.42.5(pid=23497): stderr: | 20221209222256437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222256437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222256438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222256438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222256438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222256438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222256439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:57.853518 run osmo-stp_10.42.42.5(pid=23497): stdout: | (launched: 2022-12-09_22:22:56.264721) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:57.974756 run osmo-stp_10.42.42.5(pid=23497): stderr: | 20221209222256437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222256437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222256438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222256438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222256438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222256438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222256439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:58.120075 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23497): Process ended prematurely: osmo-stp_10.42.42.5(pid=23497) [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23497)] [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:22:58.129114 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:22:58.156600 run osmo-hlr_10.42.42.2(pid=23494): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23494)] 22:22:58.204805 run osmo-hlr_10.42.42.2(pid=23494): stdout: | (launched: 2022-12-09_22:22:55.320042) 22:22:58.255146 run osmo-hlr_10.42.42.2(pid=23494): stderr: | 20221209222255499 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222255499 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222255500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222255500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222255500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222255500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222255511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222255520 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222255521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222255521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:58.324660 run osmo-msc_10.42.42.6(pid=23500): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23500)] 22:22:58.372760 run osmo-msc_10.42.42.6(pid=23500): stdout: | (launched: 2022-12-09_22:22:57.238298) 22:22:58.422698 run osmo-msc_10.42.42.6(pid=23500): stderr: | 20221209222257512 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222257512 DLGLOBAL DEBUG validating counter group 0x7f172ab0cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222257512 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222257512 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222257512 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222257512 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222257514 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222257515 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222257515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222257515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:58.473167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23493): Terminating (SIGTERM) 22:22:58.513627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23496): Terminating (SIGTERM) 22:22:58.553753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23499): Terminating (SIGTERM) 22:22:58.593853 --- ParallelTerminationStrategy: PID 23493 died... 22:22:58.613406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23493): Terminated: ok {rc=0} 22:22:58.658104 --- ParallelTerminationStrategy: PID 23496 died... 22:22:58.676727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23496): Terminated: ok {rc=0} 22:22:58.721517 --- ParallelTerminationStrategy: PID 23499 died... 22:22:58.740268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23499): Terminated: ok {rc=0} 22:22:58.825706 bus /sierra_3: Setting Powered False 22:22:59.923920 bus /sierra_3: Setting Powered False 22:23:01.048626 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:23:02.377046 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:23:02.388425 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:23:02.433007 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 22:23:02.461619 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 22:23:02.515430 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:23:02.550600 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 22:23:02.579652 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 22:23:03.126002 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 22:23:03.178768 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:03.190912 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:23:03.245576 tst mo_mt_call.py: using LAC 24064 22:23:03.367055 tst mo_mt_call.py: using RAC 94 22:23:03.494018 tst mo_mt_call.py: using CellId 24064 22:23:03.622403 tst mo_mt_call.py: using BVCI 24065 22:23:03.736288 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:03.748403 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:03.760451 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:03.774445 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:03.787515 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:03.799538 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:23:03.922231 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:23:04.042962 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:04.532609 run create_hlr_db(pid=23516): Launched 22:23:04.694513 bus /sierra_2: Setting Powered False 22:23:05.754560 run create_hlr_db(pid=23516): Terminated: ok {rc=0} 22:23:06.197813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23520): Launched 22:23:06.529725 run osmo-hlr_10.42.42.2(pid=23521): Launched 22:23:06.772393 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:07.440316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23523): Launched 22:23:07.782318 run osmo-stp_10.42.42.5(pid=23524): Launched 22:23:08.026973 run osmo-msc_10.42.42.6: Starting osmo-msc 22:23:08.713723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23526): Launched 22:23:09.058148 run osmo-msc_10.42.42.6(pid=23527): Launched 22:23:09.421397 run osmo-stp_10.42.42.5(pid=23524): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23524)] 22:23:09.726602 run osmo-stp_10.42.42.5(pid=23524): stdout: | (launched: 2022-12-09_22:23:07.718711) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:09.919903 run osmo-stp_10.42.42.5(pid=23524): stderr: | 20221209222308017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222308017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222308017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222308017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222308018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222308018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222308018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:10.071451 run osmo-stp_10.42.42.5(pid=23524): stdout: | (launched: 2022-12-09_22:23:07.718711) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:10.207655 run osmo-stp_10.42.42.5(pid=23524): stderr: | 20221209222308017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222308017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222308017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222308017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222308018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222308018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222308018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:10.374620 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23524): Process ended prematurely: osmo-stp_10.42.42.5(pid=23524) [trial-2365↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23524)] [trial-2365↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 22:23:10.384793 tst mo_mt_call.py:8: Test FAILED (7.2 sec) 22:23:10.413830 run osmo-hlr_10.42.42.2(pid=23521): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23521)] 22:23:10.465767 run osmo-hlr_10.42.42.2(pid=23521): stdout: | (launched: 2022-12-09_22:23:06.462326) 22:23:10.523665 run osmo-hlr_10.42.42.2(pid=23521): stderr: | 20221209222306773 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222306773 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222306773 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222306773 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222306773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222306773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222306784 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222306792 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222306801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222306801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:10.604428 run osmo-msc_10.42.42.6(pid=23527): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23527)] 22:23:10.665043 run osmo-msc_10.42.42.6(pid=23527): stdout: | (launched: 2022-12-09_22:23:08.993477) 22:23:10.727058 run osmo-msc_10.42.42.6(pid=23527): stderr: | 20221209222309499 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222309499 DLGLOBAL DEBUG validating counter group 0x7fe471b1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222309500 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222309500 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222309500 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222309500 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222309506 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222309507 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222309507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222309507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:23:10.785797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23520): Terminating (SIGTERM) 22:23:10.837974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23523): Terminating (SIGTERM) 22:23:10.892993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23526): Terminating (SIGTERM) 22:23:10.948853 --- ParallelTerminationStrategy: PID 23520 died... 22:23:10.978498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23520): Terminated: ok {rc=0} 22:23:11.039411 --- ParallelTerminationStrategy: PID 23523 died... 22:23:11.062581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23523): Terminated: ok {rc=0} 22:23:11.124714 --- ParallelTerminationStrategy: PID 23526 died... 22:23:11.149880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23526): Terminated: ok {rc=0} 22:23:11.260366 bus /sierra_3: Setting Powered False 22:23:12.368338 bus /sierra_3: Setting Powered False 22:23:13.490299 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 22:23:14.648507 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:14.661990 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:23:14.716661 tst mo_mt_call_osmux.py: using LAC 24065 22:23:14.846830 tst mo_mt_call_osmux.py: using RAC 95 22:23:14.976532 tst mo_mt_call_osmux.py: using CellId 24065 22:23:15.107694 tst mo_mt_call_osmux.py: using BVCI 24066 22:23:15.229090 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:15.241179 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:15.253361 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:15.265384 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:15.277678 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:15.289687 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:23:15.412597 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:23:15.539308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:16.091702 run create_hlr_db(pid=23788): Launched 22:23:16.263134 bus /sierra_2: Setting Powered False 22:23:17.362941 run create_hlr_db(pid=23788): Terminated: ok {rc=0} 22:23:17.912357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23790): Launched 22:23:18.261584 run osmo-hlr_10.42.42.2(pid=23791): Launched 22:23:18.570381 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:19.157407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23793): Launched 22:23:19.498098 run osmo-stp_10.42.42.5(pid=23794): Launched 22:23:19.750186 run osmo-msc_10.42.42.6: Starting osmo-msc 22:23:20.442932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23796): Launched 22:23:20.795084 run osmo-msc_10.42.42.6(pid=23797): Launched 22:23:21.164366 run osmo-stp_10.42.42.5(pid=23794): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23794)] 22:23:21.454780 run osmo-stp_10.42.42.5(pid=23794): stdout: | (launched: 2022-12-09_22:23:19.433485) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:21.625990 run osmo-stp_10.42.42.5(pid=23794): stderr: | 20221209222319736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222319736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222319737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222319737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222319737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222319737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222319738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:21.764508 run osmo-stp_10.42.42.5(pid=23794): stdout: | (launched: 2022-12-09_22:23:19.433485) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:21.898763 run osmo-stp_10.42.42.5(pid=23794): stderr: | 20221209222319736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222319736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222319737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222319737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222319737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222319737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222319738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:22.059825 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23794): Process ended prematurely: osmo-stp_10.42.42.5(pid=23794) [trial-2365↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23794)] [trial-2365↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 22:23:22.070346 tst mo_mt_call_osmux.py:8: Test FAILED (7.5 sec) 22:23:22.101672 run osmo-hlr_10.42.42.2(pid=23791): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23791)] 22:23:22.154919 run osmo-hlr_10.42.42.2(pid=23791): stdout: | (launched: 2022-12-09_22:23:18.195089) 22:23:22.210722 run osmo-hlr_10.42.42.2(pid=23791): stderr: | 20221209222318383 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222318383 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222318383 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222318383 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222318383 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222318384 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222318399 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222318412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222318412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222318412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:22.286987 run osmo-msc_10.42.42.6(pid=23797): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23797)] 22:23:22.340493 run osmo-msc_10.42.42.6(pid=23797): stdout: | (launched: 2022-12-09_22:23:20.730413) 22:23:22.395450 run osmo-msc_10.42.42.6(pid=23797): stderr: | 20221209222321238 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222321239 DLGLOBAL DEBUG validating counter group 0x7fc7c5743c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222321239 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222321239 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222321239 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222321239 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222321249 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222321250 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222321250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222321250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:23:22.452573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23790): Terminating (SIGTERM) 22:23:22.497904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23793): Terminating (SIGTERM) 22:23:22.545639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23796): Terminating (SIGTERM) 22:23:22.594333 --- ParallelTerminationStrategy: PID 23790 died... 22:23:22.616251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23790): Terminated: ok {rc=0} 22:23:22.667979 --- ParallelTerminationStrategy: PID 23793 died... 22:23:22.689035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23793): Terminated: ok {rc=0} 22:23:22.738929 --- ParallelTerminationStrategy: PID 23796 died... 22:23:22.759759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23796): Terminated: ok {rc=0} 22:23:22.855234 bus /sierra_3: Setting Powered False 22:23:23.957576 bus /sierra_3: Setting Powered False 22:23:25.071411 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 emergency:trx-umtrx --------------------------------------------------------------------- 22:23:26.326530 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:23:26.332044 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:23:26.366304 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:23:26.393601 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 22:23:26.479609 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:23:26.512793 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:23:26.540107 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 22:23:27.126846 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2365 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 22:23:27.131987 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:27.143050 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 22:23:27.192917 tst emergency_mo_mt_call.py: using LAC 24066 22:23:27.321283 tst emergency_mo_mt_call.py: using RAC 96 22:23:27.445868 tst emergency_mo_mt_call.py: using CellId 24066 22:23:27.562649 tst emergency_mo_mt_call.py: using BVCI 24067 22:23:27.670792 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:27.681667 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:27.692302 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:27.703494 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:27.714697 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:27.725654 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:27.840158 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:27.957460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:28.418067 run create_hlr_db(pid=23803): Launched 22:23:28.531919 bus /sierra_2: Setting Powered False 22:23:29.592286 run create_hlr_db(pid=23803): Terminated: ok {rc=0} 22:23:30.009085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23805): Launched 22:23:30.306758 run osmo-hlr_10.42.42.2(pid=23806): Launched 22:23:30.420618 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:30.975899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23808): Launched 22:23:31.370364 run osmo-stp_10.42.42.5(pid=23809): Launched 22:23:31.712269 tst emergency_mo_mt_call.py: using MSISDN 7405 22:23:31.907766 run osmo-msc_10.42.42.6: Starting osmo-msc 22:23:32.493230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23811): Launched 22:23:32.812122 run osmo-msc_10.42.42.6(pid=23812): Launched 22:23:32.990569 run osmo-stp_10.42.42.5(pid=23809): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23809)] 22:23:33.124192 run osmo-stp_10.42.42.5(pid=23809): stdout: | (launched: 2022-12-09_22:23:31.310566) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:33.259002 run osmo-stp_10.42.42.5(pid=23809): stderr: | 20221209222331551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222331551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222331551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222331551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222331552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222331552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222331552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:33.393194 run osmo-stp_10.42.42.5(pid=23809): stdout: | (launched: 2022-12-09_22:23:31.310566) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:33.520594 run osmo-stp_10.42.42.5(pid=23809): stderr: | 20221209222331551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222331551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222331551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222331551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222331552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222331552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222331552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:33.672777 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=23809): Process ended prematurely: osmo-stp_10.42.42.5(pid=23809) [trial-2365↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23809)] [trial-2365↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 22:23:33.681737 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 22:23:33.709117 run osmo-hlr_10.42.42.2(pid=23806): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23806)] 22:23:33.759317 run osmo-hlr_10.42.42.2(pid=23806): stdout: | (launched: 2022-12-09_22:23:30.252781) 22:23:33.811373 run osmo-hlr_10.42.42.2(pid=23806): stderr: | 20221209222330427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222330427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222330427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222330427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222330427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222330428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222330440 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222330448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222330448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222330448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:33.883857 run osmo-msc_10.42.42.6(pid=23812): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23812)] 22:23:33.933983 run osmo-msc_10.42.42.6(pid=23812): stdout: | (launched: 2022-12-09_22:23:32.754344) 22:23:33.985916 run osmo-msc_10.42.42.6(pid=23812): stderr: | 20221209222333078 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222333078 DLGLOBAL DEBUG validating counter group 0x7f5d6a9cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222333078 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222333078 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222333078 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222333079 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222333080 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222333081 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222333081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222333081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:23:34.038176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23805): Terminating (SIGTERM) 22:23:34.079860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23808): Terminating (SIGTERM) 22:23:34.121881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23811): Terminating (SIGTERM) 22:23:34.164167 --- ParallelTerminationStrategy: PID 23805 died... 22:23:34.184243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23805): Terminated: ok {rc=0} 22:23:34.230659 --- ParallelTerminationStrategy: PID 23808 died... 22:23:34.250685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23808): Terminated: ok {rc=0} 22:23:34.297081 --- ParallelTerminationStrategy: PID 23811 died... 22:23:34.316650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23811): Terminated: ok {rc=0} 22:23:34.404746 bus /sierra_3: Setting Powered False 22:23:35.504815 bus /sierra_3: Setting Powered False 22:23:36.623292 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 22:23:37.711611 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:37.723385 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 22:23:37.786573 tst emergency_preemptive_call.py: using LAC 24067 22:23:37.908070 tst emergency_preemptive_call.py: using RAC 97 22:23:38.025051 tst emergency_preemptive_call.py: using CellId 24067 22:23:38.141378 tst emergency_preemptive_call.py: using BVCI 24068 22:23:38.248675 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:38.259334 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:38.269861 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:38.280458 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:38.291186 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:38.301759 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:38.419270 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:38.533937 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:38.650811 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:38.764566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:39.259891 run create_hlr_db(pid=23814): Launched 22:23:39.390952 bus /sierra_2: Setting Powered False 22:23:40.455070 run create_hlr_db(pid=23814): Terminated: ok {rc=0} 22:23:40.902027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23816): Launched 22:23:41.222216 run osmo-hlr_10.42.42.2(pid=23817): Launched 22:23:41.343286 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:41.890777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23819): Launched 22:23:42.210351 run osmo-stp_10.42.42.5(pid=23820): Launched 22:23:42.341998 tst emergency_preemptive_call.py: using MSISDN 7406 22:23:42.507454 run osmo-msc_10.42.42.6: Starting osmo-msc 22:23:43.079728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23822): Launched 22:23:43.398524 run osmo-msc_10.42.42.6(pid=23823): Launched 22:23:43.576805 run osmo-stp_10.42.42.5(pid=23820): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23820)] 22:23:43.710966 run osmo-stp_10.42.42.5(pid=23820): stdout: | (launched: 2022-12-09_22:23:42.152445) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:43.845985 run osmo-stp_10.42.42.5(pid=23820): stderr: | 20221209222342344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222342345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222342345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222342345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222342346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222342346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222342346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:43.980660 run osmo-stp_10.42.42.5(pid=23820): stdout: | (launched: 2022-12-09_22:23:42.152445) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:44.108049 run osmo-stp_10.42.42.5(pid=23820): stderr: | 20221209222342344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222342345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222342345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222342345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222342346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222342346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222342346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:44.260119 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=23820): Process ended prematurely: osmo-stp_10.42.42.5(pid=23820) [trial-2365↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23820)] [trial-2365↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 22:23:44.269405 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 22:23:44.297338 run osmo-hlr_10.42.42.2(pid=23817): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23817)] 22:23:44.348278 run osmo-hlr_10.42.42.2(pid=23817): stdout: | (launched: 2022-12-09_22:23:41.164460) 22:23:44.400612 run osmo-hlr_10.42.42.2(pid=23817): stderr: | 20221209222341360 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222341360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222341360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222341360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222341360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222341360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222341373 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222341381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222341381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222341381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:44.474445 run osmo-msc_10.42.42.6(pid=23823): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23823)] 22:23:44.524862 run osmo-msc_10.42.42.6(pid=23823): stdout: | (launched: 2022-12-09_22:23:43.340663) 22:23:44.577201 run osmo-msc_10.42.42.6(pid=23823): stderr: | 20221209222343666 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222343666 DLGLOBAL DEBUG validating counter group 0x7f721c2d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222343666 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222343666 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222343666 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222343667 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222343668 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222343669 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222343669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222343669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:23:44.629737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23816): Terminating (SIGTERM) 22:23:44.671480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23819): Terminating (SIGTERM) 22:23:44.713689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23822): Terminating (SIGTERM) 22:23:44.756030 --- ParallelTerminationStrategy: PID 23816 died... 22:23:44.776336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23816): Terminated: ok {rc=0} 22:23:44.823344 --- ParallelTerminationStrategy: PID 23819 died... 22:23:44.843108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23819): Terminated: ok {rc=0} 22:23:44.889922 --- ParallelTerminationStrategy: PID 23822 died... 22:23:44.909691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23822): Terminated: ok {rc=0} 22:23:44.998199 bus /sierra_9: Setting Powered False 22:23:46.096707 bus /sierra_9: Setting Powered False 22:23:47.217385 bus /sierra_8: Setting Powered False 22:23:48.316334 bus /sierra_8: Setting Powered False 22:23:49.435382 bus /sierra_3: Setting Powered False 22:23:50.535333 bus /sierra_3: Setting Powered False 22:23:51.653163 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-umtrx --------------------------------------------------------------------- 22:23:52.933040 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:23:52.937790 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:23:52.971091 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 22:23:53.010791 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 22:23:53.103828 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:23:53.136879 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 22:23:53.176056 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 22:23:53.764657 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 22:23:53.817710 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:53.828647 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:23:53.880170 tst cs_paging_gprs_active.py: using LAC 24068 22:23:54.006722 tst cs_paging_gprs_active.py: using RAC 98 22:23:54.134472 tst cs_paging_gprs_active.py: using CellId 24068 22:23:54.260831 tst cs_paging_gprs_active.py: using BVCI 24069 22:23:54.380769 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:54.391867 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:54.402678 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:54.413601 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:54.424710 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:54.435980 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:54.447144 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:54.458098 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:54.469188 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:54.585422 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:54.705904 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:23:54.926845 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:23:55.253412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23828): Launched 22:23:55.539790 run iperf3-srv_10.42.42.10(pid=23829): Launched 22:23:55.662059 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:23:55.881707 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:23:56.207700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23830): Launched 22:23:56.491958 run iperf3-srv_10.42.42.10(pid=23831): Launched 22:23:56.614440 tst cs_paging_gprs_active.py:38: start network... 22:23:56.834267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:57.339077 run create_hlr_db(pid=23832): Launched 22:23:57.472017 bus /sierra_2: Setting Powered False 22:23:58.535888 run create_hlr_db(pid=23832): Terminated: ok {rc=0} 22:23:58.972478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23834): Launched 22:23:59.277961 run osmo-hlr_10.42.42.2(pid=23835): Launched 22:23:59.395186 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:59.956554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23837): Launched 22:24:00.282995 run osmo-stp_10.42.42.5(pid=23838): Launched 22:24:00.407787 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:24:00.988022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23840): Launched 22:24:01.124255 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:24:01.393755 run patchelf(pid=23841): Launched 22:24:01.580218 run osmo-stp_10.42.42.5(pid=23838): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23838)] 22:24:01.715629 run osmo-stp_10.42.42.5(pid=23838): stdout: | (launched: 2022-12-09_22:24:00.224004) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:01.851916 run osmo-stp_10.42.42.5(pid=23838): stderr: | 20221209222400416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222400416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222400416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222400417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222400417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222400417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222400417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:01.987036 run osmo-stp_10.42.42.5(pid=23838): stdout: | (launched: 2022-12-09_22:24:00.224004) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:02.116879 run osmo-stp_10.42.42.5(pid=23838): stderr: | 20221209222400416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222400416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222400416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222400417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222400417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222400417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222400417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:02.270349 run patchelf(pid=23841): Terminating (SIGINT) 22:24:02.444583 run patchelf(pid=23841): Terminated: ok {rc=0} 22:24:02.570092 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23838): Process ended prematurely: osmo-stp_10.42.42.5(pid=23838) [trial-2365↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23838)] [trial-2365↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 22:24:02.579810 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 22:24:02.608167 run osmo-hlr_10.42.42.2(pid=23835): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23835)] 22:24:02.656462 run osmo-hlr_10.42.42.2(pid=23835): stdout: | (launched: 2022-12-09_22:23:59.222466) 22:24:02.706723 run osmo-hlr_10.42.42.2(pid=23835): stderr: | 20221209222359399 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222359399 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222359399 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222359399 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222359399 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222359399 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222359411 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222359420 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222359420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222359420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:02.757167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23828): Terminating (SIGTERM) 22:24:02.797773 run iperf3-srv_10.42.42.10(pid=23829): Terminating (SIGTERM) 22:24:02.838407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23830): Terminating (SIGTERM) 22:24:02.878861 run iperf3-srv_10.42.42.10(pid=23831): Terminating (SIGTERM) 22:24:02.919337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23834): Terminating (SIGTERM) 22:24:02.959891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23837): Terminating (SIGTERM) 22:24:03.000277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23840): Terminating (SIGTERM) 22:24:03.041265 --- ParallelTerminationStrategy: PID 23828 died... 22:24:03.060696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23828): Terminated: ok {rc=0} 22:24:03.106858 --- ParallelTerminationStrategy: PID 23829 died... 22:24:03.125951 run iperf3-srv_10.42.42.10(pid=23829): Terminated {rc=256} 22:24:03.170942 --- ParallelTerminationStrategy: PID 23830 died... 22:24:03.189919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23830): Terminated: ok {rc=0} 22:24:03.235537 --- ParallelTerminationStrategy: PID 23831 died... 22:24:03.254517 run iperf3-srv_10.42.42.10(pid=23831): Terminated {rc=256} 22:24:03.299811 --- ParallelTerminationStrategy: PID 23834 died... 22:24:03.318868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23834): Terminated: ok {rc=0} 22:24:03.364150 --- ParallelTerminationStrategy: PID 23837 died... 22:24:03.383348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23837): Terminated: ok {rc=0} 22:24:03.428798 --- ParallelTerminationStrategy: PID 23840 died... 22:24:03.448125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23840): Terminated: ok {rc=0} 22:24:03.535762 bus /gobi_0: Setting Powered False 22:24:04.639852 bus /gobi_0: Setting Powered False 22:24:05.755430 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx iperf3.py ---------------------------------------------- 22:24:06.905162 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:06.916917 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:24:06.969352 tst iperf3.py: using LAC 24069 22:24:07.097765 tst iperf3.py: using RAC 99 22:24:07.226566 tst iperf3.py: using CellId 24069 22:24:07.354307 tst iperf3.py: using BVCI 24070 22:24:07.472935 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:07.484087 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:07.495285 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:07.506176 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:07.516819 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:07.527650 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:07.538608 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:07.549524 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:07.560393 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:07.677752 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:24:07.883703 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:08.188450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23842): Launched 22:24:08.453632 run iperf3-srv_10.42.42.10(pid=23843): Launched 22:24:08.569416 tst iperf3.py:8: start network... 22:24:08.775370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:09.248886 run create_hlr_db(pid=23844): Launched 22:24:09.366986 bus /gobi_6: Setting Powered False 22:24:10.428146 run create_hlr_db(pid=23844): Terminated: ok {rc=0} 22:24:10.872899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23846): Launched 22:24:11.200261 run osmo-hlr_10.42.42.2(pid=23847): Launched 22:24:11.325449 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:11.890355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23849): Launched 22:24:12.216252 run osmo-stp_10.42.42.5(pid=23850): Launched 22:24:12.339971 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:24:12.899848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23852): Launched 22:24:13.025373 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:24:13.301146 run patchelf(pid=23853): Launched 22:24:13.483582 run osmo-stp_10.42.42.5(pid=23850): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23850)] 22:24:13.622714 run osmo-stp_10.42.42.5(pid=23850): stdout: | (launched: 2022-12-09_22:24:12.156278) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:13.763196 run osmo-stp_10.42.42.5(pid=23850): stderr: | 20221209222412347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222412347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222412347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222412348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222412348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222412348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222412348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:13.903537 run osmo-stp_10.42.42.5(pid=23850): stdout: | (launched: 2022-12-09_22:24:12.156278) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:14.037102 run osmo-stp_10.42.42.5(pid=23850): stderr: | 20221209222412347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222412347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222412347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222412348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222412348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222412348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222412348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:14.194883 run patchelf(pid=23853): Terminating (SIGINT) 22:24:14.378963 run patchelf(pid=23853): Terminated: ok {rc=0} 22:24:14.512092 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23850): Process ended prematurely: osmo-stp_10.42.42.5(pid=23850) [trial-2365↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23850)] [trial-2365↪gprs:trx-umtrx↪iperf3.py:8] 22:24:14.522316 tst iperf3.py:8: Test FAILED (7.7 sec) 22:24:14.550838 run osmo-hlr_10.42.42.2(pid=23847): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23847)] 22:24:14.601151 run osmo-hlr_10.42.42.2(pid=23847): stdout: | (launched: 2022-12-09_22:24:11.140644) 22:24:14.653234 run osmo-hlr_10.42.42.2(pid=23847): stderr: | 20221209222411340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222411340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222411340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222411340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222411340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222411340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222411351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222411359 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222411360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222411360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:14.705428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23842): Terminating (SIGTERM) 22:24:14.747511 run iperf3-srv_10.42.42.10(pid=23843): Terminating (SIGTERM) 22:24:14.789647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23846): Terminating (SIGTERM) 22:24:14.831726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23849): Terminating (SIGTERM) 22:24:14.873947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23852): Terminating (SIGTERM) 22:24:14.916355 --- ParallelTerminationStrategy: PID 23842 died... 22:24:14.936636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23842): Terminated: ok {rc=0} 22:24:14.983640 --- ParallelTerminationStrategy: PID 23843 died... 22:24:15.003488 run iperf3-srv_10.42.42.10(pid=23843): Terminated {rc=256} 22:24:15.050013 --- ParallelTerminationStrategy: PID 23846 died... 22:24:15.069878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23846): Terminated: ok {rc=0} 22:24:15.116621 --- ParallelTerminationStrategy: PID 23849 died... 22:24:15.136573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23849): Terminated: ok {rc=0} 22:24:15.183414 --- ParallelTerminationStrategy: PID 23852 died... 22:24:15.203439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23852): Terminated: ok {rc=0} 22:24:15.291863 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 22:24:16.446590 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:16.458722 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:24:16.509324 tst iperf3m4.py: using LAC 24070 22:24:16.635630 tst iperf3m4.py: using RAC 100 22:24:16.802108 tst iperf3m4.py: using CellId 24070 22:24:16.925404 tst iperf3m4.py: using BVCI 24071 22:24:17.074430 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:17.086006 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:17.097718 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:17.110016 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:17.122789 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:17.134294 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:17.146082 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:17.157923 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:17.169672 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:17.292894 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:17.419003 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:17.538204 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:17.654517 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:24:17.860414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:18.165184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23854): Launched 22:24:18.431302 run iperf3-srv_10.42.42.10(pid=23855): Launched 22:24:18.546462 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:24:18.752288 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:19.058126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23856): Launched 22:24:19.323810 run iperf3-srv_10.42.42.10(pid=23857): Launched 22:24:19.438543 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:24:19.642993 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:19.948585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23858): Launched 22:24:20.214822 run iperf3-srv_10.42.42.10(pid=23859): Launched 22:24:20.329554 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:24:20.533922 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:20.839931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23860): Launched 22:24:21.105778 run iperf3-srv_10.42.42.10(pid=23861): Launched 22:24:21.220418 tst iperf3m4.py:8: start network... 22:24:21.425033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:21.895225 run create_hlr_db(pid=23862): Launched 22:24:22.011628 bus /gobi_6: Setting Powered False 22:24:23.072062 run create_hlr_db(pid=23862): Terminated: ok {rc=0} 22:24:23.496073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23864): Launched 22:24:23.800858 run osmo-hlr_10.42.42.2(pid=23865): Launched 22:24:23.917327 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:24.452641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23867): Launched 22:24:24.758582 run osmo-stp_10.42.42.5(pid=23868): Launched 22:24:24.875517 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:24:25.400839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23870): Launched 22:24:25.518385 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:24:25.775682 run patchelf(pid=23871): Launched 22:24:25.946212 run osmo-stp_10.42.42.5(pid=23868): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23868)] 22:24:26.076606 run osmo-stp_10.42.42.5(pid=23868): stdout: | (launched: 2022-12-09_22:24:24.702648) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:26.208259 run osmo-stp_10.42.42.5(pid=23868): stderr: | 20221209222424874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222424874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222424874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222424875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222424875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222424875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222424875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:26.339630 run osmo-stp_10.42.42.5(pid=23868): stdout: | (launched: 2022-12-09_22:24:24.702648) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:26.465131 run osmo-stp_10.42.42.5(pid=23868): stderr: | 20221209222424874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222424874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222424874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222424875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222424875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222424875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222424875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:26.613418 run patchelf(pid=23871): Terminating (SIGINT) 22:24:26.786578 run patchelf(pid=23871): Terminated: ok {rc=0} 22:24:26.911280 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23868): Process ended prematurely: osmo-stp_10.42.42.5(pid=23868) [trial-2365↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23868)] [trial-2365↪gprs:trx-umtrx↪iperf3m4.py:8] 22:24:26.920875 tst iperf3m4.py:8: Test FAILED (10.5 sec) 22:24:26.949772 run osmo-hlr_10.42.42.2(pid=23865): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23865)] 22:24:26.997896 run osmo-hlr_10.42.42.2(pid=23865): stdout: | (launched: 2022-12-09_22:24:23.745187) 22:24:27.047901 run osmo-hlr_10.42.42.2(pid=23865): stderr: | 20221209222423923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222423923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222423923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222423923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222423924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222423924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222423935 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222423944 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222423944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222423944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:27.098357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23854): Terminating (SIGTERM) 22:24:27.138634 run iperf3-srv_10.42.42.10(pid=23855): Terminating (SIGTERM) 22:24:27.178633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23856): Terminating (SIGTERM) 22:24:27.218797 run iperf3-srv_10.42.42.10(pid=23857): Terminating (SIGTERM) 22:24:27.259221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23858): Terminating (SIGTERM) 22:24:27.300099 run iperf3-srv_10.42.42.10(pid=23859): Terminating (SIGTERM) 22:24:27.340292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23860): Terminating (SIGTERM) 22:24:27.380740 run iperf3-srv_10.42.42.10(pid=23861): Terminating (SIGTERM) 22:24:27.420887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23864): Terminating (SIGTERM) 22:24:27.461488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23867): Terminating (SIGTERM) 22:24:27.501771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23870): Terminating (SIGTERM) 22:24:27.542442 --- ParallelTerminationStrategy: PID 23854 died... 22:24:27.561598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23854): Terminated: ok {rc=0} 22:24:27.606257 --- ParallelTerminationStrategy: PID 23855 died... 22:24:27.624838 run iperf3-srv_10.42.42.10(pid=23855): Terminated {rc=256} 22:24:27.669401 --- ParallelTerminationStrategy: PID 23856 died... 22:24:27.688045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23856): Terminated: ok {rc=0} 22:24:27.732689 --- ParallelTerminationStrategy: PID 23857 died... 22:24:27.751205 run iperf3-srv_10.42.42.10(pid=23857): Terminated {rc=256} 22:24:27.795456 --- ParallelTerminationStrategy: PID 23858 died... 22:24:27.814194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23858): Terminated: ok {rc=0} 22:24:27.859152 --- ParallelTerminationStrategy: PID 23859 died... 22:24:27.877923 run iperf3-srv_10.42.42.10(pid=23859): Terminated {rc=256} 22:24:27.922398 --- ParallelTerminationStrategy: PID 23860 died... 22:24:27.941218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23860): Terminated: ok {rc=0} 22:24:27.985841 --- ParallelTerminationStrategy: PID 23861 died... 22:24:28.004620 run iperf3-srv_10.42.42.10(pid=23861): Terminated {rc=256} 22:24:28.049477 --- ParallelTerminationStrategy: PID 23864 died... 22:24:28.068244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23864): Terminated: ok {rc=0} 22:24:28.113046 --- ParallelTerminationStrategy: PID 23867 died... 22:24:28.132064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23867): Terminated: ok {rc=0} 22:24:28.176701 --- ParallelTerminationStrategy: PID 23870 died... 22:24:28.195474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23870): Terminated: ok {rc=0} 22:24:28.283441 bus /gobi_4: Setting Powered False 22:24:29.383269 bus /gobi_4: Setting Powered False 22:24:30.500749 bus /gobi_1: Setting Powered False 22:24:31.613760 bus /gobi_1: Setting Powered False 22:24:32.740444 bus /gobi_0: Setting Powered False 22:24:33.839988 bus /gobi_0: Setting Powered False 22:24:34.956728 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx ping.py ---------------------------------------------- 22:24:36.061705 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:36.073300 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:24:36.123684 tst ping.py: using LAC 24071 22:24:36.249676 tst ping.py: using RAC 101 22:24:36.376458 tst ping.py: using CellId 24071 22:24:36.503045 tst ping.py: using BVCI 24072 22:24:36.620693 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:36.631682 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:36.642468 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:36.653314 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:36.663999 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:36.674808 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:36.685671 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:36.696431 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:36.814867 tst ping.py:19: start network... 22:24:37.031715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:37.527104 run create_hlr_db(pid=23872): Launched 22:24:37.656264 bus /gobi_6: Setting Powered False 22:24:38.720296 run create_hlr_db(pid=23872): Terminated: ok {rc=0} 22:24:39.148809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23874): Launched 22:24:39.447438 run osmo-hlr_10.42.42.2(pid=23875): Launched 22:24:39.562070 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:40.078138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23877): Launched 22:24:40.376635 run osmo-stp_10.42.42.5(pid=23878): Launched 22:24:40.491041 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:24:41.008527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23880): Launched 22:24:41.123582 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:24:41.376776 run patchelf(pid=23881): Launched 22:24:41.545499 run osmo-stp_10.42.42.5(pid=23878): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23878)] 22:24:41.673222 run osmo-stp_10.42.42.5(pid=23878): stdout: | (launched: 2022-12-09_22:24:40.322270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:41.802188 run osmo-stp_10.42.42.5(pid=23878): stderr: | 20221209222440492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222440492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222440492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222440493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222440493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222440493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222440493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:41.931484 run osmo-stp_10.42.42.5(pid=23878): stdout: | (launched: 2022-12-09_22:24:40.322270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:42.054475 run osmo-stp_10.42.42.5(pid=23878): stderr: | 20221209222440492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222440492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222440492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222440493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222440493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222440493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222440493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:42.199856 run patchelf(pid=23881): Terminating (SIGINT) 22:24:42.370331 run patchelf(pid=23881): Terminated: ok {rc=0} 22:24:42.492882 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23878): Process ended prematurely: osmo-stp_10.42.42.5(pid=23878) [trial-2365↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23878)] [trial-2365↪gprs:trx-umtrx↪ping.py:22] 22:24:42.501793 tst ping.py:22: Test FAILED (6.4 sec) 22:24:42.529257 run osmo-hlr_10.42.42.2(pid=23875): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23875)] 22:24:42.577171 run osmo-hlr_10.42.42.2(pid=23875): stdout: | (launched: 2022-12-09_22:24:39.393145) 22:24:42.627137 run osmo-hlr_10.42.42.2(pid=23875): stderr: | 20221209222439570 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222439570 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222439570 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222439570 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222439570 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222439570 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222439582 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222439591 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222439592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222439592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:42.677469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23874): Terminating (SIGTERM) 22:24:42.717216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23877): Terminating (SIGTERM) 22:24:42.757478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23880): Terminating (SIGTERM) 22:24:42.797884 --- ParallelTerminationStrategy: PID 23874 died... 22:24:42.817138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23874): Terminated: ok {rc=0} 22:24:42.862044 --- ParallelTerminationStrategy: PID 23877 died... 22:24:42.880846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23877): Terminated: ok {rc=0} 22:24:42.925828 --- ParallelTerminationStrategy: PID 23880 died... 22:24:42.944654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23880): Terminated: ok {rc=0} 22:24:43.029563 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 22:24:44.114339 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:44.125713 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:24:44.175096 tst ping_idle_ping.py: using LAC 24072 22:24:44.294881 tst ping_idle_ping.py: using RAC 102 22:24:44.412563 tst ping_idle_ping.py: using CellId 24072 22:24:44.536480 tst ping_idle_ping.py: using BVCI 24073 22:24:44.645702 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:44.656447 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:44.667119 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:44.678030 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:44.688857 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:44.699659 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:44.710505 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:44.721447 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:44.840355 tst ping_idle_ping.py:24: start network... 22:24:45.043399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:45.509697 run create_hlr_db(pid=23882): Launched 22:24:45.623110 bus /gobi_6: Setting Powered False 22:24:46.681488 run create_hlr_db(pid=23882): Terminated: ok {rc=0} 22:24:47.156571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23884): Launched 22:24:47.481556 run osmo-hlr_10.42.42.2(pid=23885): Launched 22:24:47.606530 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:48.166223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23887): Launched 22:24:48.487064 run osmo-stp_10.42.42.5(pid=23888): Launched 22:24:48.610915 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:24:49.164280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23890): Launched 22:24:49.287174 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:24:49.558834 run patchelf(pid=23891): Launched 22:24:49.738662 run osmo-stp_10.42.42.5(pid=23888): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23888)] 22:24:49.875124 run osmo-stp_10.42.42.5(pid=23888): stdout: | (launched: 2022-12-09_22:24:48.428409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:50.013380 run osmo-stp_10.42.42.5(pid=23888): stderr: | 20221209222448619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222448619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222448620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222448620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222448622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222448623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222448623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:50.151663 run osmo-stp_10.42.42.5(pid=23888): stdout: | (launched: 2022-12-09_22:24:48.428409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:50.283266 run osmo-stp_10.42.42.5(pid=23888): stderr: | 20221209222448619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222448619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222448620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222448620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222448622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222448623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222448623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:50.439204 run patchelf(pid=23891): Terminating (SIGINT) 22:24:50.621157 run patchelf(pid=23891): Terminated: ok {rc=0} 22:24:50.751425 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23888): Process ended prematurely: osmo-stp_10.42.42.5(pid=23888) [trial-2365↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23888)] [trial-2365↪gprs:trx-umtrx↪ping_idle_ping.py:27] 22:24:50.760849 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:24:50.789225 run osmo-hlr_10.42.42.2(pid=23885): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23885)] 22:24:50.839763 run osmo-hlr_10.42.42.2(pid=23885): stdout: | (launched: 2022-12-09_22:24:47.422705) 22:24:50.892050 run osmo-hlr_10.42.42.2(pid=23885): stderr: | 20221209222447622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222447622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222447622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222447622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222447622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222447622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222447635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222447645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222447645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222447646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:50.944579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23884): Terminating (SIGTERM) 22:24:50.986951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23887): Terminating (SIGTERM) 22:24:51.029444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23890): Terminating (SIGTERM) 22:24:51.072044 --- ParallelTerminationStrategy: PID 23884 died... 22:24:51.092492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23884): Terminated: ok {rc=0} 22:24:51.139500 --- ParallelTerminationStrategy: PID 23887 died... 22:24:51.159271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23887): Terminated: ok {rc=0} 22:24:51.205997 --- ParallelTerminationStrategy: PID 23890 died... 22:24:51.225781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23890): Terminated: ok {rc=0} 22:24:51.314582 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 22:24:52.617573 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:24:52.623864 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:24:52.657451 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:24:52.696775 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:24:52.785724 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:24:52.818902 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:24:52.858125 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:24:53.453616 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:24:53.506838 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:53.518437 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:24:53.574405 tst cs_paging_gprs_active.py: using LAC 24073 22:24:53.701919 tst cs_paging_gprs_active.py: using RAC 103 22:24:53.832169 tst cs_paging_gprs_active.py: using CellId 24073 22:24:53.953464 tst cs_paging_gprs_active.py: using BVCI 24074 22:24:54.067575 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:54.078611 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:54.089433 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:54.101063 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:54.112303 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:54.123697 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:54.135131 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:54.146369 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:54.157940 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:24:54.281654 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:24:54.399736 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:24:54.607635 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:54.915072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23895): Launched 22:24:55.181406 run iperf3-srv_10.42.42.10(pid=23896): Launched 22:24:55.297638 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:24:55.505125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:55.815247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23897): Launched 22:24:56.081099 run iperf3-srv_10.42.42.10(pid=23898): Launched 22:24:56.196189 tst cs_paging_gprs_active.py:38: start network... 22:24:56.400781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:56.873491 run create_hlr_db(pid=23899): Launched 22:24:56.991138 bus /gobi_6: Setting Powered False 22:24:58.057195 run create_hlr_db(pid=23899): Terminated: ok {rc=0} 22:24:58.511485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23901): Launched 22:24:58.838424 run osmo-hlr_10.42.42.2(pid=23902): Launched 22:24:58.963242 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:59.523079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23904): Launched 22:24:59.850735 run osmo-stp_10.42.42.5(pid=23905): Launched 22:24:59.975553 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:25:00.538273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23907): Launched 22:25:00.664263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:25:00.953811 run patchelf(pid=23908): Launched 22:25:01.159415 run osmo-stp_10.42.42.5(pid=23905): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23905)] 22:25:01.300610 run osmo-stp_10.42.42.5(pid=23905): stdout: | (launched: 2022-12-09_22:24:59.791848) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:01.443754 run osmo-stp_10.42.42.5(pid=23905): stderr: | 20221209222459985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222459986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222459986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222459986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222459987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222459987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222459987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:01.588438 run osmo-stp_10.42.42.5(pid=23905): stdout: | (launched: 2022-12-09_22:24:59.791848) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:01.725741 run osmo-stp_10.42.42.5(pid=23905): stderr: | 20221209222459985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222459986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222459986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222459986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222459987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222459987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222459987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:01.888886 run patchelf(pid=23908): Terminating (SIGINT) 22:25:02.077673 run patchelf(pid=23908): Terminated: ok {rc=0} 22:25:02.213427 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23905): Process ended prematurely: osmo-stp_10.42.42.5(pid=23905) [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23905)] [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:25:02.224157 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 22:25:02.254314 run osmo-hlr_10.42.42.2(pid=23902): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23902)] 22:25:02.305886 run osmo-hlr_10.42.42.2(pid=23902): stdout: | (launched: 2022-12-09_22:24:58.779487) 22:25:02.358243 run osmo-hlr_10.42.42.2(pid=23902): stderr: | 20221209222458976 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222458976 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222458976 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222458976 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222458977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222458977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222458989 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222458997 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222458998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222458998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:02.410870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23895): Terminating (SIGTERM) 22:25:02.453301 run iperf3-srv_10.42.42.10(pid=23896): Terminating (SIGTERM) 22:25:02.495898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23897): Terminating (SIGTERM) 22:25:02.538676 run iperf3-srv_10.42.42.10(pid=23898): Terminating (SIGTERM) 22:25:02.581155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23901): Terminating (SIGTERM) 22:25:02.623844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23904): Terminating (SIGTERM) 22:25:02.666466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23907): Terminating (SIGTERM) 22:25:02.709342 --- ParallelTerminationStrategy: PID 23895 died... 22:25:02.729750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23895): Terminated: ok {rc=0} 22:25:02.776929 --- ParallelTerminationStrategy: PID 23896 died... 22:25:02.796843 run iperf3-srv_10.42.42.10(pid=23896): Terminated {rc=256} 22:25:02.843675 --- ParallelTerminationStrategy: PID 23897 died... 22:25:02.863562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23897): Terminated: ok {rc=0} 22:25:02.910662 --- ParallelTerminationStrategy: PID 23898 died... 22:25:02.930541 run iperf3-srv_10.42.42.10(pid=23898): Terminated {rc=256} 22:25:02.977434 --- ParallelTerminationStrategy: PID 23901 died... 22:25:02.997268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23901): Terminated: ok {rc=0} 22:25:03.043955 --- ParallelTerminationStrategy: PID 23904 died... 22:25:03.063781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23904): Terminated: ok {rc=0} 22:25:03.110714 --- ParallelTerminationStrategy: PID 23907 died... 22:25:03.130562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23907): Terminated: ok {rc=0} 22:25:03.219288 bus /gobi_0: Setting Powered False 22:25:04.319573 bus /gobi_0: Setting Powered False 22:25:05.435845 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:25:06.586748 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:06.598722 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:25:06.653459 tst iperf3.py: using LAC 24074 22:25:06.783876 tst iperf3.py: using RAC 104 22:25:06.911516 tst iperf3.py: using CellId 24074 22:25:07.039546 tst iperf3.py: using BVCI 24075 22:25:07.158318 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:07.169848 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:07.180855 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:07.192251 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:07.203410 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:07.214623 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:07.226029 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:07.237154 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:07.248555 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:07.365797 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:25:07.571302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:07.878381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23912): Launched 22:25:08.143796 run iperf3-srv_10.42.42.10(pid=23913): Launched 22:25:08.258236 tst iperf3.py:8: start network... 22:25:08.463432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:08.933526 run create_hlr_db(pid=23914): Launched 22:25:09.051721 bus /gobi_6: Setting Powered False 22:25:10.113245 run create_hlr_db(pid=23914): Terminated: ok {rc=0} 22:25:10.557370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23916): Launched 22:25:10.882696 run osmo-hlr_10.42.42.2(pid=23917): Launched 22:25:11.007273 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:11.574492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23919): Launched 22:25:11.899383 run osmo-stp_10.42.42.5(pid=23920): Launched 22:25:12.023428 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:25:12.582147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23922): Launched 22:25:12.706822 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:25:12.981048 run patchelf(pid=23923): Launched 22:25:13.162513 run osmo-stp_10.42.42.5(pid=23920): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23920)] 22:25:13.300255 run osmo-stp_10.42.42.5(pid=23920): stdout: | (launched: 2022-12-09_22:25:11.840563) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:13.439426 run osmo-stp_10.42.42.5(pid=23920): stderr: | 20221209222512034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222512034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222512034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222512035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222512035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222512035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222512035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:13.579172 run osmo-stp_10.42.42.5(pid=23920): stdout: | (launched: 2022-12-09_22:25:11.840563) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:13.712408 run osmo-stp_10.42.42.5(pid=23920): stderr: | 20221209222512034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222512034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222512034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222512035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222512035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222512035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222512035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:13.869552 run patchelf(pid=23923): Terminating (SIGINT) 22:25:14.052919 run patchelf(pid=23923): Terminated: ok {rc=0} 22:25:14.184856 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23920): Process ended prematurely: osmo-stp_10.42.42.5(pid=23920) [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23920)] [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 22:25:14.195099 tst iperf3.py:8: Test FAILED (7.6 sec) 22:25:14.223642 run osmo-hlr_10.42.42.2(pid=23917): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23917)] 22:25:14.273462 run osmo-hlr_10.42.42.2(pid=23917): stdout: | (launched: 2022-12-09_22:25:10.823845) 22:25:14.325329 run osmo-hlr_10.42.42.2(pid=23917): stderr: | 20221209222511024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222511025 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222511025 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222511025 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222511025 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222511025 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222511037 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222511045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222511045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222511045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:14.377216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23912): Terminating (SIGTERM) 22:25:14.418812 run iperf3-srv_10.42.42.10(pid=23913): Terminating (SIGTERM) 22:25:14.460643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23916): Terminating (SIGTERM) 22:25:14.503275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23919): Terminating (SIGTERM) 22:25:14.545172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23922): Terminating (SIGTERM) 22:25:14.587341 --- ParallelTerminationStrategy: PID 23912 died... 22:25:14.607390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23912): Terminated: ok {rc=0} 22:25:14.653762 --- ParallelTerminationStrategy: PID 23913 died... 22:25:14.673525 run iperf3-srv_10.42.42.10(pid=23913): Terminated {rc=256} 22:25:14.719915 --- ParallelTerminationStrategy: PID 23916 died... 22:25:14.739620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23916): Terminated: ok {rc=0} 22:25:14.785960 --- ParallelTerminationStrategy: PID 23919 died... 22:25:14.805720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23919): Terminated: ok {rc=0} 22:25:14.851941 --- ParallelTerminationStrategy: PID 23922 died... 22:25:14.871410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23922): Terminated: ok {rc=0} 22:25:14.959156 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:25:16.139560 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:16.156366 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:25:16.221838 tst iperf3m4.py: using LAC 24075 22:25:16.353107 tst iperf3m4.py: using RAC 105 22:25:16.481433 tst iperf3m4.py: using CellId 24075 22:25:16.610122 tst iperf3m4.py: using BVCI 24076 22:25:16.731059 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:16.743241 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:16.755239 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:16.768244 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:16.780377 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:16.792598 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:16.805368 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:16.817667 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:16.831005 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:16.951820 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:17.077108 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:17.200267 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:17.321094 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:25:17.526192 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:17.832567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23924): Launched 22:25:18.098659 run iperf3-srv_10.42.42.10(pid=23925): Launched 22:25:18.213422 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:25:18.416673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:18.721799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23926): Launched 22:25:18.986187 run iperf3-srv_10.42.42.10(pid=23927): Launched 22:25:19.100786 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:25:19.305821 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:19.610757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23928): Launched 22:25:19.876002 run iperf3-srv_10.42.42.10(pid=23929): Launched 22:25:19.990902 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:25:20.195227 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:20.501201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23930): Launched 22:25:20.766523 run iperf3-srv_10.42.42.10(pid=23931): Launched 22:25:20.881233 tst iperf3m4.py:8: start network... 22:25:21.084717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:21.554663 run create_hlr_db(pid=23932): Launched 22:25:21.671384 bus /gobi_6: Setting Powered False 22:25:22.731948 run create_hlr_db(pid=23932): Terminated: ok {rc=0} 22:25:23.155707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23934): Launched 22:25:23.460751 run osmo-hlr_10.42.42.2(pid=23935): Launched 22:25:23.578007 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:24.106680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23937): Launched 22:25:24.410994 run osmo-stp_10.42.42.5(pid=23938): Launched 22:25:24.527611 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:25:25.052320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23940): Launched 22:25:25.170000 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:25:25.427525 run patchelf(pid=23941): Launched 22:25:25.598158 run osmo-stp_10.42.42.5(pid=23938): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23938)] 22:25:25.728026 run osmo-stp_10.42.42.5(pid=23938): stdout: | (launched: 2022-12-09_22:25:24.355496) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:25.859011 run osmo-stp_10.42.42.5(pid=23938): stderr: | 20221209222524527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222524527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222524527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222524528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222524528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222524528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222524529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:25.989739 run osmo-stp_10.42.42.5(pid=23938): stdout: | (launched: 2022-12-09_22:25:24.355496) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:26.114688 run osmo-stp_10.42.42.5(pid=23938): stderr: | 20221209222524527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222524527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222524527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222524528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222524528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222524528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222524529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:26.262510 run patchelf(pid=23941): Terminating (SIGINT) 22:25:26.435841 run patchelf(pid=23941): Terminated: ok {rc=0} 22:25:26.560182 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23938): Process ended prematurely: osmo-stp_10.42.42.5(pid=23938) [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23938)] [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 22:25:26.569912 tst iperf3m4.py:8: Test FAILED (10.5 sec) 22:25:26.597989 run osmo-hlr_10.42.42.2(pid=23935): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23935)] 22:25:26.646183 run osmo-hlr_10.42.42.2(pid=23935): stdout: | (launched: 2022-12-09_22:25:23.405105) 22:25:26.695630 run osmo-hlr_10.42.42.2(pid=23935): stderr: | 20221209222523583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222523583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222523583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222523584 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222523584 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222523584 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222523595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222523604 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222523604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222523604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:26.745723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23924): Terminating (SIGTERM) 22:25:26.785665 run iperf3-srv_10.42.42.10(pid=23925): Terminating (SIGTERM) 22:25:26.825757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23926): Terminating (SIGTERM) 22:25:26.866185 run iperf3-srv_10.42.42.10(pid=23927): Terminating (SIGTERM) 22:25:26.906133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23928): Terminating (SIGTERM) 22:25:26.946168 run iperf3-srv_10.42.42.10(pid=23929): Terminating (SIGTERM) 22:25:26.985917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23930): Terminating (SIGTERM) 22:25:27.025811 run iperf3-srv_10.42.42.10(pid=23931): Terminating (SIGTERM) 22:25:27.065619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23934): Terminating (SIGTERM) 22:25:27.105470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23937): Terminating (SIGTERM) 22:25:27.145044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23940): Terminating (SIGTERM) 22:25:27.184989 --- ParallelTerminationStrategy: PID 23924 died... 22:25:27.204206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23924): Terminated: ok {rc=0} 22:25:27.248719 --- ParallelTerminationStrategy: PID 23925 died... 22:25:27.267509 run iperf3-srv_10.42.42.10(pid=23925): Terminated {rc=256} 22:25:27.312058 --- ParallelTerminationStrategy: PID 23926 died... 22:25:27.330712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23926): Terminated: ok {rc=0} 22:25:27.375320 --- ParallelTerminationStrategy: PID 23927 died... 22:25:27.394012 run iperf3-srv_10.42.42.10(pid=23927): Terminated {rc=256} 22:25:27.438262 --- ParallelTerminationStrategy: PID 23928 died... 22:25:27.457167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23928): Terminated: ok {rc=0} 22:25:27.501253 --- ParallelTerminationStrategy: PID 23929 died... 22:25:27.519815 run iperf3-srv_10.42.42.10(pid=23929): Terminated {rc=256} 22:25:27.564065 --- ParallelTerminationStrategy: PID 23930 died... 22:25:27.582856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23930): Terminated: ok {rc=0} 22:25:27.627105 --- ParallelTerminationStrategy: PID 23931 died... 22:25:27.645637 run iperf3-srv_10.42.42.10(pid=23931): Terminated {rc=256} 22:25:27.690048 --- ParallelTerminationStrategy: PID 23934 died... 22:25:27.708728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23934): Terminated: ok {rc=0} 22:25:27.753388 --- ParallelTerminationStrategy: PID 23937 died... 22:25:27.772012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23937): Terminated: ok {rc=0} 22:25:27.816755 --- ParallelTerminationStrategy: PID 23940 died... 22:25:27.835508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23940): Terminated: ok {rc=0} 22:25:27.921160 bus /gobi_4: Setting Powered False 22:25:29.021423 bus /gobi_4: Setting Powered False 22:25:30.135192 bus /gobi_1: Setting Powered False 22:25:31.233295 bus /gobi_1: Setting Powered False 22:25:32.350148 bus /gobi_0: Setting Powered False 22:25:33.448711 bus /gobi_0: Setting Powered False 22:25:34.565885 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 22:25:35.668703 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:35.680608 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:25:35.731530 tst ping.py: using LAC 24076 22:25:35.857036 tst ping.py: using RAC 106 22:25:35.985131 tst ping.py: using CellId 24076 22:25:36.103847 tst ping.py: using BVCI 24077 22:25:36.212006 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:36.223127 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:36.234402 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:36.245675 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:36.256712 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:36.267762 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:36.279084 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:36.290397 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:36.407319 tst ping.py:19: start network... 22:25:36.607380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:37.070222 run create_hlr_db(pid=23942): Launched 22:25:37.185296 bus /gobi_6: Setting Powered False 22:25:38.245653 run create_hlr_db(pid=23942): Terminated: ok {rc=0} 22:25:38.685257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23944): Launched 22:25:39.004704 run osmo-hlr_10.42.42.2(pid=23945): Launched 22:25:39.127546 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:39.679423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23947): Launched 22:25:39.999248 run osmo-stp_10.42.42.5(pid=23948): Launched 22:25:40.121149 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:25:40.670676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23950): Launched 22:25:40.793089 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:25:41.062526 run patchelf(pid=23951): Launched 22:25:41.240354 run osmo-stp_10.42.42.5(pid=23948): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23948)] 22:25:41.375882 run osmo-stp_10.42.42.5(pid=23948): stdout: | (launched: 2022-12-09_22:25:39.941282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:41.513558 run osmo-stp_10.42.42.5(pid=23948): stderr: | 20221209222540132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222540132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222540132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222540133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222540133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222540133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222540133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:41.651394 run osmo-stp_10.42.42.5(pid=23948): stdout: | (launched: 2022-12-09_22:25:39.941282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:41.782285 run osmo-stp_10.42.42.5(pid=23948): stderr: | 20221209222540132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222540132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222540132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222540133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222540133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222540133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222540133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:41.938476 run patchelf(pid=23951): Terminating (SIGINT) 22:25:42.119469 run patchelf(pid=23951): Terminated: ok {rc=0} 22:25:42.249468 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23948): Process ended prematurely: osmo-stp_10.42.42.5(pid=23948) [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23948)] [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 22:25:42.258913 tst ping.py:22: Test FAILED (6.6 sec) 22:25:42.286988 run osmo-hlr_10.42.42.2(pid=23945): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23945)] 22:25:42.336670 run osmo-hlr_10.42.42.2(pid=23945): stdout: | (launched: 2022-12-09_22:25:38.946692) 22:25:42.388137 run osmo-hlr_10.42.42.2(pid=23945): stderr: | 20221209222539146 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222539146 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222539146 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222539146 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222539146 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222539146 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222539159 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222539167 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222539168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222539168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:42.440101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23944): Terminating (SIGTERM) 22:25:42.482329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23947): Terminating (SIGTERM) 22:25:42.524562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23950): Terminating (SIGTERM) 22:25:42.566963 --- ParallelTerminationStrategy: PID 23944 died... 22:25:42.587096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23944): Terminated: ok {rc=0} 22:25:42.633849 --- ParallelTerminationStrategy: PID 23947 died... 22:25:42.653580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23947): Terminated: ok {rc=0} 22:25:42.700142 --- ParallelTerminationStrategy: PID 23950 died... 22:25:42.719892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23950): Terminated: ok {rc=0} 22:25:42.807715 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:25:43.895149 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:43.907487 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:25:43.960295 tst ping_idle_ping.py: using LAC 24077 22:25:44.085771 tst ping_idle_ping.py: using RAC 107 22:25:44.213560 tst ping_idle_ping.py: using CellId 24077 22:25:44.338920 tst ping_idle_ping.py: using BVCI 24078 22:25:44.454954 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:44.466319 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:44.477485 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:44.488816 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:44.499855 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:44.511040 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:44.522368 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:44.533536 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:44.648414 tst ping_idle_ping.py:24: start network... 22:25:44.849922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:45.314365 run create_hlr_db(pid=23952): Launched 22:25:45.428860 bus /gobi_6: Setting Powered False 22:25:46.488304 run create_hlr_db(pid=23952): Terminated: ok {rc=0} 22:25:46.922114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23954): Launched 22:25:47.241760 run osmo-hlr_10.42.42.2(pid=23955): Launched 22:25:47.358340 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:47.873863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23957): Launched 22:25:48.177619 run osmo-stp_10.42.42.5(pid=23958): Launched 22:25:48.293920 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:25:48.818406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23960): Launched 22:25:48.943377 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:25:49.215564 run patchelf(pid=23961): Launched 22:25:49.394984 run osmo-stp_10.42.42.5(pid=23958): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23958)] 22:25:49.531884 run osmo-stp_10.42.42.5(pid=23958): stdout: | (launched: 2022-12-09_22:25:48.122282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:49.670370 run osmo-stp_10.42.42.5(pid=23958): stderr: | 20221209222548292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222548292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222548292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222548293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222548293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222548293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222548293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:49.808377 run osmo-stp_10.42.42.5(pid=23958): stdout: | (launched: 2022-12-09_22:25:48.122282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:49.940208 run osmo-stp_10.42.42.5(pid=23958): stderr: | 20221209222548292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222548292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222548292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222548293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222548293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222548293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222548293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:50.096120 run patchelf(pid=23961): Terminating (SIGINT) 22:25:50.277222 run patchelf(pid=23961): Terminated: ok {rc=0} 22:25:50.407530 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23958): Process ended prematurely: osmo-stp_10.42.42.5(pid=23958) [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23958)] [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 22:25:50.417142 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:25:50.445272 run osmo-hlr_10.42.42.2(pid=23955): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23955)] 22:25:50.495703 run osmo-hlr_10.42.42.2(pid=23955): stdout: | (launched: 2022-12-09_22:25:47.186034) 22:25:50.547695 run osmo-hlr_10.42.42.2(pid=23955): stderr: | 20221209222547360 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222547360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222547360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222547360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222547360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222547361 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222547372 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222547381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222547381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222547381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:50.600041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23954): Terminating (SIGTERM) 22:25:50.641959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23957): Terminating (SIGTERM) 22:25:50.684152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23960): Terminating (SIGTERM) 22:25:50.726528 --- ParallelTerminationStrategy: PID 23954 died... 22:25:50.746803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23954): Terminated: ok {rc=0} 22:25:50.793529 --- ParallelTerminationStrategy: PID 23957 died... 22:25:50.813325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23957): Terminated: ok {rc=0} 22:25:50.859595 --- ParallelTerminationStrategy: PID 23960 died... 22:25:50.879475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23960): Terminated: ok {rc=0} 22:25:50.967411 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:25:52.275092 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:25:52.282011 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:25:52.315447 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:25:52.354672 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:25:52.442722 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:25:52.475677 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:25:52.515336 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:25:53.113197 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:25:53.165335 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.176528 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:25:53.247244 tst cs_paging_gprs_active.py: using LAC 24078 22:25:53.376404 tst cs_paging_gprs_active.py: using RAC 108 22:25:53.497349 tst cs_paging_gprs_active.py: using CellId 24078 22:25:53.617735 tst cs_paging_gprs_active.py: using BVCI 24079 22:25:53.736911 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.748231 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.759375 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.770519 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.781597 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.792677 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.803945 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.815099 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.826405 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:25:53.943296 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:25:54.063369 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:25:54.283426 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:54.610466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23966): Launched 22:25:54.893928 run iperf3-srv_10.42.42.10(pid=23967): Launched 22:25:55.016014 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:25:55.235705 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:55.563150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23968): Launched 22:25:55.846540 run iperf3-srv_10.42.42.10(pid=23969): Launched 22:25:55.968653 tst cs_paging_gprs_active.py:38: start network... 22:25:56.188869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:56.694115 run create_hlr_db(pid=23970): Launched 22:25:56.827125 bus /gobi_6: Setting Powered False 22:25:57.891697 run create_hlr_db(pid=23970): Terminated: ok {rc=0} 22:25:58.327455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23972): Launched 22:25:58.633030 run osmo-hlr_10.42.42.2(pid=23973): Launched 22:25:58.750318 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:59.293594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23975): Launched 22:25:59.602288 run osmo-stp_10.42.42.5(pid=23976): Launched 22:25:59.718953 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:26:00.245685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23978): Launched 22:26:00.363748 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:26:00.628699 run patchelf(pid=23979): Launched 22:26:00.801114 run osmo-stp_10.42.42.5(pid=23976): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23976)] 22:26:00.939998 run osmo-stp_10.42.42.5(pid=23976): stdout: | (launched: 2022-12-09_22:25:59.546372) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:01.075262 run osmo-stp_10.42.42.5(pid=23976): stderr: | 20221209222559720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222559720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222559721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222559721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222559722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222559722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222559722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:01.210551 run osmo-stp_10.42.42.5(pid=23976): stdout: | (launched: 2022-12-09_22:25:59.546372) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:01.340266 run osmo-stp_10.42.42.5(pid=23976): stderr: | 20221209222559720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222559720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222559721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222559721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222559722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222559722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222559722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:01.493588 run patchelf(pid=23979): Terminating (SIGINT) 22:26:01.671992 run patchelf(pid=23979): Terminated: ok {rc=0} 22:26:01.800903 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23976): Process ended prematurely: osmo-stp_10.42.42.5(pid=23976) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23976)] [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:26:01.811591 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:26:01.842937 run osmo-hlr_10.42.42.2(pid=23973): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23973)] 22:26:01.893457 run osmo-hlr_10.42.42.2(pid=23973): stdout: | (launched: 2022-12-09_22:25:58.577478) 22:26:01.945703 run osmo-hlr_10.42.42.2(pid=23973): stderr: | 20221209222558755 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222558755 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222558755 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222558755 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222558755 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222558755 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222558771 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222558781 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222558781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222558781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:01.998531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23966): Terminating (SIGTERM) 22:26:02.041616 run iperf3-srv_10.42.42.10(pid=23967): Terminating (SIGTERM) 22:26:02.086959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23968): Terminating (SIGTERM) 22:26:02.130315 run iperf3-srv_10.42.42.10(pid=23969): Terminating (SIGTERM) 22:26:02.175552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23972): Terminating (SIGTERM) 22:26:02.218281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23975): Terminating (SIGTERM) 22:26:02.259709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23978): Terminating (SIGTERM) 22:26:02.300764 --- ParallelTerminationStrategy: PID 23966 died... 22:26:02.320079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23966): Terminated: ok {rc=0} 22:26:02.365892 --- ParallelTerminationStrategy: PID 23967 died... 22:26:02.384662 run iperf3-srv_10.42.42.10(pid=23967): Terminated {rc=256} 22:26:02.430268 --- ParallelTerminationStrategy: PID 23968 died... 22:26:02.449206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23968): Terminated: ok {rc=0} 22:26:02.494957 --- ParallelTerminationStrategy: PID 23969 died... 22:26:02.513790 run iperf3-srv_10.42.42.10(pid=23969): Terminated {rc=256} 22:26:02.558893 --- ParallelTerminationStrategy: PID 23972 died... 22:26:02.577786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23972): Terminated: ok {rc=0} 22:26:02.622700 --- ParallelTerminationStrategy: PID 23975 died... 22:26:02.641544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23975): Terminated: ok {rc=0} 22:26:02.686171 --- ParallelTerminationStrategy: PID 23978 died... 22:26:02.704718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23978): Terminated: ok {rc=0} 22:26:02.790972 bus /gobi_0: Setting Powered False 22:26:03.888893 bus /gobi_0: Setting Powered False 22:26:05.003288 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:26:06.153809 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.165786 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:26:06.236488 tst iperf3.py: using LAC 24079 22:26:06.364253 tst iperf3.py: using RAC 109 22:26:06.493299 tst iperf3.py: using CellId 24079 22:26:06.620883 tst iperf3.py: using BVCI 24080 22:26:06.732103 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.743003 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.753868 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.764806 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.775762 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.786834 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.797878 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.808567 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.819665 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:06.935100 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:26:07.141638 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:07.448434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23980): Launched 22:26:07.714291 run iperf3-srv_10.42.42.10(pid=23981): Launched 22:26:07.829171 tst iperf3.py:8: start network... 22:26:08.032928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:08.503936 run create_hlr_db(pid=23982): Launched 22:26:08.619947 bus /gobi_6: Setting Powered False 22:26:09.681542 run create_hlr_db(pid=23982): Terminated: ok {rc=0} 22:26:10.125909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23984): Launched 22:26:10.452484 run osmo-hlr_10.42.42.2(pid=23985): Launched 22:26:10.577921 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:11.229098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23987): Launched 22:26:11.545999 run osmo-stp_10.42.42.5(pid=23988): Launched 22:26:11.668383 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:26:12.215952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23990): Launched 22:26:12.337619 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:26:12.606136 run patchelf(pid=23991): Launched 22:26:12.783965 run osmo-stp_10.42.42.5(pid=23988): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23988)] 22:26:12.919154 run osmo-stp_10.42.42.5(pid=23988): stdout: | (launched: 2022-12-09_22:26:11.488111) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:13.055553 run osmo-stp_10.42.42.5(pid=23988): stderr: | 20221209222611679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222611680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222611680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222611680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222611681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222611681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222611681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:13.193045 run osmo-stp_10.42.42.5(pid=23988): stdout: | (launched: 2022-12-09_22:26:11.488111) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:13.323047 run osmo-stp_10.42.42.5(pid=23988): stderr: | 20221209222611679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222611680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222611680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222611680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222611681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222611681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222611681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:13.476803 run patchelf(pid=23991): Terminating (SIGINT) 22:26:13.657174 run patchelf(pid=23991): Terminated: ok {rc=0} 22:26:13.786456 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23988): Process ended prematurely: osmo-stp_10.42.42.5(pid=23988) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23988)] [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 22:26:13.796436 tst iperf3.py:8: Test FAILED (7.7 sec) 22:26:13.825027 run osmo-hlr_10.42.42.2(pid=23985): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23985)] 22:26:13.874627 run osmo-hlr_10.42.42.2(pid=23985): stdout: | (launched: 2022-12-09_22:26:10.393647) 22:26:13.925987 run osmo-hlr_10.42.42.2(pid=23985): stderr: | 20221209222610594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222610594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222610594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222610594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222610594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222610594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222610609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222610619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222610619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222610619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:13.977610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23980): Terminating (SIGTERM) 22:26:14.019083 run iperf3-srv_10.42.42.10(pid=23981): Terminating (SIGTERM) 22:26:14.060606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23984): Terminating (SIGTERM) 22:26:14.102923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23987): Terminating (SIGTERM) 22:26:14.145138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23990): Terminating (SIGTERM) 22:26:14.187126 --- ParallelTerminationStrategy: PID 23980 died... 22:26:14.207156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23980): Terminated: ok {rc=0} 22:26:14.253392 --- ParallelTerminationStrategy: PID 23981 died... 22:26:14.272815 run iperf3-srv_10.42.42.10(pid=23981): Terminated {rc=256} 22:26:14.318791 --- ParallelTerminationStrategy: PID 23984 died... 22:26:14.338360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23984): Terminated: ok {rc=0} 22:26:14.384233 --- ParallelTerminationStrategy: PID 23987 died... 22:26:14.403691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23987): Terminated: ok {rc=0} 22:26:14.449571 --- ParallelTerminationStrategy: PID 23990 died... 22:26:14.468840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23990): Terminated: ok {rc=0} 22:26:14.556600 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:26:15.706948 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:15.718764 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:26:15.789323 tst iperf3m4.py: using LAC 24080 22:26:15.917321 tst iperf3m4.py: using RAC 110 22:26:16.047971 tst iperf3m4.py: using CellId 24080 22:26:16.190407 tst iperf3m4.py: using BVCI 24081 22:26:16.306299 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:16.318387 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:16.331324 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:16.344127 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:16.357186 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:16.368929 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:16.381938 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:16.394605 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:16.407301 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:16.547191 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:16.679807 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:16.823032 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:16.939695 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:26:17.146578 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:17.460292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23992): Launched 22:26:17.737651 run iperf3-srv_10.42.42.10(pid=23993): Launched 22:26:17.858136 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:26:18.073996 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:18.395939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23994): Launched 22:26:18.672891 run iperf3-srv_10.42.42.10(pid=23995): Launched 22:26:18.792242 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:26:19.005950 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:19.324925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23996): Launched 22:26:19.602397 run iperf3-srv_10.42.42.10(pid=23997): Launched 22:26:19.721823 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:26:19.935305 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:20.254545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23998): Launched 22:26:20.531896 run iperf3-srv_10.42.42.10(pid=23999): Launched 22:26:20.651668 tst iperf3m4.py:8: start network... 22:26:20.866541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:21.340122 run create_hlr_db(pid=24000): Launched 22:26:21.454725 bus /gobi_6: Setting Powered False 22:26:22.515568 run create_hlr_db(pid=24000): Terminated: ok {rc=0} 22:26:22.951781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24002): Launched 22:26:23.269873 run osmo-hlr_10.42.42.2(pid=24003): Launched 22:26:23.391333 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:23.940056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24005): Launched 22:26:24.258339 run osmo-stp_10.42.42.5(pid=24006): Launched 22:26:24.379359 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:26:24.926550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24008): Launched 22:26:25.048719 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:26:25.317577 run patchelf(pid=24009): Launched 22:26:25.496012 run osmo-stp_10.42.42.5(pid=24006): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24006)] 22:26:25.633209 run osmo-stp_10.42.42.5(pid=24006): stdout: | (launched: 2022-12-09_22:26:24.200027) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:25.770480 run osmo-stp_10.42.42.5(pid=24006): stderr: | 20221209222624390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222624390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222624391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222624391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222624391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222624392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222624392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:25.907779 run osmo-stp_10.42.42.5(pid=24006): stdout: | (launched: 2022-12-09_22:26:24.200027) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:26.039269 run osmo-stp_10.42.42.5(pid=24006): stderr: | 20221209222624390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222624390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222624391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222624391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222624391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222624392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222624392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:26.194703 run patchelf(pid=24009): Terminating (SIGINT) 22:26:26.376515 run patchelf(pid=24009): Terminated: ok {rc=0} 22:26:26.507277 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24006): Process ended prematurely: osmo-stp_10.42.42.5(pid=24006) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24006)] [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:26:26.517516 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:26:26.546144 run osmo-hlr_10.42.42.2(pid=24003): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24003)] 22:26:26.596119 run osmo-hlr_10.42.42.2(pid=24003): stdout: | (launched: 2022-12-09_22:26:23.212263) 22:26:26.647746 run osmo-hlr_10.42.42.2(pid=24003): stderr: | 20221209222623411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222623411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222623411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222623411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222623412 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222623412 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222623424 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222623433 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222623433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222623433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:26.699845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23992): Terminating (SIGTERM) 22:26:26.741907 run iperf3-srv_10.42.42.10(pid=23993): Terminating (SIGTERM) 22:26:26.784176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23994): Terminating (SIGTERM) 22:26:26.826456 run iperf3-srv_10.42.42.10(pid=23995): Terminating (SIGTERM) 22:26:26.868295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23996): Terminating (SIGTERM) 22:26:26.910216 run iperf3-srv_10.42.42.10(pid=23997): Terminating (SIGTERM) 22:26:26.952036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23998): Terminating (SIGTERM) 22:26:26.994110 run iperf3-srv_10.42.42.10(pid=23999): Terminating (SIGTERM) 22:26:27.035896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24002): Terminating (SIGTERM) 22:26:27.077888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24005): Terminating (SIGTERM) 22:26:27.119761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24008): Terminating (SIGTERM) 22:26:27.161903 --- ParallelTerminationStrategy: PID 23992 died... 22:26:27.182061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23992): Terminated: ok {rc=0} 22:26:27.228179 --- ParallelTerminationStrategy: PID 23993 died... 22:26:27.247692 run iperf3-srv_10.42.42.10(pid=23993): Terminated {rc=256} 22:26:27.293619 --- ParallelTerminationStrategy: PID 23994 died... 22:26:27.313212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23994): Terminated: ok {rc=0} 22:26:27.358823 --- ParallelTerminationStrategy: PID 23995 died... 22:26:27.378124 run iperf3-srv_10.42.42.10(pid=23995): Terminated {rc=256} 22:26:27.423798 --- ParallelTerminationStrategy: PID 23996 died... 22:26:27.443326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23996): Terminated: ok {rc=0} 22:26:27.489253 --- ParallelTerminationStrategy: PID 23997 died... 22:26:27.509124 run iperf3-srv_10.42.42.10(pid=23997): Terminated {rc=256} 22:26:27.554889 --- ParallelTerminationStrategy: PID 23998 died... 22:26:27.574435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23998): Terminated: ok {rc=0} 22:26:27.620077 --- ParallelTerminationStrategy: PID 23999 died... 22:26:27.639500 run iperf3-srv_10.42.42.10(pid=23999): Terminated {rc=256} 22:26:27.685210 --- ParallelTerminationStrategy: PID 24002 died... 22:26:27.704434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24002): Terminated: ok {rc=0} 22:26:27.750390 --- ParallelTerminationStrategy: PID 24005 died... 22:26:27.769956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24005): Terminated: ok {rc=0} 22:26:27.815762 --- ParallelTerminationStrategy: PID 24008 died... 22:26:27.835294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24008): Terminated: ok {rc=0} 22:26:27.922915 bus /gobi_4: Setting Powered False 22:26:29.022864 bus /gobi_4: Setting Powered False 22:26:30.138831 bus /gobi_1: Setting Powered False 22:26:31.255122 bus /gobi_1: Setting Powered False 22:26:32.373775 bus /gobi_0: Setting Powered False 22:26:33.472422 bus /gobi_0: Setting Powered False 22:26:34.588243 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:26:35.691892 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:35.703530 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:26:35.772681 tst ping.py: using LAC 24081 22:26:35.888164 tst ping.py: using RAC 111 22:26:36.011865 tst ping.py: using CellId 24081 22:26:36.135267 tst ping.py: using BVCI 24082 22:26:36.250524 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:36.262031 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:36.273257 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:36.284464 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:36.295418 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:36.306878 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:36.318193 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:36.329367 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:36.443423 tst ping.py:19: start network... 22:26:36.642204 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:37.100348 run create_hlr_db(pid=24010): Launched 22:26:37.213438 bus /gobi_6: Setting Powered False 22:26:38.272639 run create_hlr_db(pid=24010): Terminated: ok {rc=0} 22:26:38.685635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24012): Launched 22:26:38.982423 run osmo-hlr_10.42.42.2(pid=24013): Launched 22:26:39.095440 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:39.600465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24015): Launched 22:26:39.894804 run osmo-stp_10.42.42.5(pid=24016): Launched 22:26:40.007424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:26:40.516052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24018): Launched 22:26:40.629723 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:26:40.877792 run patchelf(pid=24019): Launched 22:26:41.042273 run osmo-stp_10.42.42.5(pid=24016): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24016)] 22:26:41.167436 run osmo-stp_10.42.42.5(pid=24016): stdout: | (launched: 2022-12-09_22:26:39.841460) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:41.293759 run osmo-stp_10.42.42.5(pid=24016): stderr: | 20221209222640009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222640009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222640009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222640010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222640012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222640012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222640012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:41.420635 run osmo-stp_10.42.42.5(pid=24016): stdout: | (launched: 2022-12-09_22:26:39.841460) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:41.541206 run osmo-stp_10.42.42.5(pid=24016): stderr: | 20221209222640009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222640009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222640009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222640010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222640012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222640012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222640012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:41.684213 run patchelf(pid=24019): Terminating (SIGINT) 22:26:41.851297 run patchelf(pid=24019): Terminated: ok {rc=0} 22:26:41.971297 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24016): Process ended prematurely: osmo-stp_10.42.42.5(pid=24016) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24016)] [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 22:26:41.980238 tst ping.py:22: Test FAILED (6.3 sec) 22:26:42.007146 run osmo-hlr_10.42.42.2(pid=24013): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24013)] 22:26:42.055043 run osmo-hlr_10.42.42.2(pid=24013): stdout: | (launched: 2022-12-09_22:26:38.928341) 22:26:42.105106 run osmo-hlr_10.42.42.2(pid=24013): stderr: | 20221209222639106 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222639106 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222639106 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222639106 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222639106 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222639106 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222639118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222639126 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222639127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222639127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:42.154817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24012): Terminating (SIGTERM) 22:26:42.194573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24015): Terminating (SIGTERM) 22:26:42.234297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24018): Terminating (SIGTERM) 22:26:42.274437 --- ParallelTerminationStrategy: PID 24012 died... 22:26:42.293566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24012): Terminated: ok {rc=0} 22:26:42.338297 --- ParallelTerminationStrategy: PID 24015 died... 22:26:42.357092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24015): Terminated: ok {rc=0} 22:26:42.401329 --- ParallelTerminationStrategy: PID 24018 died... 22:26:42.419975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24018): Terminated: ok {rc=0} 22:26:42.505779 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:26:43.594902 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:43.606878 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:26:43.678557 tst ping_idle_ping.py: using LAC 24082 22:26:43.794089 tst ping_idle_ping.py: using RAC 112 22:26:43.910399 tst ping_idle_ping.py: using CellId 24082 22:26:44.025654 tst ping_idle_ping.py: using BVCI 24083 22:26:44.134168 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:44.145110 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:44.155711 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:44.166650 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:44.177574 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:44.188378 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:44.199293 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:44.210117 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:44.329393 tst ping_idle_ping.py:24: start network... 22:26:44.543591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:45.029102 run create_hlr_db(pid=24020): Launched 22:26:45.158271 bus /gobi_6: Setting Powered False 22:26:46.221329 run create_hlr_db(pid=24020): Terminated: ok {rc=0} 22:26:46.673728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24022): Launched 22:26:47.003920 run osmo-hlr_10.42.42.2(pid=24023): Launched 22:26:47.244557 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:47.803666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24025): Launched 22:26:48.119140 run osmo-stp_10.42.42.5(pid=24026): Launched 22:26:48.239017 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:26:48.784641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24028): Launched 22:26:48.904999 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:26:49.171459 run patchelf(pid=24029): Launched 22:26:49.346792 run osmo-stp_10.42.42.5(pid=24026): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24026)] 22:26:49.480508 run osmo-stp_10.42.42.5(pid=24026): stdout: | (launched: 2022-12-09_22:26:48.062344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:49.616447 run osmo-stp_10.42.42.5(pid=24026): stderr: | 20221209222648254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222648254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222648254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222648254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222648255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222648255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222648255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:49.751629 run osmo-stp_10.42.42.5(pid=24026): stdout: | (launched: 2022-12-09_22:26:48.062344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:49.880557 run osmo-stp_10.42.42.5(pid=24026): stderr: | 20221209222648254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222648254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222648254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222648254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222648255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222648255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222648255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:50.033051 run patchelf(pid=24029): Terminating (SIGINT) 22:26:50.211676 run patchelf(pid=24029): Terminated: ok {rc=0} 22:26:50.339931 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24026): Process ended prematurely: osmo-stp_10.42.42.5(pid=24026) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24026)] [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:26:50.349450 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 22:26:50.377409 run osmo-hlr_10.42.42.2(pid=24023): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24023)] 22:26:50.427269 run osmo-hlr_10.42.42.2(pid=24023): stdout: | (launched: 2022-12-09_22:26:46.945054) 22:26:50.478733 run osmo-hlr_10.42.42.2(pid=24023): stderr: | 20221209222647251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222647251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222647251 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222647251 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222647251 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222647251 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222647263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222647275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222647275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222647275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:50.530875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24022): Terminating (SIGTERM) 22:26:50.572447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24025): Terminating (SIGTERM) 22:26:50.613933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24028): Terminating (SIGTERM) 22:26:50.655617 --- ParallelTerminationStrategy: PID 24022 died... 22:26:50.675519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24022): Terminated: ok {rc=0} 22:26:50.721829 --- ParallelTerminationStrategy: PID 24025 died... 22:26:50.741320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24025): Terminated: ok {rc=0} 22:26:50.787575 --- ParallelTerminationStrategy: PID 24028 died... 22:26:50.807086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24028): Terminated: ok {rc=0} 22:26:50.894927 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:26:52.204393 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:26:52.210935 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:26:52.243963 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:26:52.283507 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:26:52.372109 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:26:52.405051 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:26:52.444727 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:26:53.041962 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:26:53.093101 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.104348 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:26:53.175360 tst cs_paging_gprs_active.py: using LAC 24083 22:26:53.303724 tst cs_paging_gprs_active.py: using RAC 113 22:26:53.430030 tst cs_paging_gprs_active.py: using CellId 24083 22:26:53.557078 tst cs_paging_gprs_active.py: using BVCI 24084 22:26:53.674062 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.685375 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.696402 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.707621 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.718720 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.729906 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.741152 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.752163 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.763424 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:26:53.879462 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:26:54.003300 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:26:54.220327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:54.543135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24036): Launched 22:26:54.825195 run iperf3-srv_10.42.42.10(pid=24037): Launched 22:26:54.945885 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:26:55.161916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:55.483987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24038): Launched 22:26:55.763266 run iperf3-srv_10.42.42.10(pid=24039): Launched 22:26:55.883415 tst cs_paging_gprs_active.py:38: start network... 22:26:56.099942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:56.598152 run create_hlr_db(pid=24040): Launched 22:26:56.728544 bus /gobi_6: Setting Powered False 22:26:57.792567 run create_hlr_db(pid=24040): Terminated: ok {rc=0} 22:26:58.223566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24042): Launched 22:26:58.526594 run osmo-hlr_10.42.42.2(pid=24043): Launched 22:26:58.642657 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:59.180233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24045): Launched 22:26:59.482927 run osmo-stp_10.42.42.5(pid=24046): Launched 22:26:59.599978 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:27:00.119277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24048): Launched 22:27:00.235346 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:27:00.491009 run patchelf(pid=24049): Launched 22:27:00.671162 run osmo-stp_10.42.42.5(pid=24046): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24046)] 22:27:00.807229 run osmo-stp_10.42.42.5(pid=24046): stdout: | (launched: 2022-12-09_22:26:59.428324) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:00.946917 run osmo-stp_10.42.42.5(pid=24046): stderr: | 20221209222659597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222659597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222659597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222659598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222659598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222659598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222659598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:01.087217 run osmo-stp_10.42.42.5(pid=24046): stdout: | (launched: 2022-12-09_22:26:59.428324) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:01.256119 run osmo-stp_10.42.42.5(pid=24046): stderr: | 20221209222659597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222659597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222659597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222659598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222659598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222659598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222659598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:01.456760 run patchelf(pid=24049): Terminating (SIGINT) 22:27:01.661615 run patchelf(pid=24049): Terminated: ok {rc=0} 22:27:01.794653 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24046): Process ended prematurely: osmo-stp_10.42.42.5(pid=24046) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24046)] [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:27:01.805513 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:27:01.840232 run osmo-hlr_10.42.42.2(pid=24043): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24043)] 22:27:01.898134 run osmo-hlr_10.42.42.2(pid=24043): stdout: | (launched: 2022-12-09_22:26:58.471153) 22:27:01.960716 run osmo-hlr_10.42.42.2(pid=24043): stderr: | 20221209222658646 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222658646 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222658646 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222658646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222658646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222658646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222658658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222658666 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222658667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222658667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:02.023473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24036): Terminating (SIGTERM) 22:27:02.073917 run iperf3-srv_10.42.42.10(pid=24037): Terminating (SIGTERM) 22:27:02.127725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24038): Terminating (SIGTERM) 22:27:02.179938 run iperf3-srv_10.42.42.10(pid=24039): Terminating (SIGTERM) 22:27:02.234814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24042): Terminating (SIGTERM) 22:27:02.279784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24045): Terminating (SIGTERM) 22:27:02.321284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24048): Terminating (SIGTERM) 22:27:02.362398 --- ParallelTerminationStrategy: PID 24036 died... 22:27:02.382300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24036): Terminated: ok {rc=0} 22:27:02.427189 --- ParallelTerminationStrategy: PID 24037 died... 22:27:02.445740 run iperf3-srv_10.42.42.10(pid=24037): Terminated {rc=256} 22:27:02.490102 --- ParallelTerminationStrategy: PID 24038 died... 22:27:02.508830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24038): Terminated: ok {rc=0} 22:27:02.553587 --- ParallelTerminationStrategy: PID 24039 died... 22:27:02.572313 run iperf3-srv_10.42.42.10(pid=24039): Terminated {rc=256} 22:27:02.616889 --- ParallelTerminationStrategy: PID 24042 died... 22:27:02.635852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24042): Terminated: ok {rc=0} 22:27:02.680261 --- ParallelTerminationStrategy: PID 24045 died... 22:27:02.698803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24045): Terminated: ok {rc=0} 22:27:02.743115 --- ParallelTerminationStrategy: PID 24048 died... 22:27:02.761657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24048): Terminated: ok {rc=0} 22:27:02.849709 bus /gobi_0: Setting Powered False 22:27:03.949829 bus /gobi_0: Setting Powered False 22:27:05.067364 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:27:06.217067 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.229505 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:27:06.301045 tst iperf3.py: using LAC 24084 22:27:06.427268 tst iperf3.py: using RAC 114 22:27:06.552134 tst iperf3.py: using CellId 24084 22:27:06.683430 tst iperf3.py: using BVCI 24085 22:27:06.800440 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.811800 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.822912 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.834042 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.845022 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.856126 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.867484 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.878507 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.889713 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:07.008551 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:27:07.224597 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:07.545123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24050): Launched 22:27:07.824643 run iperf3-srv_10.42.42.10(pid=24051): Launched 22:27:07.945394 tst iperf3.py:8: start network... 22:27:08.160738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:08.655577 run create_hlr_db(pid=24052): Launched 22:27:08.786450 bus /gobi_6: Setting Powered False 22:27:09.850227 run create_hlr_db(pid=24052): Terminated: ok {rc=0} 22:27:10.279733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24054): Launched 22:27:10.581770 run osmo-hlr_10.42.42.2(pid=24055): Launched 22:27:10.699397 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:11.232324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24057): Launched 22:27:11.533133 run osmo-stp_10.42.42.5(pid=24058): Launched 22:27:11.649227 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:27:12.168918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24060): Launched 22:27:12.283963 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:27:12.536840 run patchelf(pid=24061): Launched 22:27:12.704714 run osmo-stp_10.42.42.5(pid=24058): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24058)] 22:27:12.832272 run osmo-stp_10.42.42.5(pid=24058): stdout: | (launched: 2022-12-09_22:27:11.478340) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:12.960604 run osmo-stp_10.42.42.5(pid=24058): stderr: | 20221209222711648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222711648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222711649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222711649 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222711649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222711650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222711650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:13.089343 run osmo-stp_10.42.42.5(pid=24058): stdout: | (launched: 2022-12-09_22:27:11.478340) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:13.211676 run osmo-stp_10.42.42.5(pid=24058): stderr: | 20221209222711648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222711648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222711649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222711649 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222711649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222711650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222711650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:13.356499 run patchelf(pid=24061): Terminating (SIGINT) 22:27:13.527005 run patchelf(pid=24061): Terminated: ok {rc=0} 22:27:13.649178 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24058): Process ended prematurely: osmo-stp_10.42.42.5(pid=24058) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24058)] [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 22:27:13.658507 tst iperf3.py:8: Test FAILED (7.5 sec) 22:27:13.685847 run osmo-hlr_10.42.42.2(pid=24055): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24055)] 22:27:13.733282 run osmo-hlr_10.42.42.2(pid=24055): stdout: | (launched: 2022-12-09_22:27:10.526616) 22:27:13.782624 run osmo-hlr_10.42.42.2(pid=24055): stderr: | 20221209222710702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222710702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222710702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222710702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222710702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222710702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222710714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222710722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222710723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222710723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:13.832133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24050): Terminating (SIGTERM) 22:27:13.871774 run iperf3-srv_10.42.42.10(pid=24051): Terminating (SIGTERM) 22:27:13.911363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24054): Terminating (SIGTERM) 22:27:13.950875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24057): Terminating (SIGTERM) 22:27:13.990661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24060): Terminating (SIGTERM) 22:27:14.030476 --- ParallelTerminationStrategy: PID 24050 died... 22:27:14.049312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24050): Terminated: ok {rc=0} 22:27:14.093424 --- ParallelTerminationStrategy: PID 24051 died... 22:27:14.111952 run iperf3-srv_10.42.42.10(pid=24051): Terminated {rc=256} 22:27:14.156046 --- ParallelTerminationStrategy: PID 24054 died... 22:27:14.174452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24054): Terminated: ok {rc=0} 22:27:14.218546 --- ParallelTerminationStrategy: PID 24057 died... 22:27:14.237181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24057): Terminated: ok {rc=0} 22:27:14.281241 --- ParallelTerminationStrategy: PID 24060 died... 22:27:14.299700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24060): Terminated: ok {rc=0} 22:27:14.385771 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:27:15.532549 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:15.544111 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:27:15.614367 tst iperf3m4.py: using LAC 24085 22:27:15.733168 tst iperf3m4.py: using RAC 115 22:27:15.859168 tst iperf3m4.py: using CellId 24085 22:27:15.997701 tst iperf3m4.py: using BVCI 24086 22:27:16.152524 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:16.168940 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:16.185766 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:16.201967 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:16.218932 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:16.235852 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:16.251893 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:16.268796 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:16.285820 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:16.445500 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:16.591745 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:16.744233 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:16.899190 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:27:17.126408 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:17.433124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24062): Launched 22:27:17.696290 run iperf3-srv_10.42.42.10(pid=24063): Launched 22:27:17.809275 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:27:18.010037 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:18.310305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24064): Launched 22:27:18.571565 run iperf3-srv_10.42.42.10(pid=24065): Launched 22:27:18.685250 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:27:18.886344 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:19.187041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24066): Launched 22:27:19.447692 run iperf3-srv_10.42.42.10(pid=24067): Launched 22:27:19.560574 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:27:19.761250 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:20.062025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24068): Launched 22:27:20.323237 run iperf3-srv_10.42.42.10(pid=24069): Launched 22:27:20.436060 tst iperf3m4.py:8: start network... 22:27:20.636931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:21.101233 run create_hlr_db(pid=24070): Launched 22:27:21.216093 bus /gobi_6: Setting Powered False 22:27:22.275569 run create_hlr_db(pid=24070): Terminated: ok {rc=0} 22:27:22.695352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24072): Launched 22:27:22.996841 run osmo-hlr_10.42.42.2(pid=24073): Launched 22:27:23.111838 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:23.645262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24075): Launched 22:27:23.945190 run osmo-stp_10.42.42.5(pid=24076): Launched 22:27:24.059710 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:27:24.577830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24078): Launched 22:27:24.693591 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:27:24.946589 run patchelf(pid=24079): Launched 22:27:25.114454 run osmo-stp_10.42.42.5(pid=24076): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24076)] 22:27:25.242132 run osmo-stp_10.42.42.5(pid=24076): stdout: | (launched: 2022-12-09_22:27:23.890784) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:25.370933 run osmo-stp_10.42.42.5(pid=24076): stderr: | 20221209222724059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222724059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222724060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222724060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222724061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222724061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222724061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:25.499901 run osmo-stp_10.42.42.5(pid=24076): stdout: | (launched: 2022-12-09_22:27:23.890784) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:25.622760 run osmo-stp_10.42.42.5(pid=24076): stderr: | 20221209222724059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222724059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222724060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222724060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222724061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222724061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222724061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:25.767612 run patchelf(pid=24079): Terminating (SIGINT) 22:27:25.938061 run patchelf(pid=24079): Terminated: ok {rc=0} 22:27:26.060832 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24076): Process ended prematurely: osmo-stp_10.42.42.5(pid=24076) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24076)] [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:27:26.070349 tst iperf3m4.py:8: Test FAILED (10.6 sec) 22:27:26.098188 run osmo-hlr_10.42.42.2(pid=24073): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24073)] 22:27:26.145794 run osmo-hlr_10.42.42.2(pid=24073): stdout: | (launched: 2022-12-09_22:27:22.941827) 22:27:26.195779 run osmo-hlr_10.42.42.2(pid=24073): stderr: | 20221209222723121 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222723121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222723121 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222723121 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222723121 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222723121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222723136 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222723144 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222723144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222723145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:26.245853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24062): Terminating (SIGTERM) 22:27:26.285570 run iperf3-srv_10.42.42.10(pid=24063): Terminating (SIGTERM) 22:27:26.325207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24064): Terminating (SIGTERM) 22:27:26.364828 run iperf3-srv_10.42.42.10(pid=24065): Terminating (SIGTERM) 22:27:26.404217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24066): Terminating (SIGTERM) 22:27:26.443817 run iperf3-srv_10.42.42.10(pid=24067): Terminating (SIGTERM) 22:27:26.483224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24068): Terminating (SIGTERM) 22:27:26.522839 run iperf3-srv_10.42.42.10(pid=24069): Terminating (SIGTERM) 22:27:26.562263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24072): Terminating (SIGTERM) 22:27:26.602027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24075): Terminating (SIGTERM) 22:27:26.641681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24078): Terminating (SIGTERM) 22:27:26.681757 --- ParallelTerminationStrategy: PID 24062 died... 22:27:26.700801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24062): Terminated: ok {rc=0} 22:27:26.745646 --- ParallelTerminationStrategy: PID 24063 died... 22:27:26.764202 run iperf3-srv_10.42.42.10(pid=24063): Terminated {rc=256} 22:27:26.808458 --- ParallelTerminationStrategy: PID 24064 died... 22:27:26.827502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24064): Terminated: ok {rc=0} 22:27:26.872056 --- ParallelTerminationStrategy: PID 24065 died... 22:27:26.890538 run iperf3-srv_10.42.42.10(pid=24065): Terminated {rc=256} 22:27:26.934602 --- ParallelTerminationStrategy: PID 24066 died... 22:27:26.952897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24066): Terminated: ok {rc=0} 22:27:26.997149 --- ParallelTerminationStrategy: PID 24067 died... 22:27:27.015584 run iperf3-srv_10.42.42.10(pid=24067): Terminated {rc=256} 22:27:27.059790 --- ParallelTerminationStrategy: PID 24068 died... 22:27:27.078631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24068): Terminated: ok {rc=0} 22:27:27.122998 --- ParallelTerminationStrategy: PID 24069 died... 22:27:27.141545 run iperf3-srv_10.42.42.10(pid=24069): Terminated {rc=256} 22:27:27.185582 --- ParallelTerminationStrategy: PID 24072 died... 22:27:27.204064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24072): Terminated: ok {rc=0} 22:27:27.247987 --- ParallelTerminationStrategy: PID 24075 died... 22:27:27.266394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24075): Terminated: ok {rc=0} 22:27:27.310160 --- ParallelTerminationStrategy: PID 24078 died... 22:27:27.328631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24078): Terminated: ok {rc=0} 22:27:27.415330 bus /gobi_4: Setting Powered False 22:27:28.515788 bus /gobi_4: Setting Powered False 22:27:29.632364 bus /gobi_1: Setting Powered False 22:27:30.732930 bus /gobi_1: Setting Powered False 22:27:31.847951 bus /gobi_0: Setting Powered False 22:27:32.948159 bus /gobi_0: Setting Powered False 22:27:34.065613 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:27:35.166527 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:35.178019 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:27:35.248378 tst ping.py: using LAC 24086 22:27:35.362477 tst ping.py: using RAC 116 22:27:35.478014 tst ping.py: using CellId 24086 22:27:35.593390 tst ping.py: using BVCI 24087 22:27:35.701792 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:35.712656 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:35.723358 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:35.734385 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:35.745322 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:35.756208 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:35.767239 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:35.778057 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:35.896609 tst ping.py:19: start network... 22:27:36.107500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:36.595362 run create_hlr_db(pid=24082): Launched 22:27:36.723641 bus /gobi_6: Setting Powered False 22:27:37.786155 run create_hlr_db(pid=24082): Terminated: ok {rc=0} 22:27:38.225316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24084): Launched 22:27:38.538888 run osmo-hlr_10.42.42.2(pid=24085): Launched 22:27:38.659450 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:39.197983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24087): Launched 22:27:39.510109 run osmo-stp_10.42.42.5(pid=24088): Launched 22:27:39.630064 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:27:40.170347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24090): Launched 22:27:40.290662 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:27:40.555918 run patchelf(pid=24091): Launched 22:27:40.730984 run osmo-stp_10.42.42.5(pid=24088): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24088)] 22:27:40.865380 run osmo-stp_10.42.42.5(pid=24088): stdout: | (launched: 2022-12-09_22:27:39.453680) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:41.000541 run osmo-stp_10.42.42.5(pid=24088): stderr: | 20221209222739645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222739646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222739646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222739646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222739647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222739647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222739647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:41.136055 run osmo-stp_10.42.42.5(pid=24088): stdout: | (launched: 2022-12-09_22:27:39.453680) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:41.264912 run osmo-stp_10.42.42.5(pid=24088): stderr: | 20221209222739645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222739646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222739646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222739646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222739647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222739647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222739647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:41.417805 run patchelf(pid=24091): Terminating (SIGINT) 22:27:41.596286 run patchelf(pid=24091): Terminated: ok {rc=0} 22:27:41.724196 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24088): Process ended prematurely: osmo-stp_10.42.42.5(pid=24088) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24088)] [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 22:27:41.733676 tst ping.py:22: Test FAILED (6.6 sec) 22:27:41.761763 run osmo-hlr_10.42.42.2(pid=24085): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24085)] 22:27:41.811920 run osmo-hlr_10.42.42.2(pid=24085): stdout: | (launched: 2022-12-09_22:27:38.481971) 22:27:41.863568 run osmo-hlr_10.42.42.2(pid=24085): stderr: | 20221209222738678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222738678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222738678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222738678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222738678 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222738678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222738694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222738702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222738702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222738702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:41.915591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24084): Terminating (SIGTERM) 22:27:41.957317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24087): Terminating (SIGTERM) 22:27:41.999076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24090): Terminating (SIGTERM) 22:27:42.041108 --- ParallelTerminationStrategy: PID 24084 died... 22:27:42.061101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24084): Terminated: ok {rc=0} 22:27:42.107295 --- ParallelTerminationStrategy: PID 24087 died... 22:27:42.126913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24087): Terminated: ok {rc=0} 22:27:42.172730 --- ParallelTerminationStrategy: PID 24090 died... 22:27:42.192183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24090): Terminated: ok {rc=0} 22:27:42.280281 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:27:43.367589 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:43.379633 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:27:43.454334 tst ping_idle_ping.py: using LAC 24087 22:27:43.579169 tst ping_idle_ping.py: using RAC 117 22:27:43.704575 tst ping_idle_ping.py: using CellId 24087 22:27:43.821269 tst ping_idle_ping.py: using BVCI 24088 22:27:43.928732 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:43.939761 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:43.950747 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:43.962147 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:43.973428 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:43.984643 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:43.995859 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:44.006990 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:44.124779 tst ping_idle_ping.py:24: start network... 22:27:44.336549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:44.824242 run create_hlr_db(pid=24092): Launched 22:27:44.952560 bus /gobi_6: Setting Powered False 22:27:46.014211 run create_hlr_db(pid=24092): Terminated: ok {rc=0} 22:27:46.464628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24094): Launched 22:27:46.793259 run osmo-hlr_10.42.42.2(pid=24095): Launched 22:27:47.036519 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:47.574134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24097): Launched 22:27:47.872167 run osmo-stp_10.42.42.5(pid=24098): Launched 22:27:47.985564 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:27:48.497393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24100): Launched 22:27:48.613128 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:27:48.865560 run patchelf(pid=24101): Launched 22:27:49.032915 run osmo-stp_10.42.42.5(pid=24098): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24098)] 22:27:49.160701 run osmo-stp_10.42.42.5(pid=24098): stdout: | (launched: 2022-12-09_22:27:47.817917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:49.289881 run osmo-stp_10.42.42.5(pid=24098): stderr: | 20221209222747987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222747987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222747987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222747988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222747988 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222747988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222747988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:49.419277 run osmo-stp_10.42.42.5(pid=24098): stdout: | (launched: 2022-12-09_22:27:47.817917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:49.542277 run osmo-stp_10.42.42.5(pid=24098): stderr: | 20221209222747987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222747987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222747987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222747988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222747988 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222747988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222747988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:49.687741 run patchelf(pid=24101): Terminating (SIGINT) 22:27:49.857950 run patchelf(pid=24101): Terminated: ok {rc=0} 22:27:49.980000 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24098): Process ended prematurely: osmo-stp_10.42.42.5(pid=24098) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24098)] [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:27:49.988860 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:27:50.015680 run osmo-hlr_10.42.42.2(pid=24095): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24095)] 22:27:50.063364 run osmo-hlr_10.42.42.2(pid=24095): stdout: | (launched: 2022-12-09_22:27:46.730683) 22:27:50.112515 run osmo-hlr_10.42.42.2(pid=24095): stderr: | 20221209222747046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222747046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222747046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222747046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222747046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222747047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222747063 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222747076 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222747076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222747076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:50.162184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24094): Terminating (SIGTERM) 22:27:50.201582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24097): Terminating (SIGTERM) 22:27:50.241159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24100): Terminating (SIGTERM) 22:27:50.281046 --- ParallelTerminationStrategy: PID 24094 died... 22:27:50.300163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24094): Terminated: ok {rc=0} 22:27:50.344593 --- ParallelTerminationStrategy: PID 24097 died... 22:27:50.363299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24097): Terminated: ok {rc=0} 22:27:50.407493 --- ParallelTerminationStrategy: PID 24100 died... 22:27:50.426043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24100): Terminated: ok {rc=0} 22:27:50.512604 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:27:51.812775 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:27:51.819386 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:27:51.852206 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 22:27:51.899094 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 22:27:51.986734 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:27:52.019294 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 22:27:52.057333 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 22:27:52.663066 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 22:27:52.712487 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:52.723756 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:27:52.777623 tst cs_paging_gprs_active.py: using LAC 24088 22:27:52.897063 tst cs_paging_gprs_active.py: using RAC 118 22:27:53.024710 tst cs_paging_gprs_active.py: using CellId 24088 22:27:53.154623 tst cs_paging_gprs_active.py: using BVCI 24089 22:27:53.272258 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:53.284057 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:53.295447 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:53.307056 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:53.318506 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:53.329900 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:53.341396 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:53.352699 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:53.364377 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:27:53.480715 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:27:53.598270 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:27:53.801835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:54.104182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24105): Launched 22:27:54.367681 run iperf3-srv_10.42.42.10(pid=24106): Launched 22:27:54.481391 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:27:54.683314 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:54.991974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24107): Launched 22:27:55.274490 run iperf3-srv_10.42.42.10(pid=24108): Launched 22:27:55.395706 tst cs_paging_gprs_active.py:38: start network... 22:27:55.613669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:56.112932 run create_hlr_db(pid=24109): Launched 22:27:56.244465 bus /gobi_6: Setting Powered False 22:27:57.308673 run create_hlr_db(pid=24109): Terminated: ok {rc=0} 22:27:57.756420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24111): Launched 22:27:58.077689 run osmo-hlr_10.42.42.2(pid=24112): Launched 22:27:58.200736 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:58.756270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24114): Launched 22:27:59.077740 run osmo-stp_10.42.42.5(pid=24115): Launched 22:27:59.200779 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:27:59.752552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24117): Launched 22:27:59.876308 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:00.146275 run patchelf(pid=24118): Launched 22:28:00.325232 run osmo-stp_10.42.42.5(pid=24115): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24115)] 22:28:00.460819 run osmo-stp_10.42.42.5(pid=24115): stdout: | (launched: 2022-12-09_22:27:59.019722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:00.598601 run osmo-stp_10.42.42.5(pid=24115): stderr: | 20221209222759210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222759210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222759210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222759210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222759211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222759211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222759211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:00.737122 run osmo-stp_10.42.42.5(pid=24115): stdout: | (launched: 2022-12-09_22:27:59.019722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:00.875787 run osmo-stp_10.42.42.5(pid=24115): stderr: | 20221209222759210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222759210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222759210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222759210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222759211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222759211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222759211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:01.049616 run patchelf(pid=24118): Terminating (SIGINT) 22:28:01.224908 run patchelf(pid=24118): Terminated: ok {rc=0} 22:28:01.398220 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24115): Process ended prematurely: osmo-stp_10.42.42.5(pid=24115) [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24115)] [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 22:28:01.409737 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:28:01.441665 run osmo-hlr_10.42.42.2(pid=24112): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24112)] 22:28:01.497610 run osmo-hlr_10.42.42.2(pid=24112): stdout: | (launched: 2022-12-09_22:27:58.019600) 22:28:01.562672 run osmo-hlr_10.42.42.2(pid=24112): stderr: | 20221209222758218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222758219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222758219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222758219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222758219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222758219 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222758231 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222758240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222758240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222758240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:01.627704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24105): Terminating (SIGTERM) 22:28:01.683033 run iperf3-srv_10.42.42.10(pid=24106): Terminating (SIGTERM) 22:28:01.741279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24107): Terminating (SIGTERM) 22:28:01.785534 run iperf3-srv_10.42.42.10(pid=24108): Terminating (SIGTERM) 22:28:01.831727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24111): Terminating (SIGTERM) 22:28:01.875466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24114): Terminating (SIGTERM) 22:28:01.920282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24117): Terminating (SIGTERM) 22:28:01.965481 --- ParallelTerminationStrategy: PID 24105 died... 22:28:01.985539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24105): Terminated: ok {rc=0} 22:28:02.035529 --- ParallelTerminationStrategy: PID 24106 died... 22:28:02.055474 run iperf3-srv_10.42.42.10(pid=24106): Terminated {rc=256} 22:28:02.102683 --- ParallelTerminationStrategy: PID 24107 died... 22:28:02.122245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24107): Terminated: ok {rc=0} 22:28:02.169504 --- ParallelTerminationStrategy: PID 24108 died... 22:28:02.188898 run iperf3-srv_10.42.42.10(pid=24108): Terminated {rc=256} 22:28:02.237223 --- ParallelTerminationStrategy: PID 24111 died... 22:28:02.256588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24111): Terminated: ok {rc=0} 22:28:02.303869 --- ParallelTerminationStrategy: PID 24114 died... 22:28:02.322597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24114): Terminated: ok {rc=0} 22:28:02.368067 --- ParallelTerminationStrategy: PID 24117 died... 22:28:02.386779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24117): Terminated: ok {rc=0} 22:28:02.472136 bus /gobi_0: Setting Powered False 22:28:03.571434 bus /gobi_0: Setting Powered False 22:28:04.689921 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 22:28:05.840437 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:05.853123 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:28:05.908027 tst iperf3.py: using LAC 24089 22:28:06.033483 tst iperf3.py: using RAC 119 22:28:06.160287 tst iperf3.py: using CellId 24089 22:28:06.283759 tst iperf3.py: using BVCI 24090 22:28:06.400693 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:06.412429 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:06.423914 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:06.435335 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:06.446808 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:06.458245 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:06.469813 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:06.481137 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:06.492758 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:06.607835 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:28:06.810286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:07.112685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24119): Launched 22:28:07.375445 run iperf3-srv_10.42.42.10(pid=24120): Launched 22:28:07.489104 tst iperf3.py:8: start network... 22:28:07.692121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:08.157325 run create_hlr_db(pid=24121): Launched 22:28:08.273089 bus /gobi_6: Setting Powered False 22:28:09.333318 run create_hlr_db(pid=24121): Terminated: ok {rc=0} 22:28:09.751956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24123): Launched 22:28:10.052601 run osmo-hlr_10.42.42.2(pid=24124): Launched 22:28:10.168247 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:10.704203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24126): Launched 22:28:11.005549 run osmo-stp_10.42.42.5(pid=24127): Launched 22:28:11.122307 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:11.645801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24129): Launched 22:28:11.761874 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:12.016467 run patchelf(pid=24130): Launched 22:28:12.185601 run osmo-stp_10.42.42.5(pid=24127): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24127)] 22:28:12.314327 run osmo-stp_10.42.42.5(pid=24127): stdout: | (launched: 2022-12-09_22:28:10.950558) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:12.444307 run osmo-stp_10.42.42.5(pid=24127): stderr: | 20221209222811120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222811120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222811120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222811121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222811121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222811121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222811122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:12.574226 run osmo-stp_10.42.42.5(pid=24127): stdout: | (launched: 2022-12-09_22:28:10.950558) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:12.697794 run osmo-stp_10.42.42.5(pid=24127): stderr: | 20221209222811120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222811120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222811120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222811121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222811121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222811121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222811122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:12.844124 run patchelf(pid=24130): Terminating (SIGINT) 22:28:13.015876 run patchelf(pid=24130): Terminated: ok {rc=0} 22:28:13.139949 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24127): Process ended prematurely: osmo-stp_10.42.42.5(pid=24127) [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24127)] [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 22:28:13.149501 tst iperf3.py:8: Test FAILED (7.3 sec) 22:28:13.176871 run osmo-hlr_10.42.42.2(pid=24124): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24124)] 22:28:13.224848 run osmo-hlr_10.42.42.2(pid=24124): stdout: | (launched: 2022-12-09_22:28:09.998295) 22:28:13.274304 run osmo-hlr_10.42.42.2(pid=24124): stderr: | 20221209222810175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222810175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222810175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222810175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222810175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222810175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222810187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222810197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222810197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222810198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:13.324409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24119): Terminating (SIGTERM) 22:28:13.364169 run iperf3-srv_10.42.42.10(pid=24120): Terminating (SIGTERM) 22:28:13.403877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24123): Terminating (SIGTERM) 22:28:13.443730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24126): Terminating (SIGTERM) 22:28:13.483612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24129): Terminating (SIGTERM) 22:28:13.523608 --- ParallelTerminationStrategy: PID 24119 died... 22:28:13.542641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24119): Terminated: ok {rc=0} 22:28:13.586905 --- ParallelTerminationStrategy: PID 24120 died... 22:28:13.605248 run iperf3-srv_10.42.42.10(pid=24120): Terminated {rc=256} 22:28:13.649227 --- ParallelTerminationStrategy: PID 24123 died... 22:28:13.667679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24123): Terminated: ok {rc=0} 22:28:13.711880 --- ParallelTerminationStrategy: PID 24126 died... 22:28:13.730372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24126): Terminated: ok {rc=0} 22:28:13.774520 --- ParallelTerminationStrategy: PID 24129 died... 22:28:13.793103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24129): Terminated: ok {rc=0} 22:28:13.879373 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 22:28:15.026332 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:15.038289 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:28:15.090182 tst iperf3m4.py: using LAC 24090 22:28:15.207715 tst iperf3m4.py: using RAC 120 22:28:15.326724 tst iperf3m4.py: using CellId 24090 22:28:15.444406 tst iperf3m4.py: using BVCI 24091 22:28:15.553195 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:15.564250 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:15.575192 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:15.586513 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:15.597753 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:15.608799 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:15.620102 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:15.631328 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:15.642677 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:15.759457 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:15.880881 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:16.016164 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:16.143552 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:28:16.386809 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:16.705717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24131): Launched 22:28:16.990744 run iperf3-srv_10.42.42.10(pid=24132): Launched 22:28:17.111773 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:28:17.316072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:17.618906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24133): Launched 22:28:17.880318 run iperf3-srv_10.42.42.10(pid=24134): Launched 22:28:17.993421 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:28:18.194674 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:18.495856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24135): Launched 22:28:18.758192 run iperf3-srv_10.42.42.10(pid=24136): Launched 22:28:18.871103 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:28:19.071851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:19.373454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24137): Launched 22:28:19.637164 run iperf3-srv_10.42.42.10(pid=24138): Launched 22:28:19.750224 tst iperf3m4.py:8: start network... 22:28:19.951049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:20.415846 run create_hlr_db(pid=24139): Launched 22:28:20.531188 bus /gobi_6: Setting Powered False 22:28:21.591503 run create_hlr_db(pid=24139): Terminated: ok {rc=0} 22:28:22.029630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24141): Launched 22:28:22.353574 run osmo-hlr_10.42.42.2(pid=24142): Launched 22:28:22.477973 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:23.034950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24144): Launched 22:28:23.355127 run osmo-stp_10.42.42.5(pid=24145): Launched 22:28:23.477685 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:24.031857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24147): Launched 22:28:24.155070 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:24.425973 run patchelf(pid=24148): Launched 22:28:24.605534 run osmo-stp_10.42.42.5(pid=24145): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24145)] 22:28:24.742242 run osmo-stp_10.42.42.5(pid=24145): stdout: | (launched: 2022-12-09_22:28:23.296924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:24.879822 run osmo-stp_10.42.42.5(pid=24145): stderr: | 20221209222823487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222823487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222823488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222823488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222823489 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222823489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222823489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:25.017527 run osmo-stp_10.42.42.5(pid=24145): stdout: | (launched: 2022-12-09_22:28:23.296924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:25.149195 run osmo-stp_10.42.42.5(pid=24145): stderr: | 20221209222823487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222823487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222823488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222823488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222823489 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222823489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222823489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:25.305265 run patchelf(pid=24148): Terminating (SIGINT) 22:28:25.486862 run patchelf(pid=24148): Terminated: ok {rc=0} 22:28:25.617754 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24145): Process ended prematurely: osmo-stp_10.42.42.5(pid=24145) [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24145)] [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 22:28:25.627870 tst iperf3m4.py:8: Test FAILED (10.6 sec) 22:28:25.656687 run osmo-hlr_10.42.42.2(pid=24142): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24142)] 22:28:25.706916 run osmo-hlr_10.42.42.2(pid=24142): stdout: | (launched: 2022-12-09_22:28:22.295019) 22:28:25.758817 run osmo-hlr_10.42.42.2(pid=24142): stderr: | 20221209222822494 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222822494 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222822494 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222822494 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222822494 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222822494 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222822507 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222822517 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222822518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222822518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:25.811397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24131): Terminating (SIGTERM) 22:28:25.853519 run iperf3-srv_10.42.42.10(pid=24132): Terminating (SIGTERM) 22:28:25.895457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24133): Terminating (SIGTERM) 22:28:25.937447 run iperf3-srv_10.42.42.10(pid=24134): Terminating (SIGTERM) 22:28:25.979246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24135): Terminating (SIGTERM) 22:28:26.021232 run iperf3-srv_10.42.42.10(pid=24136): Terminating (SIGTERM) 22:28:26.062997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24137): Terminating (SIGTERM) 22:28:26.105041 run iperf3-srv_10.42.42.10(pid=24138): Terminating (SIGTERM) 22:28:26.146802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24141): Terminating (SIGTERM) 22:28:26.188669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24144): Terminating (SIGTERM) 22:28:26.230529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24147): Terminating (SIGTERM) 22:28:26.272611 --- ParallelTerminationStrategy: PID 24131 died... 22:28:26.293120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24131): Terminated: ok {rc=0} 22:28:26.339542 --- ParallelTerminationStrategy: PID 24132 died... 22:28:26.359018 run iperf3-srv_10.42.42.10(pid=24132): Terminated {rc=256} 22:28:26.405340 --- ParallelTerminationStrategy: PID 24133 died... 22:28:26.425058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24133): Terminated: ok {rc=0} 22:28:26.471315 --- ParallelTerminationStrategy: PID 24134 died... 22:28:26.491054 run iperf3-srv_10.42.42.10(pid=24134): Terminated {rc=256} 22:28:26.537481 --- ParallelTerminationStrategy: PID 24135 died... 22:28:26.557284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24135): Terminated: ok {rc=0} 22:28:26.603819 --- ParallelTerminationStrategy: PID 24136 died... 22:28:26.623590 run iperf3-srv_10.42.42.10(pid=24136): Terminated {rc=256} 22:28:26.670442 --- ParallelTerminationStrategy: PID 24137 died... 22:28:26.690410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24137): Terminated: ok {rc=0} 22:28:26.736731 --- ParallelTerminationStrategy: PID 24138 died... 22:28:26.756405 run iperf3-srv_10.42.42.10(pid=24138): Terminated {rc=256} 22:28:26.802760 --- ParallelTerminationStrategy: PID 24141 died... 22:28:26.822709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24141): Terminated: ok {rc=0} 22:28:26.869174 --- ParallelTerminationStrategy: PID 24144 died... 22:28:26.888907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24144): Terminated: ok {rc=0} 22:28:26.935489 --- ParallelTerminationStrategy: PID 24147 died... 22:28:26.955247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24147): Terminated: ok {rc=0} 22:28:27.044163 bus /gobi_4: Setting Powered False 22:28:28.144036 bus /gobi_4: Setting Powered False 22:28:29.260343 bus /gobi_1: Setting Powered False 22:28:30.359826 bus /gobi_1: Setting Powered False 22:28:31.476377 bus /gobi_0: Setting Powered False 22:28:32.574143 bus /gobi_0: Setting Powered False 22:28:33.691551 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 22:28:34.794742 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:34.806774 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:28:34.859200 tst ping.py: using LAC 24091 22:28:34.975981 tst ping.py: using RAC 121 22:28:35.090520 tst ping.py: using CellId 24091 22:28:35.207508 tst ping.py: using BVCI 24092 22:28:35.314113 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:35.325522 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:35.336527 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:35.347924 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:35.359284 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:35.370843 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:35.382433 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:35.393596 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:35.510750 tst ping.py:19: start network... 22:28:35.723094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:36.208278 run create_hlr_db(pid=24149): Launched 22:28:36.335968 bus /gobi_6: Setting Powered False 22:28:37.398498 run create_hlr_db(pid=24149): Terminated: ok {rc=0} 22:28:37.836884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24151): Launched 22:28:38.149655 run osmo-hlr_10.42.42.2(pid=24152): Launched 22:28:38.270463 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:38.817140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24154): Launched 22:28:39.131361 run osmo-stp_10.42.42.5(pid=24155): Launched 22:28:39.251538 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:39.794571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24157): Launched 22:28:39.915411 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:40.181662 run patchelf(pid=24158): Launched 22:28:40.358194 run osmo-stp_10.42.42.5(pid=24155): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24155)] 22:28:40.492686 run osmo-stp_10.42.42.5(pid=24155): stdout: | (launched: 2022-12-09_22:28:39.074288) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:40.629308 run osmo-stp_10.42.42.5(pid=24155): stderr: | 20221209222839265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222839266 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222839266 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222839266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222839267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222839267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222839267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:40.765633 run osmo-stp_10.42.42.5(pid=24155): stdout: | (launched: 2022-12-09_22:28:39.074288) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:40.895233 run osmo-stp_10.42.42.5(pid=24155): stderr: | 20221209222839265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222839266 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222839266 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222839266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222839267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222839267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222839267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:41.048555 run patchelf(pid=24158): Terminating (SIGINT) 22:28:41.228079 run patchelf(pid=24158): Terminated: ok {rc=0} 22:28:41.358024 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24155): Process ended prematurely: osmo-stp_10.42.42.5(pid=24155) [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24155)] [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 22:28:41.367615 tst ping.py:22: Test FAILED (6.6 sec) 22:28:41.395692 run osmo-hlr_10.42.42.2(pid=24152): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24152)] 22:28:41.445621 run osmo-hlr_10.42.42.2(pid=24152): stdout: | (launched: 2022-12-09_22:28:38.092924) 22:28:41.497497 run osmo-hlr_10.42.42.2(pid=24152): stderr: | 20221209222838290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222838290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222838290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222838290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222838290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222838291 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222838304 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222838312 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222838312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222838313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:41.549834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24151): Terminating (SIGTERM) 22:28:41.592187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24154): Terminating (SIGTERM) 22:28:41.634460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24157): Terminating (SIGTERM) 22:28:41.677135 --- ParallelTerminationStrategy: PID 24151 died... 22:28:41.697155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24151): Terminated: ok {rc=0} 22:28:41.743449 --- ParallelTerminationStrategy: PID 24154 died... 22:28:41.763110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24154): Terminated: ok {rc=0} 22:28:41.809151 --- ParallelTerminationStrategy: PID 24157 died... 22:28:41.828704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24157): Terminated: ok {rc=0} 22:28:41.916526 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 22:28:43.005078 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:43.017525 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:28:43.071985 tst ping_idle_ping.py: using LAC 24092 22:28:43.197081 tst ping_idle_ping.py: using RAC 122 22:28:43.322921 tst ping_idle_ping.py: using CellId 24092 22:28:43.448018 tst ping_idle_ping.py: using BVCI 24093 22:28:43.561749 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:43.573715 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:43.585773 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:43.597574 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:43.608854 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:43.620494 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:43.632382 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:43.643813 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:43.764328 tst ping_idle_ping.py:24: start network... 22:28:43.976765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:44.465390 run create_hlr_db(pid=24160): Launched 22:28:44.594470 bus /gobi_6: Setting Powered False 22:28:45.657696 run create_hlr_db(pid=24160): Terminated: ok {rc=0} 22:28:46.138177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24162): Launched 22:28:46.470098 run osmo-hlr_10.42.42.2(pid=24163): Launched 22:28:46.703555 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:47.344431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24165): Launched 22:28:47.659977 run osmo-stp_10.42.42.5(pid=24166): Launched 22:28:47.780697 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:48.324413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24168): Launched 22:28:48.445634 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:48.712885 run patchelf(pid=24169): Launched 22:28:48.888596 run osmo-stp_10.42.42.5(pid=24166): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24166)] 22:28:49.022994 run osmo-stp_10.42.42.5(pid=24166): stdout: | (launched: 2022-12-09_22:28:47.602666) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:49.159070 run osmo-stp_10.42.42.5(pid=24166): stderr: | 20221209222847794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222847794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222847794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222847795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222847795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222847795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222847795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:49.294904 run osmo-stp_10.42.42.5(pid=24166): stdout: | (launched: 2022-12-09_22:28:47.602666) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:49.424904 run osmo-stp_10.42.42.5(pid=24166): stderr: | 20221209222847794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222847794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222847794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222847795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222847795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222847795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222847795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:49.578844 run patchelf(pid=24169): Terminating (SIGINT) 22:28:49.757697 run patchelf(pid=24169): Terminated: ok {rc=0} 22:28:49.885746 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24166): Process ended prematurely: osmo-stp_10.42.42.5(pid=24166) [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24166)] [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 22:28:49.895297 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 22:28:49.923242 run osmo-hlr_10.42.42.2(pid=24163): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24163)] 22:28:49.973385 run osmo-hlr_10.42.42.2(pid=24163): stdout: | (launched: 2022-12-09_22:28:46.406828) 22:28:50.025340 run osmo-hlr_10.42.42.2(pid=24163): stderr: | 20221209222846732 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222846732 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222846732 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222846732 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222846732 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222846732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222846744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222846756 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222846756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222846756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:50.077487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24162): Terminating (SIGTERM) 22:28:50.119395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24165): Terminating (SIGTERM) 22:28:50.161614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24168): Terminating (SIGTERM) 22:28:50.203974 --- ParallelTerminationStrategy: PID 24162 died... 22:28:50.224212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24162): Terminated: ok {rc=0} 22:28:50.270946 --- ParallelTerminationStrategy: PID 24165 died... 22:28:50.290566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24165): Terminated: ok {rc=0} 22:28:50.336848 --- ParallelTerminationStrategy: PID 24168 died... 22:28:50.356863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24168): Terminated: ok {rc=0} 22:28:50.445054 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:28:51.760134 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:28:51.768603 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:28:51.803455 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:28:51.838610 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:28:51.892419 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:28:51.925540 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:28:51.960306 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:28:52.527127 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2365 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:28:52.533492 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:52.545561 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:28:52.619612 tst switch_tch_pdch.py: using LAC 24093 22:28:52.743482 tst switch_tch_pdch.py: using RAC 123 22:28:52.864849 tst switch_tch_pdch.py: using CellId 24093 22:28:52.986554 tst switch_tch_pdch.py: using BVCI 24094 22:28:53.100561 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:53.112266 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:53.123837 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:53.135232 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:53.146835 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:53.158201 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:53.170231 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:53.182116 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:28:53.298546 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:28:53.419273 tst switch_tch_pdch.py:51: start network... 22:28:53.631732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:54.116561 run create_hlr_db(pid=24173): Launched 22:28:54.244086 bus /gobi_6: Setting Powered False 22:28:55.306922 run create_hlr_db(pid=24173): Terminated: ok {rc=0} 22:28:55.730530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24175): Launched 22:28:56.026127 run osmo-hlr_10.42.42.2(pid=24176): Launched 22:28:56.139309 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:56.659301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24178): Launched 22:28:56.952940 run osmo-stp_10.42.42.5(pid=24179): Launched 22:28:57.067590 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:57.576295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24181): Launched 22:28:57.690557 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:57.940036 run patchelf(pid=24182): Launched 22:28:58.105565 run osmo-stp_10.42.42.5(pid=24179): ERR: Terminated: ERROR {rc=1} [trial-2365↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24179)] 22:28:58.231649 run osmo-stp_10.42.42.5(pid=24179): stdout: | (launched: 2022-12-09_22:28:56.899657) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:58.359458 run osmo-stp_10.42.42.5(pid=24179): stderr: | 20221209222857068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222857068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222857068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222857069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222857069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222857069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222857069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:58.487517 run osmo-stp_10.42.42.5(pid=24179): stdout: | (launched: 2022-12-09_22:28:56.899657) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:58.609130 run osmo-stp_10.42.42.5(pid=24179): stderr: | 20221209222857068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222857068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222857068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222857069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222857069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222857069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222857069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:58.752873 run patchelf(pid=24182): Terminating (SIGINT) 22:28:58.921199 run patchelf(pid=24182): Terminated: ok {rc=0} 22:28:59.042105 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24179): Process ended prematurely: osmo-stp_10.42.42.5(pid=24179) [trial-2365↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24179)] [trial-2365↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:28:59.050973 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 22:28:59.078259 run osmo-hlr_10.42.42.2(pid=24176): ERR: Terminated: ERROR {rc=237} [trial-2365↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24176)] 22:28:59.127120 run osmo-hlr_10.42.42.2(pid=24176): stdout: | (launched: 2022-12-09_22:28:55.972390) 22:28:59.177248 run osmo-hlr_10.42.42.2(pid=24176): stderr: | 20221209222856143 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222856143 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222856143 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222856143 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222856143 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222856144 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222856156 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222856164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222856165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222856165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:59.227639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24175): Terminating (SIGTERM) 22:28:59.268129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24178): Terminating (SIGTERM) 22:28:59.309303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24181): Terminating (SIGTERM) 22:28:59.349461 --- ParallelTerminationStrategy: PID 24175 died... 22:28:59.369185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24175): Terminated: ok {rc=0} 22:28:59.414799 --- ParallelTerminationStrategy: PID 24178 died... 22:28:59.433426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24178): Terminated: ok {rc=0} 22:28:59.479102 --- ParallelTerminationStrategy: PID 24181 died... 22:28:59.497637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24181): Terminated: ok {rc=0} 22:28:59.585364 bus /gobi_0: Setting Powered False 22:29:00.684534 bus /gobi_0: Setting Powered False 22:29:01.800821 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:29:03.057943 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:03.064312 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:29:03.098128 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:29:03.133677 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:29:03.188156 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:29:03.221451 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:29:03.256572 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:29:03.809634 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2365 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:29:03.815029 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:03.826127 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:29:03.898392 tst switch_tch_pdch.py: using LAC 24094 22:29:04.013825 tst switch_tch_pdch.py: using RAC 124 22:29:04.137419 tst switch_tch_pdch.py: using CellId 24094 22:29:04.258294 tst switch_tch_pdch.py: using BVCI 24095 22:29:04.372606 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:04.384158 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:04.395451 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:04.406555 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:04.417612 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:04.429330 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:04.440616 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:04.451938 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:29:04.567075 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:29:04.685622 tst switch_tch_pdch.py:51: start network... 22:29:04.884071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:05.314635 run create_hlr_db(pid=24186): Launched 22:29:05.427732 bus /gobi_6: Setting Powered False 22:29:06.486729 run create_hlr_db(pid=24186): Terminated: ok {rc=0} 22:29:06.874190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24188): Launched 22:29:07.168579 run osmo-hlr_10.42.42.2(pid=24189): Launched 22:29:07.281922 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:07.768093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24191): Launched 22:29:08.062767 run osmo-stp_10.42.42.5(pid=24192): Launched 22:29:08.174880 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:29:08.657326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24194): Launched 22:29:08.770553 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:29:09.019334 run patchelf(pid=24195): Launched 22:29:09.184117 run osmo-stp_10.42.42.5(pid=24192): ERR: Terminated: ERROR {rc=1} [trial-2365↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24192)] 22:29:09.309292 run osmo-stp_10.42.42.5(pid=24192): stdout: | (launched: 2022-12-09_22:29:08.009092) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:09.436338 run osmo-stp_10.42.42.5(pid=24192): stderr: | 20221209222908175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222908175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222908176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222908176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222908176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222908177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222908177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:09.564341 run osmo-stp_10.42.42.5(pid=24192): stdout: | (launched: 2022-12-09_22:29:08.009092) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:09.685188 run osmo-stp_10.42.42.5(pid=24192): stderr: | 20221209222908175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222908175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222908176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222908176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222908176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222908177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222908177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:09.827938 run patchelf(pid=24195): Terminating (SIGINT) 22:29:09.995061 run patchelf(pid=24195): Terminated: ok {rc=0} 22:29:10.115449 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24192): Process ended prematurely: osmo-stp_10.42.42.5(pid=24192) [trial-2365↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24192)] [trial-2365↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:29:10.124138 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 22:29:10.150930 run osmo-hlr_10.42.42.2(pid=24189): ERR: Terminated: ERROR {rc=237} [trial-2365↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24189)] 22:29:10.199045 run osmo-hlr_10.42.42.2(pid=24189): stdout: | (launched: 2022-12-09_22:29:07.114830) 22:29:10.248633 run osmo-hlr_10.42.42.2(pid=24189): stderr: | 20221209222907289 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222907289 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222907289 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222907289 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222907289 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222907289 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222907299 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222907308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222907308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222907308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:10.298548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24188): Terminating (SIGTERM) 22:29:10.338480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24191): Terminating (SIGTERM) 22:29:10.378435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24194): Terminating (SIGTERM) 22:29:10.418401 --- ParallelTerminationStrategy: PID 24188 died... 22:29:10.437421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24188): Terminated: ok {rc=0} 22:29:10.481820 --- ParallelTerminationStrategy: PID 24191 died... 22:29:10.500149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24191): Terminated: ok {rc=0} 22:29:10.544277 --- ParallelTerminationStrategy: PID 24194 died... 22:29:10.562924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24194): Terminated: ok {rc=0} 22:29:10.650138 bus /gobi_0: Setting Powered False 22:29:11.750956 bus /gobi_0: Setting Powered False 22:29:12.866745 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_sms:trx-lms --------------------------------------------------------------------- 22:29:14.112302 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:14.115986 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 22:29:14.150157 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 22:29:14.156677 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 22:29:14.211545 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 22:29:14.245989 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 22:29:14.253145 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 22:29:14.786601 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 22:29:14.793108 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 22:29:14.804161 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 22:29:14.853628 tst mo_mt_sms.py: using LAC 24095 22:29:14.980754 tst mo_mt_sms.py: using RAC 125 22:29:15.106392 tst mo_mt_sms.py: using CellId 24095 22:29:15.229251 tst mo_mt_sms.py: using BVCI 24096 22:29:15.342504 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 22:29:15.457355 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 22:29:15.569542 tst mo_mt_sms.py:9: start nitb and bts... 22:29:15.768643 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:29:16.425978 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24200): Launched 22:29:16.769753 run osmo-nitb_10.42.42.2(pid=24201): Launched 22:29:16.978831 run osmo-nitb_10.42.42.2(pid=24201): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24201)] 22:29:17.122801 run osmo-nitb_10.42.42.2(pid=24201): stdout: | (launched: 2022-12-09_22:29:16.701269) 22:29:17.260849 run osmo-nitb_10.42.42.2(pid=24201): stderr: | (launched: 2022-12-09_22:29:16.745871) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:29:17.395578 run osmo-nitb_10.42.42.2(pid=24201): stdout: | (launched: 2022-12-09_22:29:16.701269) 22:29:17.524421 run osmo-nitb_10.42.42.2(pid=24201): stderr: | (launched: 2022-12-09_22:29:16.745871) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24201): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24201) [trial-2365↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24201)] 22:29:17.921855 tst osmo-nitb_10.42.42.2(pid=24201): stdout: | (launched: 2022-12-09_22:29:16.701269) 22:29:18.042055 tst osmo-nitb_10.42.42.2(pid=24201): stderr: | (launched: 2022-12-09_22:29:16.745871) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:29:18.183716 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=24201): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24201) [trial-2365↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24201)] [trial-2365↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 22:29:18.192084 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 22:29:18.198702 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24200): Terminating (SIGTERM) 22:29:18.409165 --- ParallelTerminationStrategy: PID 24200 died... 22:29:18.429383 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24200): Terminated: ok {rc=0} 22:29:18.516788 bus /sierra_3: Setting Powered False 22:29:19.618170 bus /sierra_3: Setting Powered False 22:29:20.735025 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 sms:trx-lms --------------------------------------------------------------------- 22:29:21.939102 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:21.943602 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 22:29:21.977857 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 22:29:22.005193 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 22:29:22.057131 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 22:29:22.091069 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 22:29:22.118481 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 22:29:22.670903 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 22:29:22.676250 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:22.687376 tst sms:trx-lms: Using 1 x bts (candidates: 1) 22:29:22.736439 tst mo_mt_sms.py: using LAC 24096 22:29:22.857880 tst mo_mt_sms.py: using RAC 126 22:29:22.973642 tst mo_mt_sms.py: using CellId 24096 22:29:23.096571 tst mo_mt_sms.py: using BVCI 24097 22:29:23.210965 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:23.222025 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:23.233006 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:23.244067 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:23.255156 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:23.266310 tst sms:trx-lms: Using 1 x modem (candidates: 2) 22:29:23.382269 tst sms:trx-lms: Using 1 x modem (candidates: 2) 22:29:23.503528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:23.990545 run create_hlr_db(pid=24205): Launched 22:29:24.118583 bus /sierra_2: Setting Powered False 22:29:25.181323 run create_hlr_db(pid=24205): Terminated: ok {rc=0} 22:29:25.605178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24207): Launched 22:29:25.899598 run osmo-hlr_10.42.42.2(pid=24208): Launched 22:29:26.011726 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:26.531675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24210): Launched 22:29:26.825919 run osmo-stp_10.42.42.5(pid=24211): Launched 22:29:26.938231 run osmo-msc_10.42.42.6: Starting osmo-msc 22:29:27.470189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24213): Launched 22:29:27.765131 run osmo-msc_10.42.42.6(pid=24214): Launched 22:29:27.929304 run osmo-stp_10.42.42.5(pid=24211): ERR: Terminated: ERROR {rc=1} [trial-2365↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24211)] 22:29:28.053699 run osmo-stp_10.42.42.5(pid=24211): stdout: | (launched: 2022-12-09_22:29:26.771873) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:28.179565 run osmo-stp_10.42.42.5(pid=24211): stderr: | 20221209222926939 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222926939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222926940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222926940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222926940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222926941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222926941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:28.301640 run osmo-stp_10.42.42.5(pid=24211): stdout: | (launched: 2022-12-09_22:29:26.771873) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:28.418502 run osmo-stp_10.42.42.5(pid=24211): stderr: | 20221209222926939 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222926939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222926940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222926940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222926940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222926941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222926941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:28.558599 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=24211): Process ended prematurely: osmo-stp_10.42.42.5(pid=24211) [trial-2365↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24211)] [trial-2365↪sms:trx-lms↪mo_mt_sms.py:16] 22:29:28.566649 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 22:29:28.592682 run osmo-hlr_10.42.42.2(pid=24208): ERR: Terminated: ERROR {rc=237} [trial-2365↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24208)] 22:29:28.640835 run osmo-hlr_10.42.42.2(pid=24208): stdout: | (launched: 2022-12-09_22:29:25.845940) 22:29:28.690085 run osmo-hlr_10.42.42.2(pid=24208): stderr: | 20221209222926020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222926020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222926020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222926020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222926020 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222926020 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222926032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222926040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222926041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222926041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:28.758580 run osmo-msc_10.42.42.6(pid=24214): ERR: Terminated: ERROR {rc=2} [trial-2365↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24214)] 22:29:28.806192 run osmo-msc_10.42.42.6(pid=24214): stdout: | (launched: 2022-12-09_22:29:27.711263) 22:29:28.855347 run osmo-msc_10.42.42.6(pid=24214): stderr: | 20221209222927982 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222927982 DLGLOBAL DEBUG validating counter group 0x7f6ff8e4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222927982 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222927982 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222927983 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222927983 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222927984 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222927985 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222927985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222927985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:29:28.905207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24207): Terminating (SIGTERM) 22:29:28.944683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24210): Terminating (SIGTERM) 22:29:28.984360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24213): Terminating (SIGTERM) 22:29:29.023962 --- ParallelTerminationStrategy: PID 24207 died... 22:29:29.043197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24207): Terminated: ok {rc=0} 22:29:29.087497 --- ParallelTerminationStrategy: PID 24210 died... 22:29:29.107351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24210): Terminated: ok {rc=0} 22:29:29.153351 --- ParallelTerminationStrategy: PID 24213 died... 22:29:29.171732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24213): Terminated: ok {rc=0} 22:29:29.255937 bus /sierra_3: Setting Powered False 22:29:30.350699 bus /sierra_3: Setting Powered False 22:29:31.463868 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_ussd:trx-lms --------------------------------------------------------------------- 22:29:32.691873 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:32.696646 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 22:29:32.730597 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 22:29:32.737604 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 22:29:32.772557 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 22:29:32.806073 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 22:29:32.812897 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 22:29:33.334920 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2365 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 22:29:33.340324 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 22:29:33.351525 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 22:29:33.400486 tst assert_extension.py: using LAC 24097 22:29:33.523487 tst assert_extension.py: using RAC 127 22:29:33.646935 tst assert_extension.py: using CellId 24097 22:29:33.771177 tst assert_extension.py: using BVCI 24098 22:29:33.885284 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 22:29:33.997651 tst assert_extension.py:10: start nitb and bts... 22:29:34.195484 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:29:34.795360 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24219): Launched 22:29:35.088610 run osmo-nitb_10.42.42.2(pid=24220): Launched 22:29:35.252415 run osmo-nitb_10.42.42.2(pid=24220): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24220)] 22:29:35.384770 run osmo-nitb_10.42.42.2(pid=24220): stdout: | (launched: 2022-12-09_22:29:35.035129) 22:29:35.518852 run osmo-nitb_10.42.42.2(pid=24220): stderr: | (launched: 2022-12-09_22:29:35.078935) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:29:35.652923 run osmo-nitb_10.42.42.2(pid=24220): stdout: | (launched: 2022-12-09_22:29:35.035129) 22:29:35.781845 run osmo-nitb_10.42.42.2(pid=24220): stderr: | (launched: 2022-12-09_22:29:35.078935) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24220): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24220) [trial-2365↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24220)] 22:29:36.200089 tst osmo-nitb_10.42.42.2(pid=24220): stdout: | (launched: 2022-12-09_22:29:35.035129) 22:29:36.320166 tst osmo-nitb_10.42.42.2(pid=24220): stderr: | (launched: 2022-12-09_22:29:35.078935) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:29:36.461547 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=24220): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24220) [trial-2365↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24220)] [trial-2365↪nitb_ussd:trx-lms↪assert_extension.py:12] 22:29:36.469878 tst assert_extension.py:12: Test FAILED (3.1 sec) 22:29:36.476549 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24219): Terminating (SIGTERM) 22:29:36.685720 --- ParallelTerminationStrategy: PID 24219 died... 22:29:36.706666 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24219): Terminated: ok {rc=0} 22:29:36.794065 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 ussd:trx-lms --------------------------------------------------------------------- 22:29:37.976496 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:37.980702 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 22:29:38.014771 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 22:29:38.042737 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 22:29:38.078053 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 22:29:38.112024 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 22:29:38.139314 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 22:29:38.666712 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2365 ussd:trx-lms assert_extension.py ---------------------------------------------- 22:29:38.671630 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:38.682114 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 22:29:38.729405 tst assert_extension.py: using LAC 24098 22:29:38.854462 tst assert_extension.py: using RAC 128 22:29:38.978314 tst assert_extension.py: using CellId 24098 22:29:39.102760 tst assert_extension.py: using BVCI 24099 22:29:39.217053 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:39.228140 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:39.239141 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:39.250342 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:39.261385 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:39.272159 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 22:29:39.385341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:39.843745 run create_hlr_db(pid=24224): Launched 22:29:39.957486 bus /sierra_2: Setting Powered False 22:29:41.016462 run create_hlr_db(pid=24224): Terminated: ok {rc=0} 22:29:41.449589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24226): Launched 22:29:41.767951 run osmo-hlr_10.42.42.2(pid=24227): Launched 22:29:41.890250 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:42.433574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24229): Launched 22:29:42.751427 run osmo-stp_10.42.42.5(pid=24230): Launched 22:29:42.871680 run osmo-msc_10.42.42.6: Starting osmo-msc 22:29:43.439633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24232): Launched 22:29:43.754688 run osmo-msc_10.42.42.6(pid=24233): Launched 22:29:43.931172 run osmo-stp_10.42.42.5(pid=24230): ERR: Terminated: ERROR {rc=1} [trial-2365↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24230)] 22:29:44.064269 run osmo-stp_10.42.42.5(pid=24230): stdout: | (launched: 2022-12-09_22:29:42.693837) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:44.198089 run osmo-stp_10.42.42.5(pid=24230): stderr: | 20221209222942886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222942887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222942887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222942887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222942888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222942888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222942888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:44.331132 run osmo-stp_10.42.42.5(pid=24230): stdout: | (launched: 2022-12-09_22:29:42.693837) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:44.457263 run osmo-stp_10.42.42.5(pid=24230): stderr: | 20221209222942886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222942887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222942887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222942887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222942888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222942888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222942888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:44.606907 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24230): Process ended prematurely: osmo-stp_10.42.42.5(pid=24230) [trial-2365↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24230)] [trial-2365↪ussd:trx-lms↪assert_extension.py:17] 22:29:44.616099 tst assert_extension.py:17: Test FAILED (5.9 sec) 22:29:44.643782 run osmo-hlr_10.42.42.2(pid=24227): ERR: Terminated: ERROR {rc=237} [trial-2365↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24227)] 22:29:44.694256 run osmo-hlr_10.42.42.2(pid=24227): stdout: | (launched: 2022-12-09_22:29:41.710580) 22:29:44.746221 run osmo-hlr_10.42.42.2(pid=24227): stderr: | 20221209222941910 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222941910 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222941910 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222941911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222941911 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222941911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222941923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222941931 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222941932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222941932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:44.818389 run osmo-msc_10.42.42.6(pid=24233): ERR: Terminated: ERROR {rc=2} [trial-2365↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24233)] 22:29:44.868633 run osmo-msc_10.42.42.6(pid=24233): stdout: | (launched: 2022-12-09_22:29:43.697821) 22:29:44.920419 run osmo-msc_10.42.42.6(pid=24233): stderr: | 20221209222944016 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222944017 DLGLOBAL DEBUG validating counter group 0x7fb787e97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222944017 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222944017 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222944018 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222944018 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222944022 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222944022 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222944022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222944022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:29:44.972693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24226): Terminating (SIGTERM) 22:29:45.014869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24229): Terminating (SIGTERM) 22:29:45.057135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24232): Terminating (SIGTERM) 22:29:45.099495 --- ParallelTerminationStrategy: PID 24226 died... 22:29:45.119785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24226): Terminated: ok {rc=0} 22:29:45.166687 --- ParallelTerminationStrategy: PID 24229 died... 22:29:45.186286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24229): Terminated: ok {rc=0} 22:29:45.232393 --- ParallelTerminationStrategy: PID 24232 died... 22:29:45.252072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24232): Terminated: ok {rc=0} 22:29:45.340305 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:29:46.581974 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:46.588639 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:29:46.627455 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:29:46.660871 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:29:46.731169 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:29:46.784845 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:29:46.816360 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:29:47.348560 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:29:47.401782 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:47.413452 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:29:47.485391 tst mo_mt_call.py: using LAC 24099 22:29:47.610790 tst mo_mt_call.py: using RAC 129 22:29:47.737500 tst mo_mt_call.py: using CellId 24099 22:29:47.864504 tst mo_mt_call.py: using BVCI 24100 22:29:47.980513 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:47.992112 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:48.003503 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:48.015015 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:48.026607 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:48.038437 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:29:48.153764 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:29:48.274290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:48.769715 run create_hlr_db(pid=24238): Launched 22:29:48.900584 bus /sierra_2: Setting Powered False 22:29:49.964645 run create_hlr_db(pid=24238): Terminated: ok {rc=0} 22:29:50.393235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24240): Launched 22:29:50.693227 run osmo-hlr_10.42.42.2(pid=24241): Launched 22:29:50.807774 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:51.357594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24243): Launched 22:29:51.680092 run osmo-stp_10.42.42.5(pid=24244): Launched 22:29:51.801212 run osmo-msc_10.42.42.6: Starting osmo-msc 22:29:52.377844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24246): Launched 22:29:52.701188 run osmo-msc_10.42.42.6(pid=24247): Launched 22:29:52.879296 run osmo-stp_10.42.42.5(pid=24244): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24244)] 22:29:53.013832 run osmo-stp_10.42.42.5(pid=24244): stdout: | (launched: 2022-12-09_22:29:51.621557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:53.149365 run osmo-stp_10.42.42.5(pid=24244): stderr: | 20221209222951813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222951813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222951813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222951814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222951814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222951814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222951814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:53.283820 run osmo-stp_10.42.42.5(pid=24244): stdout: | (launched: 2022-12-09_22:29:51.621557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:53.411253 run osmo-stp_10.42.42.5(pid=24244): stderr: | 20221209222951813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209222951813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209222951813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209222951814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209222951814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209222951814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209222951814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:53.563153 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24244): Process ended prematurely: osmo-stp_10.42.42.5(pid=24244) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24244)] [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:29:53.572656 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:29:53.600508 run osmo-hlr_10.42.42.2(pid=24241): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24241)] 22:29:53.650740 run osmo-hlr_10.42.42.2(pid=24241): stdout: | (launched: 2022-12-09_22:29:50.638234) 22:29:53.702580 run osmo-hlr_10.42.42.2(pid=24241): stderr: | 20221209222950814 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209222950814 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209222950814 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209222950814 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209222950814 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209222950814 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209222950827 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209222950836 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209222950836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209222950837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:53.774416 run osmo-msc_10.42.42.6(pid=24247): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24247)] 22:29:53.824421 run osmo-msc_10.42.42.6(pid=24247): stdout: | (launched: 2022-12-09_22:29:52.642589) 22:29:53.876251 run osmo-msc_10.42.42.6(pid=24247): stderr: | 20221209222952965 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209222952965 DLGLOBAL DEBUG validating counter group 0x7f8df9b07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209222952966 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209222952966 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209222952966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209222952966 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209222952968 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209222952968 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209222952968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209222952968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:29:53.928387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24240): Terminating (SIGTERM) 22:29:53.969784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24243): Terminating (SIGTERM) 22:29:54.011416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24246): Terminating (SIGTERM) 22:29:54.053557 --- ParallelTerminationStrategy: PID 24240 died... 22:29:54.073287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24240): Terminated: ok {rc=0} 22:29:54.119649 --- ParallelTerminationStrategy: PID 24243 died... 22:29:54.139288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24243): Terminated: ok {rc=0} 22:29:54.185547 --- ParallelTerminationStrategy: PID 24246 died... 22:29:54.205307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24246): Terminated: ok {rc=0} 22:29:54.293099 bus /sierra_3: Setting Powered False 22:29:55.391301 bus /sierra_3: Setting Powered False 22:29:56.507008 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:29:57.653259 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:57.665081 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:29:57.734194 tst mo_mt_call_osmux.py: using LAC 24100 22:29:57.853728 tst mo_mt_call_osmux.py: using RAC 130 22:29:57.971240 tst mo_mt_call_osmux.py: using CellId 24100 22:29:58.089369 tst mo_mt_call_osmux.py: using BVCI 24101 22:29:58.200190 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:58.211340 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:58.222147 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:58.233393 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:58.244730 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:58.255983 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:29:58.371384 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:29:58.495575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:58.992161 run create_hlr_db(pid=24249): Launched 22:29:59.123010 bus /sierra_2: Setting Powered False 22:30:00.186412 run create_hlr_db(pid=24249): Terminated: ok {rc=0} 22:30:00.616933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24251): Launched 22:30:00.949791 run osmo-hlr_10.42.42.2(pid=24252): Launched 22:30:01.065635 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:01.807374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24257): Launched 22:30:02.235679 run osmo-stp_10.42.42.5(pid=24258): Launched 22:30:02.395914 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:02.978234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24260): Launched 22:30:03.298535 run osmo-msc_10.42.42.6(pid=24261): Launched 22:30:03.476758 run osmo-stp_10.42.42.5(pid=24258): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24258)] 22:30:03.612051 run osmo-stp_10.42.42.5(pid=24258): stdout: | (launched: 2022-12-09_22:30:02.169420) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:03.747948 run osmo-stp_10.42.42.5(pid=24258): stderr: | 20221209223002384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223002384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223002384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223002385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223002385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223002385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223002385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:03.883491 run osmo-stp_10.42.42.5(pid=24258): stdout: | (launched: 2022-12-09_22:30:02.169420) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:04.011338 run osmo-stp_10.42.42.5(pid=24258): stderr: | 20221209223002384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223002384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223002384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223002385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223002385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223002385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223002385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:04.164080 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24258): Process ended prematurely: osmo-stp_10.42.42.5(pid=24258) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24258)] [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:30:04.173815 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 22:30:04.201766 run osmo-hlr_10.42.42.2(pid=24252): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24252)] 22:30:04.252417 run osmo-hlr_10.42.42.2(pid=24252): stdout: | (launched: 2022-12-09_22:30:00.870183) 22:30:04.304398 run osmo-hlr_10.42.42.2(pid=24252): stderr: | 20221209223001248 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223001248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223001248 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223001248 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223001248 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223001248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223001267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223001283 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223001283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223001283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:04.376747 run osmo-msc_10.42.42.6(pid=24261): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24261)] 22:30:04.427016 run osmo-msc_10.42.42.6(pid=24261): stdout: | (launched: 2022-12-09_22:30:03.240667) 22:30:04.478936 run osmo-msc_10.42.42.6(pid=24261): stderr: | 20221209223003564 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223003564 DLGLOBAL DEBUG validating counter group 0x7f5cd92e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223003564 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223003564 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223003564 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223003564 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223003566 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223003566 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223003567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223003567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:04.531181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24251): Terminating (SIGTERM) 22:30:04.572849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24257): Terminating (SIGTERM) 22:30:04.614966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24260): Terminating (SIGTERM) 22:30:04.657410 --- ParallelTerminationStrategy: PID 24251 died... 22:30:04.677751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24251): Terminated: ok {rc=0} 22:30:04.724381 --- ParallelTerminationStrategy: PID 24257 died... 22:30:04.744127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24257): Terminated: ok {rc=0} 22:30:04.790746 --- ParallelTerminationStrategy: PID 24260 died... 22:30:04.810231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24260): Terminated: ok {rc=0} 22:30:04.898111 bus /sierra_3: Setting Powered False 22:30:05.996812 bus /sierra_3: Setting Powered False 22:30:07.114808 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:30:08.375020 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:30:08.382178 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:30:08.416124 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:30:08.443363 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:30:08.495289 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:30:08.529030 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:30:08.556152 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:30:09.110492 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:30:09.161852 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:09.173269 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:30:09.243046 tst mo_mt_call.py: using LAC 24101 22:30:09.369567 tst mo_mt_call.py: using RAC 131 22:30:09.493358 tst mo_mt_call.py: using CellId 24101 22:30:09.617913 tst mo_mt_call.py: using BVCI 24102 22:30:09.734354 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:09.745795 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:09.757080 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:09.768377 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:09.779735 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:09.791078 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:30:09.912488 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:30:10.029832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:10.496264 run create_hlr_db(pid=24266): Launched 22:30:10.613256 bus /sierra_2: Setting Powered False 22:30:11.674317 run create_hlr_db(pid=24266): Terminated: ok {rc=0} 22:30:12.096492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24268): Launched 22:30:12.398869 run osmo-hlr_10.42.42.2(pid=24269): Launched 22:30:12.514643 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:13.046966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24271): Launched 22:30:13.349030 run osmo-stp_10.42.42.5(pid=24272): Launched 22:30:13.464936 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:14.008428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24274): Launched 22:30:14.310295 run osmo-msc_10.42.42.6(pid=24275): Launched 22:30:14.479517 run osmo-stp_10.42.42.5(pid=24272): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24272)] 22:30:14.607629 run osmo-stp_10.42.42.5(pid=24272): stdout: | (launched: 2022-12-09_22:30:13.294250) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:14.736192 run osmo-stp_10.42.42.5(pid=24272): stderr: | 20221209223013464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223013464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223013465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223013465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223013466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223013466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223013466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:14.861741 run osmo-stp_10.42.42.5(pid=24272): stdout: | (launched: 2022-12-09_22:30:13.294250) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:14.981790 run osmo-stp_10.42.42.5(pid=24272): stderr: | 20221209223013464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223013464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223013465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223013465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223013466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223013466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223013466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:15.125208 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24272): Process ended prematurely: osmo-stp_10.42.42.5(pid=24272) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24272)] [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:30:15.134171 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:30:15.160604 run osmo-hlr_10.42.42.2(pid=24269): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24269)] 22:30:15.208861 run osmo-hlr_10.42.42.2(pid=24269): stdout: | (launched: 2022-12-09_22:30:12.344093) 22:30:15.258372 run osmo-hlr_10.42.42.2(pid=24269): stderr: | 20221209223012519 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223012519 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223012519 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223012519 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223012519 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223012519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223012531 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223012542 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223012542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223012542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:15.327021 run osmo-msc_10.42.42.6(pid=24275): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24275)] 22:30:15.374610 run osmo-msc_10.42.42.6(pid=24275): stdout: | (launched: 2022-12-09_22:30:14.255464) 22:30:15.423765 run osmo-msc_10.42.42.6(pid=24275): stderr: | 20221209223014526 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223014527 DLGLOBAL DEBUG validating counter group 0x7fc4b6f22c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223014527 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223014527 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223014527 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223014527 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223014529 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223014529 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223014530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223014530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:15.473829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24268): Terminating (SIGTERM) 22:30:15.513335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24271): Terminating (SIGTERM) 22:30:15.553131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24274): Terminating (SIGTERM) 22:30:15.593206 --- ParallelTerminationStrategy: PID 24268 died... 22:30:15.612127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24268): Terminated: ok {rc=0} 22:30:15.656593 --- ParallelTerminationStrategy: PID 24271 died... 22:30:15.675157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24271): Terminated: ok {rc=0} 22:30:15.720115 --- ParallelTerminationStrategy: PID 24274 died... 22:30:15.738816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24274): Terminated: ok {rc=0} 22:30:15.822634 bus /sierra_3: Setting Powered False 22:30:16.924876 bus /sierra_3: Setting Powered False 22:30:18.043531 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:30:19.192914 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:19.205092 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:30:19.275877 tst mo_mt_call_osmux.py: using LAC 24102 22:30:19.399739 tst mo_mt_call_osmux.py: using RAC 132 22:30:19.523893 tst mo_mt_call_osmux.py: using CellId 24102 22:30:19.642200 tst mo_mt_call_osmux.py: using BVCI 24103 22:30:19.751973 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:19.763135 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:19.774013 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:19.785421 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:19.796780 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:19.807848 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:30:19.928001 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:30:20.045589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:20.512500 run create_hlr_db(pid=24277): Launched 22:30:20.628921 bus /sierra_2: Setting Powered False 22:30:21.689361 run create_hlr_db(pid=24277): Terminated: ok {rc=0} 22:30:22.128434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24279): Launched 22:30:22.448816 run osmo-hlr_10.42.42.2(pid=24280): Launched 22:30:22.571735 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:23.123268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24282): Launched 22:30:23.442683 run osmo-stp_10.42.42.5(pid=24283): Launched 22:30:23.565141 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:24.146697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24285): Launched 22:30:24.467302 run osmo-msc_10.42.42.6(pid=24286): Launched 22:30:24.647235 run osmo-stp_10.42.42.5(pid=24283): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24283)] 22:30:24.783566 run osmo-stp_10.42.42.5(pid=24283): stdout: | (launched: 2022-12-09_22:30:23.384661) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:24.920056 run osmo-stp_10.42.42.5(pid=24283): stderr: | 20221209223023575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223023576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223023576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223023576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223023577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223023577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223023577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:25.054935 run osmo-stp_10.42.42.5(pid=24283): stdout: | (launched: 2022-12-09_22:30:23.384661) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:25.181940 run osmo-stp_10.42.42.5(pid=24283): stderr: | 20221209223023575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223023576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223023576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223023576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223023577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223023577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223023577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:25.334117 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24283): Process ended prematurely: osmo-stp_10.42.42.5(pid=24283) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24283)] [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:30:25.343443 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:30:25.371211 run osmo-hlr_10.42.42.2(pid=24280): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24280)] 22:30:25.421325 run osmo-hlr_10.42.42.2(pid=24280): stdout: | (launched: 2022-12-09_22:30:22.390912) 22:30:25.472927 run osmo-hlr_10.42.42.2(pid=24280): stderr: | 20221209223022588 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223022588 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223022588 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223022588 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223022588 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223022588 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223022600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223022608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223022608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223022608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:25.544936 run osmo-msc_10.42.42.6(pid=24286): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24286)] 22:30:25.595165 run osmo-msc_10.42.42.6(pid=24286): stdout: | (launched: 2022-12-09_22:30:24.409528) 22:30:25.647060 run osmo-msc_10.42.42.6(pid=24286): stderr: | 20221209223024729 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223024729 DLGLOBAL DEBUG validating counter group 0x7f29040aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223024729 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223024729 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223024729 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223024729 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223024733 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223024733 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223024733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223024733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:25.698859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24279): Terminating (SIGTERM) 22:30:25.740549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24282): Terminating (SIGTERM) 22:30:25.782458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24285): Terminating (SIGTERM) 22:30:25.824425 --- ParallelTerminationStrategy: PID 24279 died... 22:30:25.844374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24279): Terminated: ok {rc=0} 22:30:25.890563 --- ParallelTerminationStrategy: PID 24282 died... 22:30:25.910061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24282): Terminated: ok {rc=0} 22:30:25.956000 --- ParallelTerminationStrategy: PID 24285 died... 22:30:25.975571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24285): Terminated: ok {rc=0} 22:30:26.063757 bus /sierra_3: Setting Powered False 22:30:27.162749 bus /sierra_3: Setting Powered False 22:30:28.277632 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:30:29.529650 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:30:29.536573 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:30:29.570408 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:30:29.597677 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:30:29.651899 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:30:29.685856 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:30:29.712846 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:30:30.264477 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:30:30.315514 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:30.327033 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:30:30.397788 tst mo_mt_call.py: using LAC 24103 22:30:30.525398 tst mo_mt_call.py: using RAC 133 22:30:30.646830 tst mo_mt_call.py: using CellId 24103 22:30:30.766758 tst mo_mt_call.py: using BVCI 24104 22:30:30.887928 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:30.912434 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:30.929819 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:30.942154 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:30.953929 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:30.965991 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:30:31.089751 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:30:31.226200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:31.710735 run create_hlr_db(pid=24291): Launched 22:30:31.863664 bus /sierra_2: Setting Powered False 22:30:32.924874 run create_hlr_db(pid=24291): Terminated: ok {rc=0} 22:30:33.368400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24293): Launched 22:30:33.691919 run osmo-hlr_10.42.42.2(pid=24294): Launched 22:30:33.814953 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:34.372319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24296): Launched 22:30:34.693587 run osmo-stp_10.42.42.5(pid=24297): Launched 22:30:34.815953 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:35.399376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24299): Launched 22:30:35.721578 run osmo-msc_10.42.42.6(pid=24300): Launched 22:30:35.902698 run osmo-stp_10.42.42.5(pid=24297): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24297)] 22:30:36.039158 run osmo-stp_10.42.42.5(pid=24297): stdout: | (launched: 2022-12-09_22:30:34.635417) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:36.176071 run osmo-stp_10.42.42.5(pid=24297): stderr: | 20221209223034829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223034829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223034829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223034830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223034830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223034830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223034830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:36.312716 run osmo-stp_10.42.42.5(pid=24297): stdout: | (launched: 2022-12-09_22:30:34.635417) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:36.441330 run osmo-stp_10.42.42.5(pid=24297): stderr: | 20221209223034829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223034829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223034829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223034830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223034830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223034830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223034830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:36.595348 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24297): Process ended prematurely: osmo-stp_10.42.42.5(pid=24297) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24297)] [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:30:36.604741 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:30:36.632303 run osmo-hlr_10.42.42.2(pid=24294): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24294)] 22:30:36.682210 run osmo-hlr_10.42.42.2(pid=24294): stdout: | (launched: 2022-12-09_22:30:33.633606) 22:30:36.734139 run osmo-hlr_10.42.42.2(pid=24294): stderr: | 20221209223033833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223033833 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223033833 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223033833 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223033833 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223033833 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223033846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223033854 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223033854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223033854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:36.805910 run osmo-msc_10.42.42.6(pid=24300): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24300)] 22:30:36.855756 run osmo-msc_10.42.42.6(pid=24300): stdout: | (launched: 2022-12-09_22:30:35.663251) 22:30:36.907387 run osmo-msc_10.42.42.6(pid=24300): stderr: | 20221209223035987 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223035987 DLGLOBAL DEBUG validating counter group 0x7f8aa4d78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223035987 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223035987 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223035987 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223035988 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223035989 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223035990 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223035990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223035990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:36.959276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24293): Terminating (SIGTERM) 22:30:37.000583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24296): Terminating (SIGTERM) 22:30:37.042143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24299): Terminating (SIGTERM) 22:30:37.083978 --- ParallelTerminationStrategy: PID 24293 died... 22:30:37.103706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24293): Terminated: ok {rc=0} 22:30:37.149948 --- ParallelTerminationStrategy: PID 24296 died... 22:30:37.169501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24296): Terminated: ok {rc=0} 22:30:37.215872 --- ParallelTerminationStrategy: PID 24299 died... 22:30:37.235515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24299): Terminated: ok {rc=0} 22:30:37.323744 bus /sierra_3: Setting Powered False 22:30:38.424605 bus /sierra_3: Setting Powered False 22:30:39.541201 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:30:40.690904 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:40.702967 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:30:40.775152 tst mo_mt_call_osmux.py: using LAC 24104 22:30:40.901858 tst mo_mt_call_osmux.py: using RAC 134 22:30:41.028227 tst mo_mt_call_osmux.py: using CellId 24104 22:30:41.158347 tst mo_mt_call_osmux.py: using BVCI 24105 22:30:41.275948 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:41.287644 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:41.299007 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:41.310353 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:41.321877 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:41.333087 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:30:41.448169 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:30:41.569806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:42.067136 run create_hlr_db(pid=24302): Launched 22:30:42.197453 bus /sierra_2: Setting Powered False 22:30:43.261184 run create_hlr_db(pid=24302): Terminated: ok {rc=0} 22:30:43.693251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24304): Launched 22:30:43.997021 run osmo-hlr_10.42.42.2(pid=24305): Launched 22:30:44.112460 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:44.647185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24307): Launched 22:30:44.948383 run osmo-stp_10.42.42.5(pid=24308): Launched 22:30:45.063686 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:45.608537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24310): Launched 22:30:45.930474 run osmo-msc_10.42.42.6(pid=24311): Launched 22:30:46.276890 run osmo-stp_10.42.42.5(pid=24308): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24308)] 22:30:46.545880 run osmo-stp_10.42.42.5(pid=24308): stdout: | (launched: 2022-12-09_22:30:44.893918) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:46.817393 run osmo-stp_10.42.42.5(pid=24308): stderr: | 20221209223045064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223045065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223045065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223045065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223045066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223045066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223045066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:46.994477 run osmo-stp_10.42.42.5(pid=24308): stdout: | (launched: 2022-12-09_22:30:44.893918) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:47.117829 run osmo-stp_10.42.42.5(pid=24308): stderr: | 20221209223045064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223045065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223045065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223045065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223045066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223045066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223045066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:47.265979 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24308): Process ended prematurely: osmo-stp_10.42.42.5(pid=24308) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24308)] [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:30:47.274944 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 22:30:47.302721 run osmo-hlr_10.42.42.2(pid=24305): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24305)] 22:30:47.351827 run osmo-hlr_10.42.42.2(pid=24305): stdout: | (launched: 2022-12-09_22:30:43.941947) 22:30:47.402567 run osmo-hlr_10.42.42.2(pid=24305): stderr: | 20221209223044119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223044119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223044119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223044119 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223044119 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223044119 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223044131 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223044140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223044141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223044141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:47.473087 run osmo-msc_10.42.42.6(pid=24311): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24311)] 22:30:47.522103 run osmo-msc_10.42.42.6(pid=24311): stdout: | (launched: 2022-12-09_22:30:45.862370) 22:30:47.572547 run osmo-msc_10.42.42.6(pid=24311): stderr: | 20221209223046462 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223046462 DLGLOBAL DEBUG validating counter group 0x7f9446d68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223046462 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223046462 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223046462 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223046463 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223046464 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223046465 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223046465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223046465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:47.623471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24304): Terminating (SIGTERM) 22:30:47.664040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24307): Terminating (SIGTERM) 22:30:47.705261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24310): Terminating (SIGTERM) 22:30:47.746180 --- ParallelTerminationStrategy: PID 24304 died... 22:30:47.765597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24304): Terminated: ok {rc=0} 22:30:47.811099 --- ParallelTerminationStrategy: PID 24307 died... 22:30:47.830059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24307): Terminated: ok {rc=0} 22:30:47.875244 --- ParallelTerminationStrategy: PID 24310 died... 22:30:47.894272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24310): Terminated: ok {rc=0} 22:30:47.981534 bus /sierra_3: Setting Powered False 22:30:49.082563 bus /sierra_3: Setting Powered False 22:30:50.197162 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:30:51.452202 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:30:51.459688 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:30:51.493504 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:30:51.519977 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:30:51.571812 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:30:51.605187 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:30:51.631935 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:30:52.186933 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:30:52.238565 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:52.250184 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:30:52.321336 tst mo_mt_call.py: using LAC 24105 22:30:52.449022 tst mo_mt_call.py: using RAC 135 22:30:52.574991 tst mo_mt_call.py: using CellId 24105 22:30:52.703728 tst mo_mt_call.py: using BVCI 24106 22:30:52.821523 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:52.832874 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:52.844158 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:52.855433 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:52.866766 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:52.878148 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:30:52.993658 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:30:53.113496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:53.610119 run create_hlr_db(pid=24316): Launched 22:30:53.740731 bus /sierra_2: Setting Powered False 22:30:54.804837 run create_hlr_db(pid=24316): Terminated: ok {rc=0} 22:30:55.234630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24318): Launched 22:30:55.536005 run osmo-hlr_10.42.42.2(pid=24319): Launched 22:30:55.651274 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:56.184873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24321): Launched 22:30:56.487556 run osmo-stp_10.42.42.5(pid=24322): Launched 22:30:56.602770 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:57.148247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24324): Launched 22:30:57.449014 run osmo-msc_10.42.42.6(pid=24325): Launched 22:30:57.617930 run osmo-stp_10.42.42.5(pid=24322): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24322)] 22:30:57.746305 run osmo-stp_10.42.42.5(pid=24322): stdout: | (launched: 2022-12-09_22:30:56.432191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:57.875305 run osmo-stp_10.42.42.5(pid=24322): stderr: | 20221209223056602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223056602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223056603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223056603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223056603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223056604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223056604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:58.001756 run osmo-stp_10.42.42.5(pid=24322): stdout: | (launched: 2022-12-09_22:30:56.432191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:58.121962 run osmo-stp_10.42.42.5(pid=24322): stderr: | 20221209223056602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223056602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223056603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223056603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223056603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223056604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223056604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:58.265823 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24322): Process ended prematurely: osmo-stp_10.42.42.5(pid=24322) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24322)] [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:30:58.274860 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:30:58.302349 run osmo-hlr_10.42.42.2(pid=24319): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24319)] 22:30:58.350731 run osmo-hlr_10.42.42.2(pid=24319): stdout: | (launched: 2022-12-09_22:30:55.481145) 22:30:58.401318 run osmo-hlr_10.42.42.2(pid=24319): stderr: | 20221209223055657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223055657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223055657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223055658 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223055658 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223055658 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223055668 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223055678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223055678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223055679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:58.470938 run osmo-msc_10.42.42.6(pid=24325): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24325)] 22:30:58.519278 run osmo-msc_10.42.42.6(pid=24325): stdout: | (launched: 2022-12-09_22:30:57.394309) 22:30:58.569321 run osmo-msc_10.42.42.6(pid=24325): stderr: | 20221209223057667 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223057667 DLGLOBAL DEBUG validating counter group 0x7ff8b6cedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223057667 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223057668 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223057668 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223057668 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223057670 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223057670 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223057670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223057670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:58.619563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24318): Terminating (SIGTERM) 22:30:58.659802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24321): Terminating (SIGTERM) 22:30:58.699986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24324): Terminating (SIGTERM) 22:30:58.740252 --- ParallelTerminationStrategy: PID 24318 died... 22:30:58.759256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24318): Terminated: ok {rc=0} 22:30:58.804373 --- ParallelTerminationStrategy: PID 24321 died... 22:30:58.823163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24321): Terminated: ok {rc=0} 22:30:58.868279 --- ParallelTerminationStrategy: PID 24324 died... 22:30:58.887267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24324): Terminated: ok {rc=0} 22:30:58.974846 bus /sierra_3: Setting Powered False 22:31:00.076243 bus /sierra_3: Setting Powered False 22:31:01.205291 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:31:02.366993 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:02.378954 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:31:02.449751 tst mo_mt_call_osmux.py: using LAC 24106 22:31:02.578011 tst mo_mt_call_osmux.py: using RAC 136 22:31:02.704889 tst mo_mt_call_osmux.py: using CellId 24106 22:31:02.830827 tst mo_mt_call_osmux.py: using BVCI 24107 22:31:02.947232 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:02.958909 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:02.970316 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:02.981621 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:02.992905 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:03.004153 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:31:03.127018 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:31:03.245750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:03.713232 run create_hlr_db(pid=24327): Launched 22:31:03.829557 bus /sierra_2: Setting Powered False 22:31:04.889807 run create_hlr_db(pid=24327): Terminated: ok {rc=0} 22:31:05.330158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24329): Launched 22:31:05.652235 run osmo-hlr_10.42.42.2(pid=24330): Launched 22:31:05.776716 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:06.329089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24332): Launched 22:31:06.650056 run osmo-stp_10.42.42.5(pid=24333): Launched 22:31:06.774066 run osmo-msc_10.42.42.6: Starting osmo-msc 22:31:07.360133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24335): Launched 22:31:07.685698 run osmo-msc_10.42.42.6(pid=24336): Launched 22:31:07.864017 run osmo-stp_10.42.42.5(pid=24333): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24333)] 22:31:07.999539 run osmo-stp_10.42.42.5(pid=24333): stdout: | (launched: 2022-12-09_22:31:06.591723) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:08.135831 run osmo-stp_10.42.42.5(pid=24333): stderr: | 20221209223106783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223106783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223106783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223106783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223106786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223106786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223106786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:08.271519 run osmo-stp_10.42.42.5(pid=24333): stdout: | (launched: 2022-12-09_22:31:06.591723) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:08.399391 run osmo-stp_10.42.42.5(pid=24333): stderr: | 20221209223106783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223106783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223106783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223106783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223106786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223106786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223106786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:08.553068 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24333): Process ended prematurely: osmo-stp_10.42.42.5(pid=24333) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24333)] [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:31:08.562654 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:31:08.590647 run osmo-hlr_10.42.42.2(pid=24330): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24330)] 22:31:08.640621 run osmo-hlr_10.42.42.2(pid=24330): stdout: | (launched: 2022-12-09_22:31:05.594183) 22:31:08.692773 run osmo-hlr_10.42.42.2(pid=24330): stderr: | 20221209223105791 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223105792 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223105792 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223105792 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223105792 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223105792 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223105804 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223105812 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223105813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223105813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:08.765055 run osmo-msc_10.42.42.6(pid=24336): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24336)] 22:31:08.814962 run osmo-msc_10.42.42.6(pid=24336): stdout: | (launched: 2022-12-09_22:31:07.626364) 22:31:08.866533 run osmo-msc_10.42.42.6(pid=24336): stderr: | 20221209223107950 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223107950 DLGLOBAL DEBUG validating counter group 0x7f1b8dadac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223107951 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223107951 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223107951 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223107951 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223107953 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223107953 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223107953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223107953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:31:08.918470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24329): Terminating (SIGTERM) 22:31:08.960005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24332): Terminating (SIGTERM) 22:31:09.001692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24335): Terminating (SIGTERM) 22:31:09.043798 --- ParallelTerminationStrategy: PID 24329 died... 22:31:09.063951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24329): Terminated: ok {rc=0} 22:31:09.110170 --- ParallelTerminationStrategy: PID 24332 died... 22:31:09.129829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24332): Terminated: ok {rc=0} 22:31:09.175937 --- ParallelTerminationStrategy: PID 24335 died... 22:31:09.195398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24335): Terminated: ok {rc=0} 22:31:09.283225 bus /sierra_3: Setting Powered False 22:31:10.384130 bus /sierra_3: Setting Powered False 22:31:11.503049 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:31:12.756486 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:31:12.762987 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:31:12.797394 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:31:12.823925 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:31:12.878735 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:31:12.914824 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:31:12.942098 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:31:13.486117 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:31:13.536552 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:13.547635 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:31:13.616828 tst mo_mt_call.py: using LAC 24107 22:31:13.735055 tst mo_mt_call.py: using RAC 137 22:31:13.855123 tst mo_mt_call.py: using CellId 24107 22:31:13.974831 tst mo_mt_call.py: using BVCI 24108 22:31:14.084072 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:14.095009 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:14.105849 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:14.117433 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:14.128854 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:14.140642 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:31:14.256114 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:31:14.374296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:14.873245 run create_hlr_db(pid=24341): Launched 22:31:15.004261 bus /sierra_2: Setting Powered False 22:31:16.076560 run create_hlr_db(pid=24341): Terminated: ok {rc=0} 22:31:16.555053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24343): Launched 22:31:16.878461 run osmo-hlr_10.42.42.2(pid=24344): Launched 22:31:17.025427 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:17.605946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24346): Launched 22:31:17.909315 run osmo-stp_10.42.42.5(pid=24347): Launched 22:31:18.024459 run osmo-msc_10.42.42.6: Starting osmo-msc 22:31:18.568687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24349): Launched 22:31:18.870684 run osmo-msc_10.42.42.6(pid=24350): Launched 22:31:19.040210 run osmo-stp_10.42.42.5(pid=24347): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24347)] 22:31:19.168676 run osmo-stp_10.42.42.5(pid=24347): stdout: | (launched: 2022-12-09_22:31:17.854371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:19.297676 run osmo-stp_10.42.42.5(pid=24347): stderr: | 20221209223118024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223118024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223118024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223118025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223118027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223118027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223118027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:19.423559 run osmo-stp_10.42.42.5(pid=24347): stdout: | (launched: 2022-12-09_22:31:17.854371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:19.543826 run osmo-stp_10.42.42.5(pid=24347): stderr: | 20221209223118024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223118024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223118024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223118025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223118027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223118027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223118027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:19.687187 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24347): Process ended prematurely: osmo-stp_10.42.42.5(pid=24347) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24347)] [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:31:19.696199 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:31:19.722759 run osmo-hlr_10.42.42.2(pid=24344): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24344)] 22:31:19.770994 run osmo-hlr_10.42.42.2(pid=24344): stdout: | (launched: 2022-12-09_22:31:16.815638) 22:31:19.821274 run osmo-hlr_10.42.42.2(pid=24344): stderr: | 20221209223117173 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223117173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223117173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223117173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223117173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223117173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223117191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223117199 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223117199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223117199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:19.889920 run osmo-msc_10.42.42.6(pid=24350): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24350)] 22:31:19.937593 run osmo-msc_10.42.42.6(pid=24350): stdout: | (launched: 2022-12-09_22:31:18.815722) 22:31:19.987110 run osmo-msc_10.42.42.6(pid=24350): stderr: | 20221209223119087 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223119087 DLGLOBAL DEBUG validating counter group 0x7ff18a68fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223119087 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223119087 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223119087 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223119088 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223119091 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223119092 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223119092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223119092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:31:20.037493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24343): Terminating (SIGTERM) 22:31:20.077236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24346): Terminating (SIGTERM) 22:31:20.117066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24349): Terminating (SIGTERM) 22:31:20.156899 --- ParallelTerminationStrategy: PID 24343 died... 22:31:20.176041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24343): Terminated: ok {rc=0} 22:31:20.221257 --- ParallelTerminationStrategy: PID 24346 died... 22:31:20.239953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24346): Terminated: ok {rc=0} 22:31:20.285068 --- ParallelTerminationStrategy: PID 24349 died... 22:31:20.303777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24349): Terminated: ok {rc=0} 22:31:20.387921 bus /sierra_3: Setting Powered False 22:31:21.486488 bus /sierra_3: Setting Powered False 22:31:22.602758 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:31:23.752214 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:23.764261 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:31:23.835509 tst mo_mt_call_osmux.py: using LAC 24108 22:31:23.963612 tst mo_mt_call_osmux.py: using RAC 138 22:31:24.090724 tst mo_mt_call_osmux.py: using CellId 24108 22:31:24.215719 tst mo_mt_call_osmux.py: using BVCI 24109 22:31:24.332549 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:24.344069 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:24.355220 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:24.366494 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:24.377798 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:24.389064 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:31:24.508434 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:31:24.626257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:25.093879 run create_hlr_db(pid=24352): Launched 22:31:25.224607 bus /sierra_2: Setting Powered False 22:31:26.288340 run create_hlr_db(pid=24352): Terminated: ok {rc=0} 22:31:26.735737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24354): Launched 22:31:27.055691 run osmo-hlr_10.42.42.2(pid=24355): Launched 22:31:27.177552 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:27.726657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24357): Launched 22:31:28.046994 run osmo-stp_10.42.42.5(pid=24358): Launched 22:31:28.169730 run osmo-msc_10.42.42.6: Starting osmo-msc 22:31:28.749164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24360): Launched 22:31:29.068289 run osmo-msc_10.42.42.6(pid=24361): Launched 22:31:29.247209 run osmo-stp_10.42.42.5(pid=24358): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24358)] 22:31:29.381769 run osmo-stp_10.42.42.5(pid=24358): stdout: | (launched: 2022-12-09_22:31:27.989064) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:29.517218 run osmo-stp_10.42.42.5(pid=24358): stderr: | 20221209223128179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223128179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223128180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223128180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223128180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223128180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223128181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:29.653288 run osmo-stp_10.42.42.5(pid=24358): stdout: | (launched: 2022-12-09_22:31:27.989064) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:29.781197 run osmo-stp_10.42.42.5(pid=24358): stderr: | 20221209223128179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223128179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223128180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223128180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223128180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223128180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223128181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:29.933610 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24358): Process ended prematurely: osmo-stp_10.42.42.5(pid=24358) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24358)] [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:31:29.943159 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:31:29.971118 run osmo-hlr_10.42.42.2(pid=24355): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24355)] 22:31:30.021333 run osmo-hlr_10.42.42.2(pid=24355): stdout: | (launched: 2022-12-09_22:31:26.997968) 22:31:30.073311 run osmo-hlr_10.42.42.2(pid=24355): stderr: | 20221209223127195 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223127195 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223127195 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223127195 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223127195 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223127195 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223127208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223127216 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223127216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223127217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:30.145765 run osmo-msc_10.42.42.6(pid=24361): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24361)] 22:31:30.195768 run osmo-msc_10.42.42.6(pid=24361): stdout: | (launched: 2022-12-09_22:31:29.010270) 22:31:30.247609 run osmo-msc_10.42.42.6(pid=24361): stderr: | 20221209223129333 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223129333 DLGLOBAL DEBUG validating counter group 0x7f2dab9bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223129333 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223129333 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223129333 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223129334 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223129335 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223129336 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223129336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223129336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:31:30.299464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24354): Terminating (SIGTERM) 22:31:30.340933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24357): Terminating (SIGTERM) 22:31:30.382508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24360): Terminating (SIGTERM) 22:31:30.424353 --- ParallelTerminationStrategy: PID 24354 died... 22:31:30.444024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24354): Terminated: ok {rc=0} 22:31:30.490148 --- ParallelTerminationStrategy: PID 24357 died... 22:31:30.509678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24357): Terminated: ok {rc=0} 22:31:30.555533 --- ParallelTerminationStrategy: PID 24360 died... 22:31:30.575076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24360): Terminated: ok {rc=0} 22:31:30.664179 bus /sierra_3: Setting Powered False 22:31:31.760268 bus /sierra_3: Setting Powered False 22:31:32.878929 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:31:34.133740 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:31:34.140504 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:31:34.174130 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:31:34.201206 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:31:34.254434 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:31:34.288566 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:31:34.315687 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:31:34.867398 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:31:34.918627 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:34.930127 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:31:35.001530 tst mo_mt_call.py: using LAC 24109 22:31:35.121451 tst mo_mt_call.py: using RAC 139 22:31:35.242083 tst mo_mt_call.py: using CellId 24109 22:31:35.359096 tst mo_mt_call.py: using BVCI 24110 22:31:35.469812 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:35.480901 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:35.491903 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:35.503179 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:35.514447 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:35.525592 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:31:35.641955 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:31:35.758536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:36.223987 run create_hlr_db(pid=24368): Launched 22:31:36.339121 bus /sierra_2: Setting Powered False 22:31:37.399252 run create_hlr_db(pid=24368): Terminated: ok {rc=0} 22:31:37.819440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24370): Launched 22:31:38.120535 run osmo-hlr_10.42.42.2(pid=24371): Launched 22:31:38.236292 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:38.763512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24373): Launched 22:31:39.065564 run osmo-stp_10.42.42.5(pid=24374): Launched 22:31:39.182874 run osmo-msc_10.42.42.6: Starting osmo-msc 22:31:39.731906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24376): Launched 22:31:40.033567 run osmo-msc_10.42.42.6(pid=24377): Launched 22:31:40.204048 run osmo-stp_10.42.42.5(pid=24374): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24374)] 22:31:40.332829 run osmo-stp_10.42.42.5(pid=24374): stdout: | (launched: 2022-12-09_22:31:39.010188) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:40.461946 run osmo-stp_10.42.42.5(pid=24374): stderr: | 20221209223139179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223139179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223139179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223139180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223139180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223139180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223139180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:40.588479 run osmo-stp_10.42.42.5(pid=24374): stdout: | (launched: 2022-12-09_22:31:39.010188) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:40.709085 run osmo-stp_10.42.42.5(pid=24374): stderr: | 20221209223139179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223139179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223139179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223139180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223139180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223139180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223139180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:40.854075 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24374): Process ended prematurely: osmo-stp_10.42.42.5(pid=24374) [trial-2365↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24374)] [trial-2365↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:31:40.862763 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:31:40.889375 run osmo-hlr_10.42.42.2(pid=24371): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24371)] 22:31:40.937316 run osmo-hlr_10.42.42.2(pid=24371): stdout: | (launched: 2022-12-09_22:31:38.065559) 22:31:40.986696 run osmo-hlr_10.42.42.2(pid=24371): stderr: | 20221209223138240 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223138240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223138240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223138240 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223138240 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223138240 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223138256 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223138266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223138266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223138266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:41.055638 run osmo-msc_10.42.42.6(pid=24377): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24377)] 22:31:41.103239 run osmo-msc_10.42.42.6(pid=24377): stdout: | (launched: 2022-12-09_22:31:39.978799) 22:31:41.153071 run osmo-msc_10.42.42.6(pid=24377): stderr: | 20221209223140251 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223140251 DLGLOBAL DEBUG validating counter group 0x7fcc89120c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223140252 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223140252 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223140252 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223140252 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223140254 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223140254 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223140254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223140254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:31:41.202800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24370): Terminating (SIGTERM) 22:31:41.242485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24373): Terminating (SIGTERM) 22:31:41.281989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24376): Terminating (SIGTERM) 22:31:41.322262 --- ParallelTerminationStrategy: PID 24370 died... 22:31:41.341243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24370): Terminated: ok {rc=0} 22:31:41.385605 --- ParallelTerminationStrategy: PID 24373 died... 22:31:41.403961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24373): Terminated: ok {rc=0} 22:31:41.448331 --- ParallelTerminationStrategy: PID 24376 died... 22:31:41.466916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24376): Terminated: ok {rc=0} 22:31:41.553633 bus /sierra_3: Setting Powered False 22:31:42.653580 bus /sierra_3: Setting Powered False 22:31:43.767199 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:31:44.915683 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:44.927864 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:31:44.999958 tst mo_mt_call_osmux.py: using LAC 24110 22:31:45.125724 tst mo_mt_call_osmux.py: using RAC 140 22:31:45.251832 tst mo_mt_call_osmux.py: using CellId 24110 22:31:45.379311 tst mo_mt_call_osmux.py: using BVCI 24111 22:31:45.490413 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:45.501768 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:45.512858 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:45.524261 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:45.535669 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:45.546696 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:31:45.664760 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:31:45.784719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:46.321032 run create_hlr_db(pid=24379): Launched 22:31:46.487014 bus /sierra_2: Setting Powered False 22:31:47.549930 run create_hlr_db(pid=24379): Terminated: ok {rc=0} 22:31:47.986862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24381): Launched 22:31:48.289326 run osmo-hlr_10.42.42.2(pid=24382): Launched 22:31:48.404676 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:48.926274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24384): Launched 22:31:49.227659 run osmo-stp_10.42.42.5(pid=24385): Launched 22:31:49.343640 run osmo-msc_10.42.42.6: Starting osmo-msc 22:31:49.897061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24387): Launched 22:31:50.199986 run osmo-msc_10.42.42.6(pid=24388): Launched 22:31:50.370493 run osmo-stp_10.42.42.5(pid=24385): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24385)] 22:31:50.498787 run osmo-stp_10.42.42.5(pid=24385): stdout: | (launched: 2022-12-09_22:31:49.172814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:50.627158 run osmo-stp_10.42.42.5(pid=24385): stderr: | 20221209223149344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223149344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223149344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223149345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223149345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223149345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223149345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:50.753391 run osmo-stp_10.42.42.5(pid=24385): stdout: | (launched: 2022-12-09_22:31:49.172814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:50.873942 run osmo-stp_10.42.42.5(pid=24385): stderr: | 20221209223149344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223149344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223149344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223149345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223149345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223149345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223149345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:51.017823 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24385): Process ended prematurely: osmo-stp_10.42.42.5(pid=24385) [trial-2365↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24385)] [trial-2365↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:31:51.026515 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:31:51.053154 run osmo-hlr_10.42.42.2(pid=24382): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24382)] 22:31:51.101140 run osmo-hlr_10.42.42.2(pid=24382): stdout: | (launched: 2022-12-09_22:31:48.234180) 22:31:51.150519 run osmo-hlr_10.42.42.2(pid=24382): stderr: | 20221209223148411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223148411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223148411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223148411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223148411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223148411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223148423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223148433 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223148433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223148433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:51.219516 run osmo-msc_10.42.42.6(pid=24388): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24388)] 22:31:51.267150 run osmo-msc_10.42.42.6(pid=24388): stdout: | (launched: 2022-12-09_22:31:50.144711) 22:31:51.316395 run osmo-msc_10.42.42.6(pid=24388): stderr: | 20221209223150414 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223150414 DLGLOBAL DEBUG validating counter group 0x7f968ef75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223150415 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223150415 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223150415 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223150415 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223150417 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223150417 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223150417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223150417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:31:51.366323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24381): Terminating (SIGTERM) 22:31:51.406107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24384): Terminating (SIGTERM) 22:31:51.445981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24387): Terminating (SIGTERM) 22:31:51.486030 --- ParallelTerminationStrategy: PID 24381 died... 22:31:51.505091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24381): Terminated: ok {rc=0} 22:31:51.549306 --- ParallelTerminationStrategy: PID 24384 died... 22:31:51.567638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24384): Terminated: ok {rc=0} 22:31:51.611731 --- ParallelTerminationStrategy: PID 24387 died... 22:31:51.630301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24387): Terminated: ok {rc=0} 22:31:51.716240 bus /sierra_3: Setting Powered False 22:31:52.815954 bus /sierra_3: Setting Powered False 22:31:53.931336 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:31:55.186239 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:31:55.192628 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:31:55.226472 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:31:55.253530 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:31:55.307445 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:31:55.341282 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:31:55.368371 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:31:55.922394 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:31:55.975508 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:55.986913 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:31:56.070878 tst mo_mt_call.py: using LAC 24111 22:31:56.204054 tst mo_mt_call.py: using RAC 141 22:31:56.328867 tst mo_mt_call.py: using CellId 24111 22:31:56.454265 tst mo_mt_call.py: using BVCI 24112 22:31:56.571612 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:56.582930 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:56.593969 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:56.605008 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:56.616074 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:56.627156 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:31:56.746249 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:31:56.865564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:57.363828 run create_hlr_db(pid=24393): Launched 22:31:57.494836 bus /sierra_2: Setting Powered False 22:31:58.558099 run create_hlr_db(pid=24393): Terminated: ok {rc=0} 22:31:59.006871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24395): Launched 22:31:59.328584 run osmo-hlr_10.42.42.2(pid=24396): Launched 22:31:59.450999 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:00.002357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24398): Launched 22:32:00.323431 run osmo-stp_10.42.42.5(pid=24399): Launched 22:32:00.446588 run osmo-msc_10.42.42.6: Starting osmo-msc 22:32:01.050027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24401): Launched 22:32:01.385090 run osmo-msc_10.42.42.6(pid=24402): Launched 22:32:01.850783 run osmo-stp_10.42.42.5(pid=24399): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24399)] 22:32:02.053047 run osmo-stp_10.42.42.5(pid=24399): stdout: | (launched: 2022-12-09_22:32:00.265622) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:02.355602 run osmo-stp_10.42.42.5(pid=24399): stderr: | 20221209223200455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223200455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223200455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223200456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223200456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223200456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223200456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:02.498749 run osmo-stp_10.42.42.5(pid=24399): stdout: | (launched: 2022-12-09_22:32:00.265622) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:02.627474 run osmo-stp_10.42.42.5(pid=24399): stderr: | 20221209223200455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223200455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223200455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223200456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223200456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223200456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223200456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:02.781342 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24399): Process ended prematurely: osmo-stp_10.42.42.5(pid=24399) [trial-2365↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24399)] [trial-2365↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:32:02.790896 tst mo_mt_call.py:8: Test FAILED (6.9 sec) 22:32:02.818734 run osmo-hlr_10.42.42.2(pid=24396): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24396)] 22:32:02.869198 run osmo-hlr_10.42.42.2(pid=24396): stdout: | (launched: 2022-12-09_22:31:59.270360) 22:32:02.921813 run osmo-hlr_10.42.42.2(pid=24396): stderr: | 20221209223159469 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223159469 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223159469 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223159469 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223159469 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223159470 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223159484 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223159494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223159494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223159494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:02.994844 run osmo-msc_10.42.42.6(pid=24402): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24402)] 22:32:03.045245 run osmo-msc_10.42.42.6(pid=24402): stdout: | (launched: 2022-12-09_22:32:01.320843) 22:32:03.097447 run osmo-msc_10.42.42.6(pid=24402): stderr: | 20221209223202006 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223202006 DLGLOBAL DEBUG validating counter group 0x7f83bb3bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223202006 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223202006 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223202006 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223202007 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223202008 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223202009 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223202009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223202009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:32:03.149934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24395): Terminating (SIGTERM) 22:32:03.191585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24398): Terminating (SIGTERM) 22:32:03.233542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24401): Terminating (SIGTERM) 22:32:03.275793 --- ParallelTerminationStrategy: PID 24395 died... 22:32:03.295624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24395): Terminated: ok {rc=0} 22:32:03.342228 --- ParallelTerminationStrategy: PID 24398 died... 22:32:03.361945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24398): Terminated: ok {rc=0} 22:32:03.408329 --- ParallelTerminationStrategy: PID 24401 died... 22:32:03.427968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24401): Terminated: ok {rc=0} 22:32:03.515608 bus /sierra_3: Setting Powered False 22:32:04.616552 bus /sierra_3: Setting Powered False 22:32:05.732386 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:32:06.882500 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:06.894415 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:32:06.966996 tst mo_mt_call_osmux.py: using LAC 24112 22:32:07.094356 tst mo_mt_call_osmux.py: using RAC 142 22:32:07.226409 tst mo_mt_call_osmux.py: using CellId 24112 22:32:07.351819 tst mo_mt_call_osmux.py: using BVCI 24113 22:32:07.469142 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:07.480331 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:07.491363 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:07.502501 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:07.513658 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:07.524709 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:32:07.640453 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:32:07.761587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:08.260007 run create_hlr_db(pid=24404): Launched 22:32:08.391169 bus /sierra_2: Setting Powered False 22:32:09.454493 run create_hlr_db(pid=24404): Terminated: ok {rc=0} 22:32:09.903211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24406): Launched 22:32:10.225434 run osmo-hlr_10.42.42.2(pid=24407): Launched 22:32:10.349127 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:10.904827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24409): Launched 22:32:11.225429 run osmo-stp_10.42.42.5(pid=24410): Launched 22:32:11.349424 run osmo-msc_10.42.42.6: Starting osmo-msc 22:32:11.935946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24412): Launched 22:32:12.257521 run osmo-msc_10.42.42.6(pid=24413): Launched 22:32:12.439298 run osmo-stp_10.42.42.5(pid=24410): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24410)] 22:32:12.576122 run osmo-stp_10.42.42.5(pid=24410): stdout: | (launched: 2022-12-09_22:32:11.167375) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:12.714065 run osmo-stp_10.42.42.5(pid=24410): stderr: | 20221209223211360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223211360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223211360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223211361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223211361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223211361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223211361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:12.850761 run osmo-stp_10.42.42.5(pid=24410): stdout: | (launched: 2022-12-09_22:32:11.167375) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:12.980091 run osmo-stp_10.42.42.5(pid=24410): stderr: | 20221209223211360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223211360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223211360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223211361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223211361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223211361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223211361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:13.135232 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24410): Process ended prematurely: osmo-stp_10.42.42.5(pid=24410) [trial-2365↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24410)] [trial-2365↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:32:13.144568 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:32:13.172476 run osmo-hlr_10.42.42.2(pid=24407): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24407)] 22:32:13.222626 run osmo-hlr_10.42.42.2(pid=24407): stdout: | (launched: 2022-12-09_22:32:10.167329) 22:32:13.274340 run osmo-hlr_10.42.42.2(pid=24407): stderr: | 20221209223210365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223210365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223210365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223210365 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223210365 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223210365 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223210377 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223210386 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223210386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223210386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:13.346528 run osmo-msc_10.42.42.6(pid=24413): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24413)] 22:32:13.396728 run osmo-msc_10.42.42.6(pid=24413): stdout: | (launched: 2022-12-09_22:32:12.199108) 22:32:13.448427 run osmo-msc_10.42.42.6(pid=24413): stderr: | 20221209223212520 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223212520 DLGLOBAL DEBUG validating counter group 0x7fcaa091dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223212520 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223212520 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223212520 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223212521 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223212522 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223212523 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223212523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223212523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:32:13.500745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24406): Terminating (SIGTERM) 22:32:13.542599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24409): Terminating (SIGTERM) 22:32:13.584362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24412): Terminating (SIGTERM) 22:32:13.626673 --- ParallelTerminationStrategy: PID 24406 died... 22:32:13.646671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24406): Terminated: ok {rc=0} 22:32:13.693323 --- ParallelTerminationStrategy: PID 24409 died... 22:32:13.712885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24409): Terminated: ok {rc=0} 22:32:13.759606 --- ParallelTerminationStrategy: PID 24412 died... 22:32:13.779470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24412): Terminated: ok {rc=0} 22:32:13.867587 bus /sierra_3: Setting Powered False 22:32:14.967321 bus /sierra_3: Setting Powered False 22:32:16.086678 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 emergency:trx-lms --------------------------------------------------------------------- 22:32:17.352490 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:32:17.357036 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 22:32:17.390419 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 22:32:17.417149 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 22:32:17.502999 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 22:32:17.537301 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 22:32:17.564679 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 22:32:18.149537 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2365 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 22:32:18.154666 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:18.165627 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 22:32:18.215571 tst emergency_mo_mt_call.py: using LAC 24113 22:32:18.333365 tst emergency_mo_mt_call.py: using RAC 143 22:32:18.451567 tst emergency_mo_mt_call.py: using CellId 24113 22:32:18.569069 tst emergency_mo_mt_call.py: using BVCI 24114 22:32:18.678123 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:18.689162 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:18.699563 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:18.710455 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:18.721286 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:18.731757 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:18.849740 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:18.968298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:19.428322 run create_hlr_db(pid=24418): Launched 22:32:19.541222 bus /sierra_2: Setting Powered False 22:32:20.601221 run create_hlr_db(pid=24418): Terminated: ok {rc=0} 22:32:21.016561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24420): Launched 22:32:21.314034 run osmo-hlr_10.42.42.2(pid=24421): Launched 22:32:21.427266 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:21.947169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24423): Launched 22:32:22.242978 run osmo-stp_10.42.42.5(pid=24424): Launched 22:32:22.366334 tst emergency_mo_mt_call.py: using MSISDN 7407 22:32:22.516257 run osmo-msc_10.42.42.6: Starting osmo-msc 22:32:23.048442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24426): Launched 22:32:23.345244 run osmo-msc_10.42.42.6(pid=24427): Launched 22:32:23.511548 run osmo-stp_10.42.42.5(pid=24424): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24424)] 22:32:23.637468 run osmo-stp_10.42.42.5(pid=24424): stdout: | (launched: 2022-12-09_22:32:22.188912) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:23.763689 run osmo-stp_10.42.42.5(pid=24424): stderr: | 20221209223222361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223222361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223222361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223222362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223222362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223222362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223222362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:23.887397 run osmo-stp_10.42.42.5(pid=24424): stdout: | (launched: 2022-12-09_22:32:22.188912) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:24.005212 run osmo-stp_10.42.42.5(pid=24424): stderr: | 20221209223222361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223222361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223222361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223222362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223222362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223222362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223222362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:24.146061 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=24424): Process ended prematurely: osmo-stp_10.42.42.5(pid=24424) [trial-2365↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24424)] [trial-2365↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 22:32:24.154292 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 22:32:24.180785 run osmo-hlr_10.42.42.2(pid=24421): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24421)] 22:32:24.228543 run osmo-hlr_10.42.42.2(pid=24421): stdout: | (launched: 2022-12-09_22:32:21.259851) 22:32:24.277916 run osmo-hlr_10.42.42.2(pid=24421): stderr: | 20221209223221435 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223221435 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223221435 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223221435 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223221435 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223221435 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223221448 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223221456 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223221457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223221457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:24.347008 run osmo-msc_10.42.42.6(pid=24427): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24427)] 22:32:24.394881 run osmo-msc_10.42.42.6(pid=24427): stdout: | (launched: 2022-12-09_22:32:23.291095) 22:32:24.444241 run osmo-msc_10.42.42.6(pid=24427): stderr: | 20221209223223562 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223223563 DLGLOBAL DEBUG validating counter group 0x7f45b0b50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223223563 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223223563 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223223563 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223223564 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223223565 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223223566 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223223566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223223566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:32:24.494082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24420): Terminating (SIGTERM) 22:32:24.533791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24423): Terminating (SIGTERM) 22:32:24.573485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24426): Terminating (SIGTERM) 22:32:24.613402 --- ParallelTerminationStrategy: PID 24420 died... 22:32:24.632355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24420): Terminated: ok {rc=0} 22:32:24.676823 --- ParallelTerminationStrategy: PID 24423 died... 22:32:24.695784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24423): Terminated: ok {rc=0} 22:32:24.739882 --- ParallelTerminationStrategy: PID 24426 died... 22:32:24.758439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24426): Terminated: ok {rc=0} 22:32:24.844446 bus /sierra_3: Setting Powered False 22:32:25.944126 bus /sierra_3: Setting Powered False 22:32:27.059618 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 22:32:28.148239 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:28.159622 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 22:32:28.210923 tst emergency_preemptive_call.py: using LAC 24114 22:32:28.326309 tst emergency_preemptive_call.py: using RAC 144 22:32:28.443568 tst emergency_preemptive_call.py: using CellId 24114 22:32:28.561267 tst emergency_preemptive_call.py: using BVCI 24115 22:32:28.667920 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:28.678571 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:28.688886 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:28.699638 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:28.710338 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:28.720895 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:28.839342 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:28.958797 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:29.074374 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:29.189580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:29.650710 run create_hlr_db(pid=24429): Launched 22:32:29.763494 bus /sierra_2: Setting Powered False 22:32:30.822787 run create_hlr_db(pid=24429): Terminated: ok {rc=0} 22:32:31.318796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24431): Launched 22:32:31.701226 run osmo-hlr_10.42.42.2(pid=24432): Launched 22:32:31.992865 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:32.558497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24434): Launched 22:32:32.876589 run osmo-stp_10.42.42.5(pid=24435): Launched 22:32:33.006937 tst emergency_preemptive_call.py: using MSISDN 7408 22:32:33.171085 run osmo-msc_10.42.42.6: Starting osmo-msc 22:32:33.737327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24437): Launched 22:32:34.053405 run osmo-msc_10.42.42.6(pid=24438): Launched 22:32:34.230802 run osmo-stp_10.42.42.5(pid=24435): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24435)] 22:32:34.369174 run osmo-stp_10.42.42.5(pid=24435): stdout: | (launched: 2022-12-09_22:32:32.819122) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:34.502216 run osmo-stp_10.42.42.5(pid=24435): stderr: | 20221209223233010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223233010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223233010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223233011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223233011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223233011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223233011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:34.634239 run osmo-stp_10.42.42.5(pid=24435): stdout: | (launched: 2022-12-09_22:32:32.819122) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:34.760448 run osmo-stp_10.42.42.5(pid=24435): stderr: | 20221209223233010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223233010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223233010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223233011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223233011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223233011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223233011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:34.910784 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=24435): Process ended prematurely: osmo-stp_10.42.42.5(pid=24435) [trial-2365↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24435)] [trial-2365↪emergency:trx-lms↪emergency_preemptive_call.py:32] 22:32:34.919722 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 22:32:34.947562 run osmo-hlr_10.42.42.2(pid=24432): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24432)] 22:32:34.998547 run osmo-hlr_10.42.42.2(pid=24432): stdout: | (launched: 2022-12-09_22:32:31.633763) 22:32:35.050959 run osmo-hlr_10.42.42.2(pid=24432): stderr: | 20221209223231823 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223231823 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223231823 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223231823 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223231823 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223231823 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223231843 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223231855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223231855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223231855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:35.123833 run osmo-msc_10.42.42.6(pid=24438): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24438)] 22:32:35.174737 run osmo-msc_10.42.42.6(pid=24438): stdout: | (launched: 2022-12-09_22:32:33.995336) 22:32:35.227657 run osmo-msc_10.42.42.6(pid=24438): stderr: | 20221209223234316 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223234316 DLGLOBAL DEBUG validating counter group 0x7f4627803c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223234316 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223234316 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223234316 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223234317 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223234318 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223234319 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223234319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223234319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:32:35.280442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24431): Terminating (SIGTERM) 22:32:35.322964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24434): Terminating (SIGTERM) 22:32:35.365533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24437): Terminating (SIGTERM) 22:32:35.408225 --- ParallelTerminationStrategy: PID 24431 died... 22:32:35.428416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24431): Terminated: ok {rc=0} 22:32:35.475114 --- ParallelTerminationStrategy: PID 24434 died... 22:32:35.494956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24434): Terminated: ok {rc=0} 22:32:35.541313 --- ParallelTerminationStrategy: PID 24437 died... 22:32:35.561061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24437): Terminated: ok {rc=0} 22:32:35.650449 bus /sierra_9: Setting Powered False 22:32:36.746244 bus /sierra_9: Setting Powered False 22:32:37.861816 bus /sierra_8: Setting Powered False 22:32:38.961145 bus /sierra_8: Setting Powered False 22:32:40.078623 bus /sierra_3: Setting Powered False 22:32:41.179632 bus /sierra_3: Setting Powered False 22:32:42.298841 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-lms --------------------------------------------------------------------- 22:32:43.580236 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:32:43.584757 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 22:32:43.618453 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 22:32:43.657664 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 22:32:43.746515 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 22:32:43.780337 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 22:32:43.819947 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 22:32:44.410956 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 22:32:44.463126 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:44.474110 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:32:44.526992 tst cs_paging_gprs_active.py: using LAC 24115 22:32:44.646219 tst cs_paging_gprs_active.py: using RAC 145 22:32:44.762826 tst cs_paging_gprs_active.py: using CellId 24115 22:32:44.879591 tst cs_paging_gprs_active.py: using BVCI 24116 22:32:44.989079 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:44.999733 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:45.010334 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:45.020851 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:45.031532 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:45.042116 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:45.052771 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:45.063272 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:45.073983 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:32:45.193460 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:32:45.313422 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:32:45.530064 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:32:45.858174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24444): Launched 22:32:46.175409 run iperf3-srv_10.42.42.10(pid=24445): Launched 22:32:46.308920 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:32:46.530086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:32:46.854668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24446): Launched 22:32:47.209913 run iperf3-srv_10.42.42.10(pid=24447): Launched 22:32:47.339131 tst cs_paging_gprs_active.py:38: start network... 22:32:47.543901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:48.013236 run create_hlr_db(pid=24448): Launched 22:32:48.129270 bus /sierra_2: Setting Powered False 22:32:49.189924 run create_hlr_db(pid=24448): Terminated: ok {rc=0} 22:32:49.611964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24450): Launched 22:32:49.914420 run osmo-hlr_10.42.42.2(pid=24451): Launched 22:32:50.030179 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:50.566447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24453): Launched 22:32:50.870049 run osmo-stp_10.42.42.5(pid=24454): Launched 22:32:50.985728 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:32:51.504872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24456): Launched 22:32:51.621909 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:32:51.877610 run patchelf(pid=24457): Launched 22:32:52.048335 run osmo-stp_10.42.42.5(pid=24454): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24454)] 22:32:52.177369 run osmo-stp_10.42.42.5(pid=24454): stdout: | (launched: 2022-12-09_22:32:50.814704) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:52.307884 run osmo-stp_10.42.42.5(pid=24454): stderr: | 20221209223250984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223250984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223250985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223250985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223250986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223250986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223250986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:52.438764 run osmo-stp_10.42.42.5(pid=24454): stdout: | (launched: 2022-12-09_22:32:50.814704) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:52.563550 run osmo-stp_10.42.42.5(pid=24454): stderr: | 20221209223250984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223250984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223250985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223250985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223250986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223250986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223250986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:52.711704 run patchelf(pid=24457): Terminating (SIGINT) 22:32:52.884081 run patchelf(pid=24457): Terminated: ok {rc=0} 22:32:53.008157 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24454): Process ended prematurely: osmo-stp_10.42.42.5(pid=24454) [trial-2365↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24454)] [trial-2365↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 22:32:53.017604 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:32:53.044877 run osmo-hlr_10.42.42.2(pid=24451): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24451)] 22:32:53.093155 run osmo-hlr_10.42.42.2(pid=24451): stdout: | (launched: 2022-12-09_22:32:49.859519) 22:32:53.142747 run osmo-hlr_10.42.42.2(pid=24451): stderr: | 20221209223250033 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223250033 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223250033 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223250033 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223250033 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223250033 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223250046 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223250057 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223250057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223250057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:53.192728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24444): Terminating (SIGTERM) 22:32:53.232528 run iperf3-srv_10.42.42.10(pid=24445): Terminating (SIGTERM) 22:32:53.271951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24446): Terminating (SIGTERM) 22:32:53.311955 run iperf3-srv_10.42.42.10(pid=24447): Terminating (SIGTERM) 22:32:53.351358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24450): Terminating (SIGTERM) 22:32:53.390866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24453): Terminating (SIGTERM) 22:32:53.430275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24456): Terminating (SIGTERM) 22:32:53.469851 --- ParallelTerminationStrategy: PID 24444 died... 22:32:53.488633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24444): Terminated: ok {rc=0} 22:32:53.533095 --- ParallelTerminationStrategy: PID 24445 died... 22:32:53.551487 run iperf3-srv_10.42.42.10(pid=24445): Terminated {rc=256} 22:32:53.595411 --- ParallelTerminationStrategy: PID 24446 died... 22:32:53.613948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24446): Terminated: ok {rc=0} 22:32:53.657685 --- ParallelTerminationStrategy: PID 24447 died... 22:32:53.676038 run iperf3-srv_10.42.42.10(pid=24447): Terminated {rc=256} 22:32:53.720117 --- ParallelTerminationStrategy: PID 24450 died... 22:32:53.738625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24450): Terminated: ok {rc=0} 22:32:53.782757 --- ParallelTerminationStrategy: PID 24453 died... 22:32:53.801344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24453): Terminated: ok {rc=0} 22:32:53.845580 --- ParallelTerminationStrategy: PID 24456 died... 22:32:53.864062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24456): Terminated: ok {rc=0} 22:32:53.948149 bus /gobi_0: Setting Powered False 22:32:55.047459 bus /gobi_0: Setting Powered False 22:32:56.163813 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms iperf3.py ---------------------------------------------- 22:32:57.311381 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:57.322761 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:32:57.374107 tst iperf3.py: using LAC 24116 22:32:57.494699 tst iperf3.py: using RAC 146 22:32:57.612048 tst iperf3.py: using CellId 24116 22:32:57.736026 tst iperf3.py: using BVCI 24117 22:32:57.847018 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:57.857593 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:57.867882 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:57.878406 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:57.888811 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:57.899388 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:57.910469 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:57.920871 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:57.931594 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:32:58.046432 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:32:58.249130 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:32:58.551806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24458): Launched 22:32:58.816138 run iperf3-srv_10.42.42.10(pid=24459): Launched 22:32:58.930261 tst iperf3.py:8: start network... 22:32:59.132135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:59.599235 run create_hlr_db(pid=24460): Launched 22:32:59.714417 bus /gobi_6: Setting Powered False 22:33:00.774506 run create_hlr_db(pid=24460): Terminated: ok {rc=0} 22:33:01.219636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24463): Launched 22:33:01.545644 run osmo-hlr_10.42.42.2(pid=24464): Launched 22:33:01.709713 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:02.527258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24466): Launched 22:33:02.851903 run osmo-stp_10.42.42.5(pid=24467): Launched 22:33:02.974902 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:03.530394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24469): Launched 22:33:03.654451 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:03.926942 run patchelf(pid=24470): Launched 22:33:04.107276 run osmo-stp_10.42.42.5(pid=24467): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24467)] 22:33:04.244515 run osmo-stp_10.42.42.5(pid=24467): stdout: | (launched: 2022-12-09_22:33:02.792544) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:04.382974 run osmo-stp_10.42.42.5(pid=24467): stderr: | 20221209223302986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223302986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223302987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223302987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223302987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223302987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223302988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:04.521636 run osmo-stp_10.42.42.5(pid=24467): stdout: | (launched: 2022-12-09_22:33:02.792544) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:04.653771 run osmo-stp_10.42.42.5(pid=24467): stderr: | 20221209223302986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223302986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223302987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223302987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223302987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223302987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223302988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:04.810917 run patchelf(pid=24470): Terminating (SIGINT) 22:33:04.994152 run patchelf(pid=24470): Terminated: ok {rc=0} 22:33:05.125686 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24467): Process ended prematurely: osmo-stp_10.42.42.5(pid=24467) [trial-2365↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24467)] [trial-2365↪gprs:trx-lms↪iperf3.py:8] 22:33:05.135757 tst iperf3.py:8: Test FAILED (7.9 sec) 22:33:05.164371 run osmo-hlr_10.42.42.2(pid=24464): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24464)] 22:33:05.214455 run osmo-hlr_10.42.42.2(pid=24464): stdout: | (launched: 2022-12-09_22:33:01.479554) 22:33:05.266321 run osmo-hlr_10.42.42.2(pid=24464): stderr: | 20221209223301864 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223301864 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223301864 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223301865 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223301865 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223301865 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223301883 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223301910 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223301911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223301911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:05.318477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24458): Terminating (SIGTERM) 22:33:05.360463 run iperf3-srv_10.42.42.10(pid=24459): Terminating (SIGTERM) 22:33:05.402708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24463): Terminating (SIGTERM) 22:33:05.444876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24466): Terminating (SIGTERM) 22:33:05.486860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24469): Terminating (SIGTERM) 22:33:05.529144 --- ParallelTerminationStrategy: PID 24458 died... 22:33:05.549292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24458): Terminated: ok {rc=0} 22:33:05.596040 --- ParallelTerminationStrategy: PID 24459 died... 22:33:05.615530 run iperf3-srv_10.42.42.10(pid=24459): Terminated {rc=256} 22:33:05.661697 --- ParallelTerminationStrategy: PID 24463 died... 22:33:05.681317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24463): Terminated: ok {rc=0} 22:33:05.727880 --- ParallelTerminationStrategy: PID 24466 died... 22:33:05.747589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24466): Terminated: ok {rc=0} 22:33:05.793756 --- ParallelTerminationStrategy: PID 24469 died... 22:33:05.813537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24469): Terminated: ok {rc=0} 22:33:05.901535 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms iperf3m4.py ---------------------------------------------- 22:33:07.052016 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:07.063758 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:33:07.114248 tst iperf3m4.py: using LAC 24117 22:33:07.241355 tst iperf3m4.py: using RAC 147 22:33:07.366808 tst iperf3m4.py: using CellId 24117 22:33:07.494394 tst iperf3m4.py: using BVCI 24118 22:33:07.612783 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:07.623929 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:07.634769 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:07.645616 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:07.656260 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:07.667085 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:07.677996 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:07.688715 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:07.699893 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:07.820488 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:07.944158 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:08.063023 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:08.184379 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:33:08.387998 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:08.691254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24471): Launched 22:33:08.953966 run iperf3-srv_10.42.42.10(pid=24472): Launched 22:33:09.067191 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:33:09.268884 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:09.571067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24473): Launched 22:33:09.834081 run iperf3-srv_10.42.42.10(pid=24474): Launched 22:33:09.948104 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:33:10.150245 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:10.453723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24475): Launched 22:33:10.716909 run iperf3-srv_10.42.42.10(pid=24476): Launched 22:33:10.830507 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:33:11.032257 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:11.334538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24477): Launched 22:33:11.597336 run iperf3-srv_10.42.42.10(pid=24478): Launched 22:33:11.711738 tst iperf3m4.py:8: start network... 22:33:11.914645 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:12.383288 run create_hlr_db(pid=24479): Launched 22:33:12.499750 bus /gobi_6: Setting Powered False 22:33:13.559585 run create_hlr_db(pid=24479): Terminated: ok {rc=0} 22:33:13.979626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24481): Launched 22:33:14.281682 run osmo-hlr_10.42.42.2(pid=24482): Launched 22:33:14.398639 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:14.926026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24484): Launched 22:33:15.227650 run osmo-stp_10.42.42.5(pid=24485): Launched 22:33:15.343440 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:15.874759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24487): Launched 22:33:16.017887 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:16.293808 run patchelf(pid=24488): Launched 22:33:16.470111 run osmo-stp_10.42.42.5(pid=24485): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24485)] 22:33:16.602878 run osmo-stp_10.42.42.5(pid=24485): stdout: | (launched: 2022-12-09_22:33:15.172751) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:16.736496 run osmo-stp_10.42.42.5(pid=24485): stderr: | 20221209223315342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223315342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223315343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223315343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223315344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223315344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223315344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:16.870824 run osmo-stp_10.42.42.5(pid=24485): stdout: | (launched: 2022-12-09_22:33:15.172751) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:16.998234 run osmo-stp_10.42.42.5(pid=24485): stderr: | 20221209223315342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223315342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223315343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223315343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223315344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223315344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223315344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:17.149151 run patchelf(pid=24488): Terminating (SIGINT) 22:33:17.323870 run patchelf(pid=24488): Terminated: ok {rc=0} 22:33:17.448039 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24485): Process ended prematurely: osmo-stp_10.42.42.5(pid=24485) [trial-2365↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24485)] [trial-2365↪gprs:trx-lms↪iperf3m4.py:8] 22:33:17.457702 tst iperf3m4.py:8: Test FAILED (10.4 sec) 22:33:17.486260 run osmo-hlr_10.42.42.2(pid=24482): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24482)] 22:33:17.534647 run osmo-hlr_10.42.42.2(pid=24482): stdout: | (launched: 2022-12-09_22:33:14.226821) 22:33:17.584532 run osmo-hlr_10.42.42.2(pid=24482): stderr: | 20221209223314401 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223314401 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223314401 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223314401 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223314401 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223314401 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223314413 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223314421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223314421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223314421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:17.634610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24471): Terminating (SIGTERM) 22:33:17.674851 run iperf3-srv_10.42.42.10(pid=24472): Terminating (SIGTERM) 22:33:17.715062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24473): Terminating (SIGTERM) 22:33:17.755425 run iperf3-srv_10.42.42.10(pid=24474): Terminating (SIGTERM) 22:33:17.795579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24475): Terminating (SIGTERM) 22:33:17.835943 run iperf3-srv_10.42.42.10(pid=24476): Terminating (SIGTERM) 22:33:17.876078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24477): Terminating (SIGTERM) 22:33:17.916312 run iperf3-srv_10.42.42.10(pid=24478): Terminating (SIGTERM) 22:33:17.956429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24481): Terminating (SIGTERM) 22:33:17.996593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24484): Terminating (SIGTERM) 22:33:18.036718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24487): Terminating (SIGTERM) 22:33:18.077319 --- ParallelTerminationStrategy: PID 24471 died... 22:33:18.096432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24471): Terminated: ok {rc=0} 22:33:18.142017 --- ParallelTerminationStrategy: PID 24472 died... 22:33:18.160648 run iperf3-srv_10.42.42.10(pid=24472): Terminated {rc=256} 22:33:18.205514 --- ParallelTerminationStrategy: PID 24473 died... 22:33:18.224139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24473): Terminated: ok {rc=0} 22:33:18.268620 --- ParallelTerminationStrategy: PID 24474 died... 22:33:18.287265 run iperf3-srv_10.42.42.10(pid=24474): Terminated {rc=256} 22:33:18.332071 --- ParallelTerminationStrategy: PID 24475 died... 22:33:18.350807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24475): Terminated: ok {rc=0} 22:33:18.395413 --- ParallelTerminationStrategy: PID 24476 died... 22:33:18.414186 run iperf3-srv_10.42.42.10(pid=24476): Terminated {rc=256} 22:33:18.459046 --- ParallelTerminationStrategy: PID 24477 died... 22:33:18.477796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24477): Terminated: ok {rc=0} 22:33:18.522829 --- ParallelTerminationStrategy: PID 24478 died... 22:33:18.541692 run iperf3-srv_10.42.42.10(pid=24478): Terminated {rc=256} 22:33:18.586570 --- ParallelTerminationStrategy: PID 24481 died... 22:33:18.605411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24481): Terminated: ok {rc=0} 22:33:18.650051 --- ParallelTerminationStrategy: PID 24484 died... 22:33:18.668695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24484): Terminated: ok {rc=0} 22:33:18.714002 --- ParallelTerminationStrategy: PID 24487 died... 22:33:18.732782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24487): Terminated: ok {rc=0} 22:33:18.819676 bus /gobi_4: Setting Powered False 22:33:19.920166 bus /gobi_4: Setting Powered False 22:33:21.037309 bus /gobi_1: Setting Powered False 22:33:22.136914 bus /gobi_1: Setting Powered False 22:33:23.253783 bus /gobi_0: Setting Powered False 22:33:24.353143 bus /gobi_0: Setting Powered False 22:33:25.470376 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms ping.py ---------------------------------------------- 22:33:26.573422 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:26.585114 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:33:26.635969 tst ping.py: using LAC 24118 22:33:26.760893 tst ping.py: using RAC 148 22:33:26.885925 tst ping.py: using CellId 24118 22:33:27.008563 tst ping.py: using BVCI 24119 22:33:27.125128 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:27.136067 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:27.146996 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:27.157786 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:27.168531 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:27.179332 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:27.190244 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:27.201064 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:27.320479 tst ping.py:19: start network... 22:33:27.533931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:28.022320 run create_hlr_db(pid=24489): Launched 22:33:28.150423 bus /gobi_6: Setting Powered False 22:33:29.213096 run create_hlr_db(pid=24489): Terminated: ok {rc=0} 22:33:29.654383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24491): Launched 22:33:29.970762 run osmo-hlr_10.42.42.2(pid=24492): Launched 22:33:30.090899 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:30.635487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24494): Launched 22:33:30.977697 run osmo-stp_10.42.42.5(pid=24495): Launched 22:33:31.211133 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:31.853886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24497): Launched 22:33:31.987707 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:32.265817 run patchelf(pid=24498): Launched 22:33:32.434558 run osmo-stp_10.42.42.5(pid=24495): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24495)] 22:33:32.561624 run osmo-stp_10.42.42.5(pid=24495): stdout: | (launched: 2022-12-09_22:33:30.912854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:32.691081 run osmo-stp_10.42.42.5(pid=24495): stderr: | 20221209223331181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223331181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223331181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223331181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223331182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223331182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223331182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:32.820201 run osmo-stp_10.42.42.5(pid=24495): stdout: | (launched: 2022-12-09_22:33:30.912854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:32.942802 run osmo-stp_10.42.42.5(pid=24495): stderr: | 20221209223331181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223331181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223331181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223331181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223331182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223331182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223331182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:33.087625 run patchelf(pid=24498): Terminating (SIGINT) 22:33:33.257972 run patchelf(pid=24498): Terminated: ok {rc=0} 22:33:33.379954 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24495): Process ended prematurely: osmo-stp_10.42.42.5(pid=24495) [trial-2365↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24495)] [trial-2365↪gprs:trx-lms↪ping.py:22] 22:33:33.388938 tst ping.py:22: Test FAILED (6.8 sec) 22:33:33.416577 run osmo-hlr_10.42.42.2(pid=24492): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24492)] 22:33:33.464759 run osmo-hlr_10.42.42.2(pid=24492): stdout: | (launched: 2022-12-09_22:33:29.913651) 22:33:33.515004 run osmo-hlr_10.42.42.2(pid=24492): stderr: | 20221209223330111 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223330111 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223330111 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223330111 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223330111 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223330111 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223330125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223330134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223330134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223330135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:33.565515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24491): Terminating (SIGTERM) 22:33:33.605877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24494): Terminating (SIGTERM) 22:33:33.646807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24497): Terminating (SIGTERM) 22:33:33.687663 --- ParallelTerminationStrategy: PID 24491 died... 22:33:33.707200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24491): Terminated: ok {rc=0} 22:33:33.752393 --- ParallelTerminationStrategy: PID 24494 died... 22:33:33.771497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24494): Terminated: ok {rc=0} 22:33:33.816465 --- ParallelTerminationStrategy: PID 24497 died... 22:33:33.835349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24497): Terminated: ok {rc=0} 22:33:33.920308 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 22:33:35.006283 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:35.018400 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:33:35.071405 tst ping_idle_ping.py: using LAC 24119 22:33:35.203801 tst ping_idle_ping.py: using RAC 149 22:33:35.327803 tst ping_idle_ping.py: using CellId 24119 22:33:35.444730 tst ping_idle_ping.py: using BVCI 24120 22:33:35.553510 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:35.564227 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:35.574845 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:35.585783 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:35.596466 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:35.607176 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:35.617962 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:35.628661 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:35.744229 tst ping_idle_ping.py:24: start network... 22:33:35.944077 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:36.405348 run create_hlr_db(pid=24499): Launched 22:33:36.519560 bus /gobi_6: Setting Powered False 22:33:37.579925 run create_hlr_db(pid=24499): Terminated: ok {rc=0} 22:33:38.016521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24501): Launched 22:33:38.334490 run osmo-hlr_10.42.42.2(pid=24502): Launched 22:33:38.456372 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:39.003466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24504): Launched 22:33:39.320773 run osmo-stp_10.42.42.5(pid=24505): Launched 22:33:39.442572 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:39.991308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24507): Launched 22:33:40.113161 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:40.380472 run patchelf(pid=24508): Launched 22:33:40.556910 run osmo-stp_10.42.42.5(pid=24505): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24505)] 22:33:40.691448 run osmo-stp_10.42.42.5(pid=24505): stdout: | (launched: 2022-12-09_22:33:39.263085) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:40.828027 run osmo-stp_10.42.42.5(pid=24505): stderr: | 20221209223339454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223339454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223339454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223339454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223339455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223339455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223339455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:40.964129 run osmo-stp_10.42.42.5(pid=24505): stdout: | (launched: 2022-12-09_22:33:39.263085) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:41.093951 run osmo-stp_10.42.42.5(pid=24505): stderr: | 20221209223339454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223339454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223339454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223339454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223339455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223339455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223339455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:41.247645 run patchelf(pid=24508): Terminating (SIGINT) 22:33:41.426649 run patchelf(pid=24508): Terminated: ok {rc=0} 22:33:41.555370 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24505): Process ended prematurely: osmo-stp_10.42.42.5(pid=24505) [trial-2365↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24505)] [trial-2365↪gprs:trx-lms↪ping_idle_ping.py:27] 22:33:41.564941 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:33:41.593131 run osmo-hlr_10.42.42.2(pid=24502): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24502)] 22:33:41.643127 run osmo-hlr_10.42.42.2(pid=24502): stdout: | (launched: 2022-12-09_22:33:38.276709) 22:33:41.695353 run osmo-hlr_10.42.42.2(pid=24502): stderr: | 20221209223338474 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223338474 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223338474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223338474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223338474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223338474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223338491 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223338501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223338501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223338501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:41.747903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24501): Terminating (SIGTERM) 22:33:41.789662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24504): Terminating (SIGTERM) 22:33:41.831192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24507): Terminating (SIGTERM) 22:33:41.873161 --- ParallelTerminationStrategy: PID 24501 died... 22:33:41.893412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24501): Terminated: ok {rc=0} 22:33:41.939896 --- ParallelTerminationStrategy: PID 24504 died... 22:33:41.959567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24504): Terminated: ok {rc=0} 22:33:42.005705 --- ParallelTerminationStrategy: PID 24507 died... 22:33:42.025428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24507): Terminated: ok {rc=0} 22:33:42.113666 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 22:33:43.419075 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:33:43.425330 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:33:43.459693 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:33:43.498762 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:33:43.586928 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:33:43.620690 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:33:43.659788 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:33:44.257320 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:33:44.308940 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:44.320186 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:33:44.372115 tst cs_paging_gprs_active.py: using LAC 24120 22:33:44.505831 tst cs_paging_gprs_active.py: using RAC 150 22:33:44.631547 tst cs_paging_gprs_active.py: using CellId 24120 22:33:44.757949 tst cs_paging_gprs_active.py: using BVCI 24121 22:33:44.877240 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:44.888496 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:44.899631 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:44.910804 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:44.921877 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:44.932838 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:44.944105 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:44.955065 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:44.966278 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:33:45.087154 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:33:45.204773 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:33:45.410033 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:45.716157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24512): Launched 22:33:46.025813 run iperf3-srv_10.42.42.10(pid=24513): Launched 22:33:46.162083 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:33:46.386363 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:46.739105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24514): Launched 22:33:47.031353 run iperf3-srv_10.42.42.10(pid=24515): Launched 22:33:47.169314 tst cs_paging_gprs_active.py:38: start network... 22:33:47.387501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:47.891055 run create_hlr_db(pid=24516): Launched 22:33:48.022380 bus /gobi_6: Setting Powered False 22:33:49.086546 run create_hlr_db(pid=24516): Terminated: ok {rc=0} 22:33:49.536813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24518): Launched 22:33:49.861798 run osmo-hlr_10.42.42.2(pid=24519): Launched 22:33:49.984290 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:50.543153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24521): Launched 22:33:50.867614 run osmo-stp_10.42.42.5(pid=24522): Launched 22:33:50.991292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:51.548773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24524): Launched 22:33:51.673415 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:51.947277 run patchelf(pid=24526): Launched 22:33:52.128798 run osmo-stp_10.42.42.5(pid=24522): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24522)] 22:33:52.266037 run osmo-stp_10.42.42.5(pid=24522): stdout: | (launched: 2022-12-09_22:33:50.809356) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:52.404258 run osmo-stp_10.42.42.5(pid=24522): stderr: | 20221209223350998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223350998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223350999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223350999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223351001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223351001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223351002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:52.543011 run osmo-stp_10.42.42.5(pid=24522): stdout: | (launched: 2022-12-09_22:33:50.809356) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:52.675759 run osmo-stp_10.42.42.5(pid=24522): stderr: | 20221209223350998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223350998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223350999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223350999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223351001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223351001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223351002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:52.834016 run patchelf(pid=24526): Terminating (SIGINT) 22:33:53.016508 run patchelf(pid=24526): Terminated: ok {rc=0} 22:33:53.148060 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24522): Process ended prematurely: osmo-stp_10.42.42.5(pid=24522) [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24522)] [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:33:53.158297 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 22:33:53.186968 run osmo-hlr_10.42.42.2(pid=24519): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24519)] 22:33:53.237242 run osmo-hlr_10.42.42.2(pid=24519): stdout: | (launched: 2022-12-09_22:33:49.802870) 22:33:53.289338 run osmo-hlr_10.42.42.2(pid=24519): stderr: | 20221209223350003 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223350003 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223350003 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223350003 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223350003 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223350003 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223350015 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223350024 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223350024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223350024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:53.341909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24512): Terminating (SIGTERM) 22:33:53.383903 run iperf3-srv_10.42.42.10(pid=24513): Terminating (SIGTERM) 22:33:53.426109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24514): Terminating (SIGTERM) 22:33:53.468167 run iperf3-srv_10.42.42.10(pid=24515): Terminating (SIGTERM) 22:33:53.510318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24518): Terminating (SIGTERM) 22:33:53.552387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24521): Terminating (SIGTERM) 22:33:53.594665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24524): Terminating (SIGTERM) 22:33:53.637198 --- ParallelTerminationStrategy: PID 24512 died... 22:33:53.657448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24512): Terminated: ok {rc=0} 22:33:53.704291 --- ParallelTerminationStrategy: PID 24513 died... 22:33:53.724080 run iperf3-srv_10.42.42.10(pid=24513): Terminated {rc=256} 22:33:53.771010 --- ParallelTerminationStrategy: PID 24514 died... 22:33:53.791159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24514): Terminated: ok {rc=0} 22:33:53.837840 --- ParallelTerminationStrategy: PID 24515 died... 22:33:53.857606 run iperf3-srv_10.42.42.10(pid=24515): Terminated {rc=256} 22:33:53.904052 --- ParallelTerminationStrategy: PID 24518 died... 22:33:53.923742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24518): Terminated: ok {rc=0} 22:33:53.970986 --- ParallelTerminationStrategy: PID 24521 died... 22:33:53.990799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24521): Terminated: ok {rc=0} 22:33:54.037797 --- ParallelTerminationStrategy: PID 24524 died... 22:33:54.057601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24524): Terminated: ok {rc=0} 22:33:54.145390 bus /gobi_0: Setting Powered False 22:33:55.245645 bus /gobi_0: Setting Powered False 22:33:56.362534 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:33:57.508501 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:57.520146 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:33:57.570042 tst iperf3.py: using LAC 24121 22:33:57.688242 tst iperf3.py: using RAC 151 22:33:57.806169 tst iperf3.py: using CellId 24121 22:33:57.930067 tst iperf3.py: using BVCI 24122 22:33:58.041337 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:58.052243 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:58.063057 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:58.074198 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:58.085298 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:58.096274 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:58.107414 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:58.118142 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:58.129244 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:33:58.244278 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:33:58.448080 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:58.752272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24527): Launched 22:33:59.016880 run iperf3-srv_10.42.42.10(pid=24528): Launched 22:33:59.131726 tst iperf3.py:8: start network... 22:33:59.334644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:59.802057 run create_hlr_db(pid=24529): Launched 22:33:59.917564 bus /gobi_6: Setting Powered False 22:34:00.990535 run create_hlr_db(pid=24529): Terminated: ok {rc=0} 22:34:01.503825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24531): Launched 22:34:01.861752 run osmo-hlr_10.42.42.2(pid=24532): Launched 22:34:02.012161 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:02.680453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24534): Launched 22:34:03.003768 run osmo-stp_10.42.42.5(pid=24535): Launched 22:34:03.127217 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:34:03.681815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24537): Launched 22:34:03.807198 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:34:04.081793 run patchelf(pid=24538): Launched 22:34:04.264560 run osmo-stp_10.42.42.5(pid=24535): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24535)] 22:34:04.403556 run osmo-stp_10.42.42.5(pid=24535): stdout: | (launched: 2022-12-09_22:34:02.945405) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:04.543502 run osmo-stp_10.42.42.5(pid=24535): stderr: | 20221209223403139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223403139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223403139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223403140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223403140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223403140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223403140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:04.683589 run osmo-stp_10.42.42.5(pid=24535): stdout: | (launched: 2022-12-09_22:34:02.945405) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:04.817417 run osmo-stp_10.42.42.5(pid=24535): stderr: | 20221209223403139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223403139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223403139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223403140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223403140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223403140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223403140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:04.975250 run patchelf(pid=24538): Terminating (SIGINT) 22:34:05.159838 run patchelf(pid=24538): Terminated: ok {rc=0} 22:34:05.292669 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24535): Process ended prematurely: osmo-stp_10.42.42.5(pid=24535) [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24535)] [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 22:34:05.302839 tst iperf3.py:8: Test FAILED (7.8 sec) 22:34:05.331523 run osmo-hlr_10.42.42.2(pid=24532): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24532)] 22:34:05.381948 run osmo-hlr_10.42.42.2(pid=24532): stdout: | (launched: 2022-12-09_22:34:01.787984) 22:34:05.434224 run osmo-hlr_10.42.42.2(pid=24532): stderr: | 20221209223402169 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223402169 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223402169 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223402169 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223402169 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223402169 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223402183 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223402196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223402196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223402196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:05.486809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24527): Terminating (SIGTERM) 22:34:05.528902 run iperf3-srv_10.42.42.10(pid=24528): Terminating (SIGTERM) 22:34:05.571257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24531): Terminating (SIGTERM) 22:34:05.613728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24534): Terminating (SIGTERM) 22:34:05.656067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24537): Terminating (SIGTERM) 22:34:05.698629 --- ParallelTerminationStrategy: PID 24527 died... 22:34:05.718887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24527): Terminated: ok {rc=0} 22:34:05.766035 --- ParallelTerminationStrategy: PID 24528 died... 22:34:05.785690 run iperf3-srv_10.42.42.10(pid=24528): Terminated {rc=256} 22:34:05.832135 --- ParallelTerminationStrategy: PID 24531 died... 22:34:05.851815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24531): Terminated: ok {rc=0} 22:34:05.899028 --- ParallelTerminationStrategy: PID 24534 died... 22:34:05.918696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24534): Terminated: ok {rc=0} 22:34:05.965166 --- ParallelTerminationStrategy: PID 24537 died... 22:34:05.984714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24537): Terminated: ok {rc=0} 22:34:06.073268 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:34:07.221309 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:07.232796 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:34:07.284415 tst iperf3m4.py: using LAC 24122 22:34:07.404630 tst iperf3m4.py: using RAC 152 22:34:07.523002 tst iperf3m4.py: using CellId 24122 22:34:07.641638 tst iperf3m4.py: using BVCI 24123 22:34:07.762248 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:07.773819 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:07.785092 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:07.796846 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:07.808520 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:07.820197 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:07.831902 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:07.843229 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:07.854874 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:07.978916 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:08.099295 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:08.220753 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:08.339138 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:34:08.558445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:08.883672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24540): Launched 22:34:09.164812 run iperf3-srv_10.42.42.10(pid=24541): Launched 22:34:09.286576 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:34:09.504528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:09.829201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24542): Launched 22:34:10.110197 run iperf3-srv_10.42.42.10(pid=24543): Launched 22:34:10.231230 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:34:10.448119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:10.771930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24544): Launched 22:34:11.052912 run iperf3-srv_10.42.42.10(pid=24545): Launched 22:34:11.174165 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:34:11.390749 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:11.714100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24546): Launched 22:34:11.996041 run iperf3-srv_10.42.42.10(pid=24547): Launched 22:34:12.117304 tst iperf3m4.py:8: start network... 22:34:12.334268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:12.833648 run create_hlr_db(pid=24548): Launched 22:34:12.966544 bus /gobi_6: Setting Powered False 22:34:14.030804 run create_hlr_db(pid=24548): Terminated: ok {rc=0} 22:34:14.479258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24550): Launched 22:34:14.802587 run osmo-hlr_10.42.42.2(pid=24551): Launched 22:34:14.925369 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:15.488161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24553): Launched 22:34:15.810706 run osmo-stp_10.42.42.5(pid=24554): Launched 22:34:16.073975 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:34:16.799738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24556): Launched 22:34:16.947156 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:34:17.211300 run patchelf(pid=24557): Launched 22:34:17.400608 run osmo-stp_10.42.42.5(pid=24554): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24554)] 22:34:17.531298 run osmo-stp_10.42.42.5(pid=24554): stdout: | (launched: 2022-12-09_22:34:15.751663) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:17.662880 run osmo-stp_10.42.42.5(pid=24554): stderr: | 20221209223416025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223416025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223416026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223416026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223416028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223416029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223416029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:17.794357 run osmo-stp_10.42.42.5(pid=24554): stdout: | (launched: 2022-12-09_22:34:15.751663) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:17.919761 run osmo-stp_10.42.42.5(pid=24554): stderr: | 20221209223416025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223416025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223416026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223416026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223416028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223416029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223416029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:18.068620 run patchelf(pid=24557): Terminating (SIGINT) 22:34:18.243061 run patchelf(pid=24557): Terminated: ok {rc=0} 22:34:18.368567 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24554): Process ended prematurely: osmo-stp_10.42.42.5(pid=24554) [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24554)] [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 22:34:18.378289 tst iperf3m4.py:8: Test FAILED (11.2 sec) 22:34:18.407733 run osmo-hlr_10.42.42.2(pid=24551): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24551)] 22:34:18.457101 run osmo-hlr_10.42.42.2(pid=24551): stdout: | (launched: 2022-12-09_22:34:14.743697) 22:34:18.507890 run osmo-hlr_10.42.42.2(pid=24551): stderr: | 20221209223414941 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223414941 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223414941 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223414941 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223414941 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223414941 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223414954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223414965 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223414965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223414965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:18.558902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24540): Terminating (SIGTERM) 22:34:18.599993 run iperf3-srv_10.42.42.10(pid=24541): Terminating (SIGTERM) 22:34:18.641179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24542): Terminating (SIGTERM) 22:34:18.682698 run iperf3-srv_10.42.42.10(pid=24543): Terminating (SIGTERM) 22:34:18.723953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24544): Terminating (SIGTERM) 22:34:18.765791 run iperf3-srv_10.42.42.10(pid=24545): Terminating (SIGTERM) 22:34:18.807281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24546): Terminating (SIGTERM) 22:34:18.848784 run iperf3-srv_10.42.42.10(pid=24547): Terminating (SIGTERM) 22:34:18.890008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24550): Terminating (SIGTERM) 22:34:18.931369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24553): Terminating (SIGTERM) 22:34:18.972692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24556): Terminating (SIGTERM) 22:34:19.014173 --- ParallelTerminationStrategy: PID 24540 died... 22:34:19.033249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24540): Terminated: ok {rc=0} 22:34:19.079508 --- ParallelTerminationStrategy: PID 24541 died... 22:34:19.098554 run iperf3-srv_10.42.42.10(pid=24541): Terminated {rc=256} 22:34:19.144382 --- ParallelTerminationStrategy: PID 24542 died... 22:34:19.163415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24542): Terminated: ok {rc=0} 22:34:19.209552 --- ParallelTerminationStrategy: PID 24543 died... 22:34:19.228409 run iperf3-srv_10.42.42.10(pid=24543): Terminated {rc=256} 22:34:19.273896 --- ParallelTerminationStrategy: PID 24544 died... 22:34:19.292811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24544): Terminated: ok {rc=0} 22:34:19.338167 --- ParallelTerminationStrategy: PID 24545 died... 22:34:19.357206 run iperf3-srv_10.42.42.10(pid=24545): Terminated {rc=256} 22:34:19.402210 --- ParallelTerminationStrategy: PID 24546 died... 22:34:19.420876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24546): Terminated: ok {rc=0} 22:34:19.466177 --- ParallelTerminationStrategy: PID 24547 died... 22:34:19.485012 run iperf3-srv_10.42.42.10(pid=24547): Terminated {rc=256} 22:34:19.529952 --- ParallelTerminationStrategy: PID 24550 died... 22:34:19.549051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24550): Terminated: ok {rc=0} 22:34:19.594130 --- ParallelTerminationStrategy: PID 24553 died... 22:34:19.613160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24553): Terminated: ok {rc=0} 22:34:19.659115 --- ParallelTerminationStrategy: PID 24556 died... 22:34:19.678224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24556): Terminated: ok {rc=0} 22:34:19.763849 bus /gobi_4: Setting Powered False 22:34:20.863307 bus /gobi_4: Setting Powered False 22:34:21.980494 bus /gobi_1: Setting Powered False 22:34:23.080507 bus /gobi_1: Setting Powered False 22:34:24.196786 bus /gobi_0: Setting Powered False 22:34:25.296023 bus /gobi_0: Setting Powered False 22:34:26.415896 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 22:34:27.520028 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:27.531405 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:34:27.582359 tst ping.py: using LAC 24123 22:34:27.700747 tst ping.py: using RAC 153 22:34:27.817149 tst ping.py: using CellId 24123 22:34:27.942409 tst ping.py: using BVCI 24124 22:34:28.060270 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:28.071877 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:28.083216 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:28.094786 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:28.106580 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:28.118033 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:28.129977 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:28.141243 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:28.256051 tst ping.py:19: start network... 22:34:28.455306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:28.913694 run create_hlr_db(pid=24558): Launched 22:34:29.029189 bus /gobi_6: Setting Powered False 22:34:30.088365 run create_hlr_db(pid=24558): Terminated: ok {rc=0} 22:34:30.522685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24560): Launched 22:34:30.850805 run osmo-hlr_10.42.42.2(pid=24561): Launched 22:34:31.124759 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:31.771423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24563): Launched 22:34:32.091113 run osmo-stp_10.42.42.5(pid=24564): Launched 22:34:32.280295 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:34:32.871247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24566): Launched 22:34:32.993013 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:34:33.260754 run patchelf(pid=24567): Launched 22:34:33.437764 run osmo-stp_10.42.42.5(pid=24564): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24564)] 22:34:33.572661 run osmo-stp_10.42.42.5(pid=24564): stdout: | (launched: 2022-12-09_22:34:32.029013) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:33.709378 run osmo-stp_10.42.42.5(pid=24564): stderr: | 20221209223432383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223432383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223432383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223432383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223432384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223432384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223432384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:33.846568 run osmo-stp_10.42.42.5(pid=24564): stdout: | (launched: 2022-12-09_22:34:32.029013) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:33.976646 run osmo-stp_10.42.42.5(pid=24564): stderr: | 20221209223432383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223432383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223432383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223432383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223432384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223432384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223432384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:34.131302 run patchelf(pid=24567): Terminating (SIGINT) 22:34:34.310732 run patchelf(pid=24567): Terminated: ok {rc=0} 22:34:34.439505 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24564): Process ended prematurely: osmo-stp_10.42.42.5(pid=24564) [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24564)] [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 22:34:34.448886 tst ping.py:22: Test FAILED (6.9 sec) 22:34:34.477527 run osmo-hlr_10.42.42.2(pid=24561): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24561)] 22:34:34.527736 run osmo-hlr_10.42.42.2(pid=24561): stdout: | (launched: 2022-12-09_22:34:30.783765) 22:34:34.579953 run osmo-hlr_10.42.42.2(pid=24561): stderr: | 20221209223431079 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223431079 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223431079 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223431079 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223431079 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223431079 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223431096 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223431113 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223431113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223431113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:34.632542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24560): Terminating (SIGTERM) 22:34:34.674482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24563): Terminating (SIGTERM) 22:34:34.716448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24566): Terminating (SIGTERM) 22:34:34.759254 --- ParallelTerminationStrategy: PID 24560 died... 22:34:34.779846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24560): Terminated: ok {rc=0} 22:34:34.827119 --- ParallelTerminationStrategy: PID 24563 died... 22:34:34.847012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24563): Terminated: ok {rc=0} 22:34:34.893609 --- ParallelTerminationStrategy: PID 24566 died... 22:34:34.913489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24566): Terminated: ok {rc=0} 22:34:35.002713 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:34:36.090736 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:36.105874 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:34:36.157073 tst ping_idle_ping.py: using LAC 24124 22:34:36.282948 tst ping_idle_ping.py: using RAC 154 22:34:36.408921 tst ping_idle_ping.py: using CellId 24124 22:34:36.534302 tst ping_idle_ping.py: using BVCI 24125 22:34:36.652054 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:36.663580 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:36.674799 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:36.686478 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:36.697874 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:36.709074 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:36.720344 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:36.731372 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:36.850480 tst ping_idle_ping.py:24: start network... 22:34:37.064090 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:37.556114 run create_hlr_db(pid=24568): Launched 22:34:37.685230 bus /gobi_6: Setting Powered False 22:34:38.748440 run create_hlr_db(pid=24568): Terminated: ok {rc=0} 22:34:39.175772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24570): Launched 22:34:39.473952 run osmo-hlr_10.42.42.2(pid=24571): Launched 22:34:39.601681 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:40.159449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24573): Launched 22:34:40.477710 run osmo-stp_10.42.42.5(pid=24574): Launched 22:34:40.601455 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:34:41.154310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24576): Launched 22:34:41.276706 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:34:41.545099 run patchelf(pid=24577): Launched 22:34:41.721988 run osmo-stp_10.42.42.5(pid=24574): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24574)] 22:34:41.857663 run osmo-stp_10.42.42.5(pid=24574): stdout: | (launched: 2022-12-09_22:34:40.419982) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:41.994609 run osmo-stp_10.42.42.5(pid=24574): stderr: | 20221209223440611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223440611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223440612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223440612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223440613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223440613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223440613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:42.131682 run osmo-stp_10.42.42.5(pid=24574): stdout: | (launched: 2022-12-09_22:34:40.419982) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:42.262728 run osmo-stp_10.42.42.5(pid=24574): stderr: | 20221209223440611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223440611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223440612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223440612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223440613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223440613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223440613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:42.417205 run patchelf(pid=24577): Terminating (SIGINT) 22:34:42.597166 run patchelf(pid=24577): Terminated: ok {rc=0} 22:34:42.726748 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24574): Process ended prematurely: osmo-stp_10.42.42.5(pid=24574) [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24574)] [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 22:34:42.736171 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:34:42.764674 run osmo-hlr_10.42.42.2(pid=24571): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24571)] 22:34:42.815333 run osmo-hlr_10.42.42.2(pid=24571): stdout: | (launched: 2022-12-09_22:34:39.419000) 22:34:42.867371 run osmo-hlr_10.42.42.2(pid=24571): stderr: | 20221209223439614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223439614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223439614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223439614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223439614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223439614 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223439627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223439638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223439638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223439638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:42.919847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24570): Terminating (SIGTERM) 22:34:42.961918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24573): Terminating (SIGTERM) 22:34:43.004179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24576): Terminating (SIGTERM) 22:34:43.046858 --- ParallelTerminationStrategy: PID 24570 died... 22:34:43.067038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24570): Terminated: ok {rc=0} 22:34:43.114041 --- ParallelTerminationStrategy: PID 24573 died... 22:34:43.133997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24573): Terminated: ok {rc=0} 22:34:43.180747 --- ParallelTerminationStrategy: PID 24576 died... 22:34:43.200518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24576): Terminated: ok {rc=0} 22:34:43.288779 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:34:44.596388 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:34:44.602994 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:34:44.637301 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:34:44.677040 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:34:44.765698 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:34:44.800111 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:34:44.839682 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:34:45.435114 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:34:45.487735 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:45.499172 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:34:45.570298 tst cs_paging_gprs_active.py: using LAC 24125 22:34:45.698354 tst cs_paging_gprs_active.py: using RAC 155 22:34:45.827665 tst cs_paging_gprs_active.py: using CellId 24125 22:34:45.985322 tst cs_paging_gprs_active.py: using BVCI 24126 22:34:46.115503 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:46.127424 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:46.139519 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:46.151860 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:46.164064 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:46.176473 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:46.188509 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:46.200566 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:46.212586 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:34:46.335913 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:34:46.468398 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:34:46.755448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:47.195982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24581): Launched 22:34:47.496615 run iperf3-srv_10.42.42.10(pid=24582): Launched 22:34:47.617824 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:34:47.835213 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:48.159125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24583): Launched 22:34:48.441150 run iperf3-srv_10.42.42.10(pid=24584): Launched 22:34:48.562421 tst cs_paging_gprs_active.py:38: start network... 22:34:48.780410 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:49.280297 run create_hlr_db(pid=24585): Launched 22:34:49.412335 bus /gobi_6: Setting Powered False 22:34:50.475685 run create_hlr_db(pid=24585): Terminated: ok {rc=0} 22:34:50.924940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24587): Launched 22:34:51.247264 run osmo-hlr_10.42.42.2(pid=24588): Launched 22:34:51.370482 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:51.928727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24590): Launched 22:34:52.250096 run osmo-stp_10.42.42.5(pid=24591): Launched 22:34:52.373207 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:34:52.930532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24593): Launched 22:34:53.055189 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:34:53.334670 run patchelf(pid=24594): Launched 22:34:53.515388 run osmo-stp_10.42.42.5(pid=24591): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24591)] 22:34:53.652180 run osmo-stp_10.42.42.5(pid=24591): stdout: | (launched: 2022-12-09_22:34:52.191774) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:53.791069 run osmo-stp_10.42.42.5(pid=24591): stderr: | 20221209223452383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223452383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223452383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223452384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223452386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223452386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223452386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:53.929369 run osmo-stp_10.42.42.5(pid=24591): stdout: | (launched: 2022-12-09_22:34:52.191774) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:54.061902 run osmo-stp_10.42.42.5(pid=24591): stderr: | 20221209223452383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223452383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223452383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223452384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223452386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223452386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223452386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:54.219142 run patchelf(pid=24594): Terminating (SIGINT) 22:34:54.402941 run patchelf(pid=24594): Terminated: ok {rc=0} 22:34:54.534334 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24591): Process ended prematurely: osmo-stp_10.42.42.5(pid=24591) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24591)] [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:34:54.544386 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 22:34:54.573231 run osmo-hlr_10.42.42.2(pid=24588): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24588)] 22:34:54.623280 run osmo-hlr_10.42.42.2(pid=24588): stdout: | (launched: 2022-12-09_22:34:51.188809) 22:34:54.674993 run osmo-hlr_10.42.42.2(pid=24588): stderr: | 20221209223451388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223451388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223451388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223451388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223451388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223451388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223451401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223451410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223451410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223451410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:54.727765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24581): Terminating (SIGTERM) 22:34:54.769720 run iperf3-srv_10.42.42.10(pid=24582): Terminating (SIGTERM) 22:34:54.811841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24583): Terminating (SIGTERM) 22:34:54.853915 run iperf3-srv_10.42.42.10(pid=24584): Terminating (SIGTERM) 22:34:54.895645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24587): Terminating (SIGTERM) 22:34:54.937381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24590): Terminating (SIGTERM) 22:34:54.979281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24593): Terminating (SIGTERM) 22:34:55.021348 --- ParallelTerminationStrategy: PID 24581 died... 22:34:55.041149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24581): Terminated: ok {rc=0} 22:34:55.087649 --- ParallelTerminationStrategy: PID 24582 died... 22:34:55.107260 run iperf3-srv_10.42.42.10(pid=24582): Terminated {rc=256} 22:34:55.153329 --- ParallelTerminationStrategy: PID 24583 died... 22:34:55.172877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24583): Terminated: ok {rc=0} 22:34:55.219211 --- ParallelTerminationStrategy: PID 24584 died... 22:34:55.238955 run iperf3-srv_10.42.42.10(pid=24584): Terminated {rc=256} 22:34:55.285119 --- ParallelTerminationStrategy: PID 24587 died... 22:34:55.304853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24587): Terminated: ok {rc=0} 22:34:55.350868 --- ParallelTerminationStrategy: PID 24590 died... 22:34:55.370495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24590): Terminated: ok {rc=0} 22:34:55.416873 --- ParallelTerminationStrategy: PID 24593 died... 22:34:55.437143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24593): Terminated: ok {rc=0} 22:34:55.525303 bus /gobi_0: Setting Powered False 22:34:56.626769 bus /gobi_0: Setting Powered False 22:34:57.742897 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:34:58.891693 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:58.903613 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:34:58.974846 tst iperf3.py: using LAC 24126 22:34:59.102861 tst iperf3.py: using RAC 156 22:34:59.229828 tst iperf3.py: using CellId 24126 22:34:59.357072 tst iperf3.py: using BVCI 24127 22:34:59.468341 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:59.479388 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:59.490172 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:59.501291 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:59.512665 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:59.523868 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:59.534908 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:59.545787 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:59.556836 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:34:59.676380 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:34:59.879949 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:00.183248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24595): Launched 22:35:00.448817 run iperf3-srv_10.42.42.10(pid=24596): Launched 22:35:00.563601 tst iperf3.py:8: start network... 22:35:00.766531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:01.321294 run create_hlr_db(pid=24600): Launched 22:35:01.479210 bus /gobi_6: Setting Powered False 22:35:02.542727 run create_hlr_db(pid=24600): Terminated: ok {rc=0} 22:35:02.979581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24602): Launched 22:35:03.282723 run osmo-hlr_10.42.42.2(pid=24603): Launched 22:35:03.398847 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:03.937256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24605): Launched 22:35:04.240316 run osmo-stp_10.42.42.5(pid=24606): Launched 22:35:04.356857 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:35:04.892082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24608): Launched 22:35:05.009259 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:35:05.264649 run patchelf(pid=24609): Launched 22:35:05.434135 run osmo-stp_10.42.42.5(pid=24606): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24606)] 22:35:05.563211 run osmo-stp_10.42.42.5(pid=24606): stdout: | (launched: 2022-12-09_22:35:04.185409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:05.693659 run osmo-stp_10.42.42.5(pid=24606): stderr: | 20221209223504356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223504357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223504357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223504357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223504360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223504360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223504360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:05.824034 run osmo-stp_10.42.42.5(pid=24606): stdout: | (launched: 2022-12-09_22:35:04.185409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:05.948293 run osmo-stp_10.42.42.5(pid=24606): stderr: | 20221209223504356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223504357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223504357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223504357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223504360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223504360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223504360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:06.095427 run patchelf(pid=24609): Terminating (SIGINT) 22:35:06.267621 run patchelf(pid=24609): Terminated: ok {rc=0} 22:35:06.391558 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24606): Process ended prematurely: osmo-stp_10.42.42.5(pid=24606) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24606)] [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 22:35:06.400925 tst iperf3.py:8: Test FAILED (7.5 sec) 22:35:06.429081 run osmo-hlr_10.42.42.2(pid=24603): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24603)] 22:35:06.477454 run osmo-hlr_10.42.42.2(pid=24603): stdout: | (launched: 2022-12-09_22:35:03.227860) 22:35:06.527306 run osmo-hlr_10.42.42.2(pid=24603): stderr: | 20221209223503401 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223503401 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223503401 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223503401 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223503401 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223503401 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223503413 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223503421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223503421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223503421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:06.577625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24595): Terminating (SIGTERM) 22:35:06.617762 run iperf3-srv_10.42.42.10(pid=24596): Terminating (SIGTERM) 22:35:06.658027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24602): Terminating (SIGTERM) 22:35:06.698204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24605): Terminating (SIGTERM) 22:35:06.738205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24608): Terminating (SIGTERM) 22:35:06.778465 --- ParallelTerminationStrategy: PID 24595 died... 22:35:06.797675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24595): Terminated: ok {rc=0} 22:35:06.842567 --- ParallelTerminationStrategy: PID 24596 died... 22:35:06.861291 run iperf3-srv_10.42.42.10(pid=24596): Terminated {rc=256} 22:35:06.905761 --- ParallelTerminationStrategy: PID 24602 died... 22:35:06.924439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24602): Terminated: ok {rc=0} 22:35:06.969063 --- ParallelTerminationStrategy: PID 24605 died... 22:35:06.987712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24605): Terminated: ok {rc=0} 22:35:07.032483 --- ParallelTerminationStrategy: PID 24608 died... 22:35:07.051270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24608): Terminated: ok {rc=0} 22:35:07.134888 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:35:08.285858 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.297867 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:35:08.372431 tst iperf3m4.py: using LAC 24127 22:35:08.493162 tst iperf3m4.py: using RAC 157 22:35:08.610554 tst iperf3m4.py: using CellId 24127 22:35:08.727058 tst iperf3m4.py: using BVCI 24128 22:35:08.836564 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.847622 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.858606 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.869789 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.880695 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.891759 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.902953 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.914080 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.925301 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:09.045617 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:09.168930 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:09.287135 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:09.409391 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:35:09.627378 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:09.951357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24610): Launched 22:35:10.232364 run iperf3-srv_10.42.42.10(pid=24611): Launched 22:35:10.354291 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:35:10.572560 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:10.897371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24612): Launched 22:35:11.178361 run iperf3-srv_10.42.42.10(pid=24613): Launched 22:35:11.300131 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:35:11.517764 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:11.842372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24614): Launched 22:35:12.123602 run iperf3-srv_10.42.42.10(pid=24615): Launched 22:35:12.244835 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:35:12.462504 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:12.785773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24616): Launched 22:35:13.068826 run iperf3-srv_10.42.42.10(pid=24617): Launched 22:35:13.189649 tst iperf3m4.py:8: start network... 22:35:13.406178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:13.906070 run create_hlr_db(pid=24618): Launched 22:35:14.037871 bus /gobi_6: Setting Powered False 22:35:15.101542 run create_hlr_db(pid=24618): Terminated: ok {rc=0} 22:35:15.532669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24620): Launched 22:35:15.850177 run osmo-hlr_10.42.42.2(pid=24621): Launched 22:35:16.151871 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:16.694608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24623): Launched 22:35:17.025742 run osmo-stp_10.42.42.5(pid=24624): Launched 22:35:17.261624 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:35:17.867039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24626): Launched 22:35:17.990653 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:35:18.262176 run patchelf(pid=24627): Launched 22:35:18.442582 run osmo-stp_10.42.42.5(pid=24624): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24624)] 22:35:18.579912 run osmo-stp_10.42.42.5(pid=24624): stdout: | (launched: 2022-12-09_22:35:16.959288) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:18.718151 run osmo-stp_10.42.42.5(pid=24624): stderr: | 20221209223517270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223517270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223517270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223517271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223517271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223517271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223517271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:18.856735 run osmo-stp_10.42.42.5(pid=24624): stdout: | (launched: 2022-12-09_22:35:16.959288) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:18.988465 run osmo-stp_10.42.42.5(pid=24624): stderr: | 20221209223517270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223517270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223517270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223517271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223517271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223517271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223517271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:19.144226 run patchelf(pid=24627): Terminating (SIGINT) 22:35:19.326646 run patchelf(pid=24627): Terminated: ok {rc=0} 22:35:19.457319 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24624): Process ended prematurely: osmo-stp_10.42.42.5(pid=24624) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24624)] [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:35:19.467418 tst iperf3m4.py:8: Test FAILED (11.2 sec) 22:35:19.496246 run osmo-hlr_10.42.42.2(pid=24621): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24621)] 22:35:19.546328 run osmo-hlr_10.42.42.2(pid=24621): stdout: | (launched: 2022-12-09_22:35:15.779950) 22:35:19.597945 run osmo-hlr_10.42.42.2(pid=24621): stderr: | 20221209223516017 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223516017 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223516017 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223516017 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223516017 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223516018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223516033 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223516050 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223516050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223516050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:19.649989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24610): Terminating (SIGTERM) 22:35:19.692000 run iperf3-srv_10.42.42.10(pid=24611): Terminating (SIGTERM) 22:35:19.734133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24612): Terminating (SIGTERM) 22:35:19.776076 run iperf3-srv_10.42.42.10(pid=24613): Terminating (SIGTERM) 22:35:19.818199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24614): Terminating (SIGTERM) 22:35:19.860262 run iperf3-srv_10.42.42.10(pid=24615): Terminating (SIGTERM) 22:35:19.902180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24616): Terminating (SIGTERM) 22:35:19.944240 run iperf3-srv_10.42.42.10(pid=24617): Terminating (SIGTERM) 22:35:19.986278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24620): Terminating (SIGTERM) 22:35:20.028281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24623): Terminating (SIGTERM) 22:35:20.070324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24626): Terminating (SIGTERM) 22:35:20.112577 --- ParallelTerminationStrategy: PID 24610 died... 22:35:20.132758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24610): Terminated: ok {rc=0} 22:35:20.179534 --- ParallelTerminationStrategy: PID 24611 died... 22:35:20.199384 run iperf3-srv_10.42.42.10(pid=24611): Terminated {rc=256} 22:35:20.245715 --- ParallelTerminationStrategy: PID 24612 died... 22:35:20.265528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24612): Terminated: ok {rc=0} 22:35:20.312100 --- ParallelTerminationStrategy: PID 24613 died... 22:35:20.331944 run iperf3-srv_10.42.42.10(pid=24613): Terminated {rc=256} 22:35:20.378223 --- ParallelTerminationStrategy: PID 24614 died... 22:35:20.398016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24614): Terminated: ok {rc=0} 22:35:20.444399 --- ParallelTerminationStrategy: PID 24615 died... 22:35:20.464417 run iperf3-srv_10.42.42.10(pid=24615): Terminated {rc=256} 22:35:20.511080 --- ParallelTerminationStrategy: PID 24616 died... 22:35:20.530705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24616): Terminated: ok {rc=0} 22:35:20.577206 --- ParallelTerminationStrategy: PID 24617 died... 22:35:20.596896 run iperf3-srv_10.42.42.10(pid=24617): Terminated {rc=256} 22:35:20.643262 --- ParallelTerminationStrategy: PID 24620 died... 22:35:20.663092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24620): Terminated: ok {rc=0} 22:35:20.709422 --- ParallelTerminationStrategy: PID 24623 died... 22:35:20.729096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24623): Terminated: ok {rc=0} 22:35:20.775196 --- ParallelTerminationStrategy: PID 24626 died... 22:35:20.795307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24626): Terminated: ok {rc=0} 22:35:20.883216 bus /gobi_4: Setting Powered False 22:35:21.983246 bus /gobi_4: Setting Powered False 22:35:23.099286 bus /gobi_1: Setting Powered False 22:35:24.198954 bus /gobi_1: Setting Powered False 22:35:25.314736 bus /gobi_0: Setting Powered False 22:35:26.413623 bus /gobi_0: Setting Powered False 22:35:27.530637 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:35:28.631131 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:28.643027 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:35:28.713498 tst ping.py: using LAC 24128 22:35:28.830652 tst ping.py: using RAC 158 22:35:28.948440 tst ping.py: using CellId 24128 22:35:29.064003 tst ping.py: using BVCI 24129 22:35:29.171126 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:29.182049 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:29.192602 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:29.203221 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:29.214356 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:29.225275 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:29.236154 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:29.246986 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:29.361037 tst ping.py:19: start network... 22:35:29.559326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:30.017621 run create_hlr_db(pid=24628): Launched 22:35:30.132198 bus /gobi_6: Setting Powered False 22:35:31.191951 run create_hlr_db(pid=24628): Terminated: ok {rc=0} 22:35:31.627439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24630): Launched 22:35:32.017486 run osmo-hlr_10.42.42.2(pid=24631): Launched 22:35:32.202686 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:32.768158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24633): Launched 22:35:33.086330 run osmo-stp_10.42.42.5(pid=24634): Launched 22:35:33.206825 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:35:33.753888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24636): Launched 22:35:33.876233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:35:34.143321 run patchelf(pid=24637): Launched 22:35:34.319643 run osmo-stp_10.42.42.5(pid=24634): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24634)] 22:35:34.453958 run osmo-stp_10.42.42.5(pid=24634): stdout: | (launched: 2022-12-09_22:35:33.027495) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:34.590227 run osmo-stp_10.42.42.5(pid=24634): stderr: | 20221209223533218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223533218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223533218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223533219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223533221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223533221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223533221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:34.726551 run osmo-stp_10.42.42.5(pid=24634): stdout: | (launched: 2022-12-09_22:35:33.027495) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:34.857031 run osmo-stp_10.42.42.5(pid=24634): stderr: | 20221209223533218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223533218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223533218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223533219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223533221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223533221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223533221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:35.010522 run patchelf(pid=24637): Terminating (SIGINT) 22:35:35.189303 run patchelf(pid=24637): Terminated: ok {rc=0} 22:35:35.317707 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24634): Process ended prematurely: osmo-stp_10.42.42.5(pid=24634) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24634)] [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 22:35:35.327134 tst ping.py:22: Test FAILED (6.7 sec) 22:35:35.355414 run osmo-hlr_10.42.42.2(pid=24631): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24631)] 22:35:35.405610 run osmo-hlr_10.42.42.2(pid=24631): stdout: | (launched: 2022-12-09_22:35:31.954238) 22:35:35.457643 run osmo-hlr_10.42.42.2(pid=24631): stderr: | 20221209223532294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223532294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223532294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223532294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223532294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223532294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223532306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223532314 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223532314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223532314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:35.510162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24630): Terminating (SIGTERM) 22:35:35.552279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24633): Terminating (SIGTERM) 22:35:35.594553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24636): Terminating (SIGTERM) 22:35:35.636849 --- ParallelTerminationStrategy: PID 24630 died... 22:35:35.657187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24630): Terminated: ok {rc=0} 22:35:35.703936 --- ParallelTerminationStrategy: PID 24633 died... 22:35:35.723664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24633): Terminated: ok {rc=0} 22:35:35.770103 --- ParallelTerminationStrategy: PID 24636 died... 22:35:35.789984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24636): Terminated: ok {rc=0} 22:35:35.878852 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:35:36.968005 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:36.980474 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:35:37.054159 tst ping_idle_ping.py: using LAC 24129 22:35:37.179751 tst ping_idle_ping.py: using RAC 159 22:35:37.306450 tst ping_idle_ping.py: using CellId 24129 22:35:37.432419 tst ping_idle_ping.py: using BVCI 24130 22:35:37.549761 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:37.561141 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:37.572138 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:37.583269 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:37.594403 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:37.605569 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:37.616741 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:37.627840 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:37.743002 tst ping_idle_ping.py:24: start network... 22:35:37.945116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:38.410233 run create_hlr_db(pid=24638): Launched 22:35:38.525237 bus /gobi_6: Setting Powered False 22:35:39.584609 run create_hlr_db(pid=24638): Terminated: ok {rc=0} 22:35:40.022112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24640): Launched 22:35:40.339432 run osmo-hlr_10.42.42.2(pid=24641): Launched 22:35:40.460486 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:41.006172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24643): Launched 22:35:41.322677 run osmo-stp_10.42.42.5(pid=24644): Launched 22:35:41.444102 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:35:41.992141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24646): Launched 22:35:42.113816 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:35:42.381652 run patchelf(pid=24647): Launched 22:35:42.560419 run osmo-stp_10.42.42.5(pid=24644): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24644)] 22:35:42.697230 run osmo-stp_10.42.42.5(pid=24644): stdout: | (launched: 2022-12-09_22:35:41.265073) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:42.835482 run osmo-stp_10.42.42.5(pid=24644): stderr: | 20221209223541454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223541454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223541454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223541455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223541455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223541455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223541455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:42.973330 run osmo-stp_10.42.42.5(pid=24644): stdout: | (launched: 2022-12-09_22:35:41.265073) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:43.104519 run osmo-stp_10.42.42.5(pid=24644): stderr: | 20221209223541454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223541454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223541454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223541455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223541455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223541455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223541455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:43.259816 run patchelf(pid=24647): Terminating (SIGINT) 22:35:43.441343 run patchelf(pid=24647): Terminated: ok {rc=0} 22:35:43.571689 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24644): Process ended prematurely: osmo-stp_10.42.42.5(pid=24644) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24644)] [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:35:43.581814 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:35:43.610309 run osmo-hlr_10.42.42.2(pid=24641): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24641)] 22:35:43.660526 run osmo-hlr_10.42.42.2(pid=24641): stdout: | (launched: 2022-12-09_22:35:40.281732) 22:35:43.712513 run osmo-hlr_10.42.42.2(pid=24641): stderr: | 20221209223540479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223540479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223540479 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223540479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223540479 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223540479 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223540494 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223540504 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223540504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223540504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:43.764844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24640): Terminating (SIGTERM) 22:35:43.807000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24643): Terminating (SIGTERM) 22:35:43.849123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24646): Terminating (SIGTERM) 22:35:43.891402 --- ParallelTerminationStrategy: PID 24640 died... 22:35:43.911615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24640): Terminated: ok {rc=0} 22:35:43.958808 --- ParallelTerminationStrategy: PID 24643 died... 22:35:43.978704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24643): Terminated: ok {rc=0} 22:35:44.025174 --- ParallelTerminationStrategy: PID 24646 died... 22:35:44.044816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24646): Terminated: ok {rc=0} 22:35:44.133451 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:35:45.437645 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:35:45.444271 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:35:45.479306 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:35:45.519212 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:35:45.609393 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:35:45.643032 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:35:45.681362 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:35:46.302614 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:35:46.377652 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:46.394287 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:35:46.482908 tst cs_paging_gprs_active.py: using LAC 24130 22:35:46.612749 tst cs_paging_gprs_active.py: using RAC 160 22:35:46.733282 tst cs_paging_gprs_active.py: using CellId 24130 22:35:46.862484 tst cs_paging_gprs_active.py: using BVCI 24131 22:35:47.009022 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:47.023192 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:47.037113 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:47.051300 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:47.063610 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:47.075690 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:47.088625 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:47.100498 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:47.112495 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:35:47.230940 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:35:47.354404 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:35:47.558352 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:47.863094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24653): Launched 22:35:48.128158 run iperf3-srv_10.42.42.10(pid=24654): Launched 22:35:48.242348 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:35:48.445603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:48.749561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24655): Launched 22:35:49.016065 run iperf3-srv_10.42.42.10(pid=24656): Launched 22:35:49.130457 tst cs_paging_gprs_active.py:38: start network... 22:35:49.333642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:49.803322 run create_hlr_db(pid=24657): Launched 22:35:49.919465 bus /gobi_6: Setting Powered False 22:35:50.979961 run create_hlr_db(pid=24657): Terminated: ok {rc=0} 22:35:51.422430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24659): Launched 22:35:51.731873 run osmo-hlr_10.42.42.2(pid=24660): Launched 22:35:51.847006 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:52.381284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24662): Launched 22:35:52.686381 run osmo-stp_10.42.42.5(pid=24663): Launched 22:35:52.802400 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:35:53.324046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24665): Launched 22:35:53.441666 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:35:53.698192 run patchelf(pid=24666): Launched 22:35:53.869859 run osmo-stp_10.42.42.5(pid=24663): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24663)] 22:35:53.998851 run osmo-stp_10.42.42.5(pid=24663): stdout: | (launched: 2022-12-09_22:35:52.630212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:54.128927 run osmo-stp_10.42.42.5(pid=24663): stderr: | 20221209223552803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223552803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223552803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223552804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223552804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223552804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223552804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:54.259254 run osmo-stp_10.42.42.5(pid=24663): stdout: | (launched: 2022-12-09_22:35:52.630212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:54.383357 run osmo-stp_10.42.42.5(pid=24663): stderr: | 20221209223552803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223552803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223552803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223552804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223552804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223552804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223552804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:54.530817 run patchelf(pid=24666): Terminating (SIGINT) 22:35:54.702428 run patchelf(pid=24666): Terminated: ok {rc=0} 22:35:54.826755 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24663): Process ended prematurely: osmo-stp_10.42.42.5(pid=24663) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24663)] [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:35:54.836173 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 22:35:54.864013 run osmo-hlr_10.42.42.2(pid=24660): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24660)] 22:35:54.911899 run osmo-hlr_10.42.42.2(pid=24660): stdout: | (launched: 2022-12-09_22:35:51.675304) 22:35:54.961548 run osmo-hlr_10.42.42.2(pid=24660): stderr: | 20221209223551853 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223551853 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223551853 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223551853 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223551853 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223551853 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223551866 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223551874 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223551874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223551874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:55.011628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24653): Terminating (SIGTERM) 22:35:55.051776 run iperf3-srv_10.42.42.10(pid=24654): Terminating (SIGTERM) 22:35:55.091721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24655): Terminating (SIGTERM) 22:35:55.131711 run iperf3-srv_10.42.42.10(pid=24656): Terminating (SIGTERM) 22:35:55.171490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24659): Terminating (SIGTERM) 22:35:55.211470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24662): Terminating (SIGTERM) 22:35:55.251298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24665): Terminating (SIGTERM) 22:35:55.291446 --- ParallelTerminationStrategy: PID 24653 died... 22:35:55.310601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24653): Terminated: ok {rc=0} 22:35:55.355069 --- ParallelTerminationStrategy: PID 24654 died... 22:35:55.373671 run iperf3-srv_10.42.42.10(pid=24654): Terminated {rc=256} 22:35:55.417856 --- ParallelTerminationStrategy: PID 24655 died... 22:35:55.436473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24655): Terminated: ok {rc=0} 22:35:55.480493 --- ParallelTerminationStrategy: PID 24656 died... 22:35:55.499012 run iperf3-srv_10.42.42.10(pid=24656): Terminated {rc=256} 22:35:55.543139 --- ParallelTerminationStrategy: PID 24659 died... 22:35:55.561731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24659): Terminated: ok {rc=0} 22:35:55.606324 --- ParallelTerminationStrategy: PID 24662 died... 22:35:55.624844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24662): Terminated: ok {rc=0} 22:35:55.669264 --- ParallelTerminationStrategy: PID 24665 died... 22:35:55.687627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24665): Terminated: ok {rc=0} 22:35:55.771863 bus /gobi_0: Setting Powered False 22:35:56.870863 bus /gobi_0: Setting Powered False 22:35:57.990834 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:35:59.136886 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.148637 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:35:59.217970 tst iperf3.py: using LAC 24131 22:35:59.337127 tst iperf3.py: using RAC 161 22:35:59.464730 tst iperf3.py: using CellId 24131 22:35:59.594810 tst iperf3.py: using BVCI 24132 22:35:59.713424 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.724617 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.735766 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.746838 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.757815 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.768867 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.780255 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.791266 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.802466 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:35:59.919890 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:36:00.124439 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:36:00.429472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24667): Launched 22:36:00.697104 run iperf3-srv_10.42.42.10(pid=24668): Launched 22:36:00.812450 tst iperf3.py:8: start network... 22:36:01.032654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:01.524061 run create_hlr_db(pid=24669): Launched 22:36:01.655512 bus /gobi_6: Setting Powered False 22:36:02.717229 run create_hlr_db(pid=24669): Terminated: ok {rc=0} 22:36:03.158793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24671): Launched 22:36:03.482716 run osmo-hlr_10.42.42.2(pid=24672): Launched 22:36:03.607389 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:04.165243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24674): Launched 22:36:04.487848 run osmo-stp_10.42.42.5(pid=24675): Launched 22:36:04.611398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:36:05.166767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24677): Launched 22:36:05.290745 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:36:05.564181 run patchelf(pid=24678): Launched 22:36:05.744033 run osmo-stp_10.42.42.5(pid=24675): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24675)] 22:36:05.881543 run osmo-stp_10.42.42.5(pid=24675): stdout: | (launched: 2022-12-09_22:36:04.428090) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:06.019995 run osmo-stp_10.42.42.5(pid=24675): stderr: | 20221209223604620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223604621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223604621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223604621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223604622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223604622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223604622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:06.158655 run osmo-stp_10.42.42.5(pid=24675): stdout: | (launched: 2022-12-09_22:36:04.428090) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:06.290837 run osmo-stp_10.42.42.5(pid=24675): stderr: | 20221209223604620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223604621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223604621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223604621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223604622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223604622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223604622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:06.447244 run patchelf(pid=24678): Terminating (SIGINT) 22:36:06.630267 run patchelf(pid=24678): Terminated: ok {rc=0} 22:36:06.761723 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24675): Process ended prematurely: osmo-stp_10.42.42.5(pid=24675) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24675)] [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 22:36:06.771713 tst iperf3.py:8: Test FAILED (7.7 sec) 22:36:06.800518 run osmo-hlr_10.42.42.2(pid=24672): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24672)] 22:36:06.850872 run osmo-hlr_10.42.42.2(pid=24672): stdout: | (launched: 2022-12-09_22:36:03.423964) 22:36:06.902682 run osmo-hlr_10.42.42.2(pid=24672): stderr: | 20221209223603620 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223603620 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223603620 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223603620 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223603621 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223603621 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223603633 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223603641 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223603642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223603642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:06.954751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24667): Terminating (SIGTERM) 22:36:06.996103 run iperf3-srv_10.42.42.10(pid=24668): Terminating (SIGTERM) 22:36:07.037542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24671): Terminating (SIGTERM) 22:36:07.079027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24674): Terminating (SIGTERM) 22:36:07.122293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24677): Terminating (SIGTERM) 22:36:07.164203 --- ParallelTerminationStrategy: PID 24667 died... 22:36:07.184280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24667): Terminated: ok {rc=0} 22:36:07.230714 --- ParallelTerminationStrategy: PID 24668 died... 22:36:07.250238 run iperf3-srv_10.42.42.10(pid=24668): Terminated {rc=256} 22:36:07.296091 --- ParallelTerminationStrategy: PID 24671 died... 22:36:07.315798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24671): Terminated: ok {rc=0} 22:36:07.361650 --- ParallelTerminationStrategy: PID 24674 died... 22:36:07.381258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24674): Terminated: ok {rc=0} 22:36:07.427020 --- ParallelTerminationStrategy: PID 24677 died... 22:36:07.446627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24677): Terminated: ok {rc=0} 22:36:07.534229 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:36:08.687427 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:08.699471 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:36:08.770008 tst iperf3m4.py: using LAC 24132 22:36:08.897454 tst iperf3m4.py: using RAC 162 22:36:09.022385 tst iperf3m4.py: using CellId 24132 22:36:09.147289 tst iperf3m4.py: using BVCI 24133 22:36:09.265398 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:09.276665 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:09.287770 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:09.298867 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:09.309853 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:09.320811 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:09.332040 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:09.343024 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:09.354232 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:09.471398 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:09.594941 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:09.712879 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:09.834697 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:36:10.054016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:36:10.379181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24679): Launched 22:36:10.661778 run iperf3-srv_10.42.42.10(pid=24680): Launched 22:36:10.785156 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:36:11.006691 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:36:11.334485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24681): Launched 22:36:11.616641 run iperf3-srv_10.42.42.10(pid=24682): Launched 22:36:11.738323 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:36:11.956426 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:36:12.281363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24683): Launched 22:36:12.563758 run iperf3-srv_10.42.42.10(pid=24684): Launched 22:36:12.685504 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:36:12.904479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:36:13.229743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24685): Launched 22:36:13.511621 run iperf3-srv_10.42.42.10(pid=24686): Launched 22:36:13.633177 tst iperf3m4.py:8: start network... 22:36:13.850787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:14.353159 run create_hlr_db(pid=24687): Launched 22:36:14.485376 bus /gobi_6: Setting Powered False 22:36:15.549648 run create_hlr_db(pid=24687): Terminated: ok {rc=0} 22:36:16.021725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24689): Launched 22:36:16.388528 run osmo-hlr_10.42.42.2(pid=24690): Launched 22:36:16.547758 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:17.267235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24692): Launched 22:36:17.590442 run osmo-stp_10.42.42.5(pid=24693): Launched 22:36:17.713349 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:36:18.269814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24695): Launched 22:36:18.395215 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:36:18.670565 run patchelf(pid=24696): Launched 22:36:18.851201 run osmo-stp_10.42.42.5(pid=24693): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24693)] 22:36:18.989646 run osmo-stp_10.42.42.5(pid=24693): stdout: | (launched: 2022-12-09_22:36:17.531737) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:19.128078 run osmo-stp_10.42.42.5(pid=24693): stderr: | 20221209223617724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223617724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223617724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223617725 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223617727 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223617727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223617727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:19.266507 run osmo-stp_10.42.42.5(pid=24693): stdout: | (launched: 2022-12-09_22:36:17.531737) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:19.398690 run osmo-stp_10.42.42.5(pid=24693): stderr: | 20221209223617724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223617724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223617724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223617725 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223617727 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223617727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223617727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:19.555149 run patchelf(pid=24696): Terminating (SIGINT) 22:36:19.738390 run patchelf(pid=24696): Terminated: ok {rc=0} 22:36:19.870123 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24693): Process ended prematurely: osmo-stp_10.42.42.5(pid=24693) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24693)] [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:36:19.880284 tst iperf3m4.py:8: Test FAILED (11.2 sec) 22:36:19.909272 run osmo-hlr_10.42.42.2(pid=24690): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24690)] 22:36:19.959186 run osmo-hlr_10.42.42.2(pid=24690): stdout: | (launched: 2022-12-09_22:36:16.324166) 22:36:20.010801 run osmo-hlr_10.42.42.2(pid=24690): stderr: | 20221209223616697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223616697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223616697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223616698 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223616698 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223616698 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223616717 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223616734 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223616734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223616734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:20.062816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24679): Terminating (SIGTERM) 22:36:20.104583 run iperf3-srv_10.42.42.10(pid=24680): Terminating (SIGTERM) 22:36:20.146506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24681): Terminating (SIGTERM) 22:36:20.188411 run iperf3-srv_10.42.42.10(pid=24682): Terminating (SIGTERM) 22:36:20.230222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24683): Terminating (SIGTERM) 22:36:20.271992 run iperf3-srv_10.42.42.10(pid=24684): Terminating (SIGTERM) 22:36:20.313743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24685): Terminating (SIGTERM) 22:36:20.355649 run iperf3-srv_10.42.42.10(pid=24686): Terminating (SIGTERM) 22:36:20.397270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24689): Terminating (SIGTERM) 22:36:20.438915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24692): Terminating (SIGTERM) 22:36:20.480575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24695): Terminating (SIGTERM) 22:36:20.522873 --- ParallelTerminationStrategy: PID 24679 died... 22:36:20.542994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24679): Terminated: ok {rc=0} 22:36:20.589456 --- ParallelTerminationStrategy: PID 24680 died... 22:36:20.608808 run iperf3-srv_10.42.42.10(pid=24680): Terminated {rc=256} 22:36:20.655110 --- ParallelTerminationStrategy: PID 24681 died... 22:36:20.674717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24681): Terminated: ok {rc=0} 22:36:20.720805 --- ParallelTerminationStrategy: PID 24682 died... 22:36:20.740825 run iperf3-srv_10.42.42.10(pid=24682): Terminated {rc=256} 22:36:20.786812 --- ParallelTerminationStrategy: PID 24683 died... 22:36:20.806394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24683): Terminated: ok {rc=0} 22:36:20.852686 --- ParallelTerminationStrategy: PID 24684 died... 22:36:20.872392 run iperf3-srv_10.42.42.10(pid=24684): Terminated {rc=256} 22:36:20.918325 --- ParallelTerminationStrategy: PID 24685 died... 22:36:20.938144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24685): Terminated: ok {rc=0} 22:36:20.984658 --- ParallelTerminationStrategy: PID 24686 died... 22:36:21.004204 run iperf3-srv_10.42.42.10(pid=24686): Terminated {rc=256} 22:36:21.050072 --- ParallelTerminationStrategy: PID 24689 died... 22:36:21.069779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24689): Terminated: ok {rc=0} 22:36:21.115792 --- ParallelTerminationStrategy: PID 24692 died... 22:36:21.135373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24692): Terminated: ok {rc=0} 22:36:21.181379 --- ParallelTerminationStrategy: PID 24695 died... 22:36:21.201143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24695): Terminated: ok {rc=0} 22:36:21.292374 bus /gobi_4: Setting Powered False 22:36:22.390390 bus /gobi_4: Setting Powered False 22:36:23.506910 bus /gobi_1: Setting Powered False 22:36:24.606219 bus /gobi_1: Setting Powered False 22:36:25.722254 bus /gobi_0: Setting Powered False 22:36:26.821071 bus /gobi_0: Setting Powered False 22:36:27.937391 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:36:29.040810 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:29.052417 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:36:29.123691 tst ping.py: using LAC 24133 22:36:29.241739 tst ping.py: using RAC 163 22:36:29.372546 tst ping.py: using CellId 24133 22:36:29.496808 tst ping.py: using BVCI 24134 22:36:29.612714 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:29.624043 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:29.635191 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:29.646315 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:29.657377 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:29.668493 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:29.679687 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:29.690874 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:29.808731 tst ping.py:19: start network... 22:36:30.023692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:30.513783 run create_hlr_db(pid=24705): Launched 22:36:30.644021 bus /gobi_6: Setting Powered False 22:36:31.719915 run create_hlr_db(pid=24705): Terminated: ok {rc=0} 22:36:32.243498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24707): Launched 22:36:32.552244 run osmo-hlr_10.42.42.2(pid=24708): Launched 22:36:32.667396 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:33.197403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24710): Launched 22:36:33.497771 run osmo-stp_10.42.42.5(pid=24711): Launched 22:36:33.621804 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:36:34.180109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24713): Launched 22:36:34.302653 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:36:34.571329 run patchelf(pid=24714): Launched 22:36:34.749157 run osmo-stp_10.42.42.5(pid=24711): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24711)] 22:36:34.885184 run osmo-stp_10.42.42.5(pid=24711): stdout: | (launched: 2022-12-09_22:36:33.442468) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:35.022459 run osmo-stp_10.42.42.5(pid=24711): stderr: | 20221209223633629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223633630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223633630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223633630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223633631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223633631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223633631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:35.160472 run osmo-stp_10.42.42.5(pid=24711): stdout: | (launched: 2022-12-09_22:36:33.442468) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:35.290882 run osmo-stp_10.42.42.5(pid=24711): stderr: | 20221209223633629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223633630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223633630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223633630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223633631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223633631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223633631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:35.445400 run patchelf(pid=24714): Terminating (SIGINT) 22:36:35.625519 run patchelf(pid=24714): Terminated: ok {rc=0} 22:36:35.754993 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24711): Process ended prematurely: osmo-stp_10.42.42.5(pid=24711) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24711)] [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 22:36:35.764350 tst ping.py:22: Test FAILED (6.7 sec) 22:36:35.792589 run osmo-hlr_10.42.42.2(pid=24708): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24708)] 22:36:35.843316 run osmo-hlr_10.42.42.2(pid=24708): stdout: | (launched: 2022-12-09_22:36:32.497594) 22:36:35.895288 run osmo-hlr_10.42.42.2(pid=24708): stderr: | 20221209223632671 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223632671 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223632671 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223632671 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223632671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223632671 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223632684 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223632696 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223632696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223632696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:35.947732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24707): Terminating (SIGTERM) 22:36:35.989686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24710): Terminating (SIGTERM) 22:36:36.031626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24713): Terminating (SIGTERM) 22:36:36.074053 --- ParallelTerminationStrategy: PID 24707 died... 22:36:36.094292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24707): Terminated: ok {rc=0} 22:36:36.141067 --- ParallelTerminationStrategy: PID 24710 died... 22:36:36.160836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24710): Terminated: ok {rc=0} 22:36:36.207178 --- ParallelTerminationStrategy: PID 24713 died... 22:36:36.226856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24713): Terminated: ok {rc=0} 22:36:36.315732 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:36:37.403120 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:37.415052 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:36:37.487991 tst ping_idle_ping.py: using LAC 24134 22:36:37.613751 tst ping_idle_ping.py: using RAC 164 22:36:37.739409 tst ping_idle_ping.py: using CellId 24134 22:36:37.863947 tst ping_idle_ping.py: using BVCI 24135 22:36:37.979234 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:37.990613 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:38.001813 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:38.012912 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:38.024018 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:38.035152 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:38.046459 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:38.057594 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:38.177220 tst ping_idle_ping.py:24: start network... 22:36:38.391027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:38.885915 run create_hlr_db(pid=24715): Launched 22:36:39.014849 bus /gobi_6: Setting Powered False 22:36:40.078878 run create_hlr_db(pid=24715): Terminated: ok {rc=0} 22:36:40.525053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24717): Launched 22:36:40.843365 run osmo-hlr_10.42.42.2(pid=24718): Launched 22:36:40.965767 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:41.513227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24720): Launched 22:36:41.831000 run osmo-stp_10.42.42.5(pid=24721): Launched 22:36:41.952431 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:36:42.500888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24723): Launched 22:36:42.622801 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:36:42.891599 run patchelf(pid=24724): Launched 22:36:43.070215 run osmo-stp_10.42.42.5(pid=24721): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24721)] 22:36:43.205867 run osmo-stp_10.42.42.5(pid=24721): stdout: | (launched: 2022-12-09_22:36:41.772886) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:43.342305 run osmo-stp_10.42.42.5(pid=24721): stderr: | 20221209223641964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223641964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223641964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223641965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223641967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223641967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223641967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:43.478780 run osmo-stp_10.42.42.5(pid=24721): stdout: | (launched: 2022-12-09_22:36:41.772886) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:43.608828 run osmo-stp_10.42.42.5(pid=24721): stderr: | 20221209223641964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223641964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223641964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223641965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223641967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223641967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223641967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:43.762911 run patchelf(pid=24724): Terminating (SIGINT) 22:36:43.943166 run patchelf(pid=24724): Terminated: ok {rc=0} 22:36:44.071955 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24721): Process ended prematurely: osmo-stp_10.42.42.5(pid=24721) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24721)] [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:36:44.081702 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 22:36:44.110044 run osmo-hlr_10.42.42.2(pid=24718): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24718)] 22:36:44.160111 run osmo-hlr_10.42.42.2(pid=24718): stdout: | (launched: 2022-12-09_22:36:40.785062) 22:36:44.212023 run osmo-hlr_10.42.42.2(pid=24718): stderr: | 20221209223640981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223640981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223640981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223640981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223640981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223640981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223640993 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223641002 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223641002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223641002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:44.264274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24717): Terminating (SIGTERM) 22:36:44.306327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24720): Terminating (SIGTERM) 22:36:44.348427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24723): Terminating (SIGTERM) 22:36:44.390800 --- ParallelTerminationStrategy: PID 24717 died... 22:36:44.411079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24717): Terminated: ok {rc=0} 22:36:44.457737 --- ParallelTerminationStrategy: PID 24720 died... 22:36:44.477478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24720): Terminated: ok {rc=0} 22:36:44.523689 --- ParallelTerminationStrategy: PID 24723 died... 22:36:44.543417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24723): Terminated: ok {rc=0} 22:36:44.631406 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:36:45.950563 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:36:45.962317 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:36:45.996686 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:36:46.032796 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:36:46.086502 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:36:46.123953 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:36:46.160513 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:36:46.712768 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2365 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:36:46.718705 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:46.731180 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:36:46.807201 tst switch_tch_pdch.py: using LAC 24135 22:36:46.938649 tst switch_tch_pdch.py: using RAC 165 22:36:47.065458 tst switch_tch_pdch.py: using CellId 24135 22:36:47.185716 tst switch_tch_pdch.py: using BVCI 24136 22:36:47.300669 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:47.312931 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:47.324875 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:47.338532 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:47.349768 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:47.361118 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:47.372712 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:47.383985 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:36:47.503007 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:36:47.624172 tst switch_tch_pdch.py:51: start network... 22:36:47.825141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:48.285226 run create_hlr_db(pid=24728): Launched 22:36:48.399691 bus /gobi_6: Setting Powered False 22:36:49.459611 run create_hlr_db(pid=24728): Terminated: ok {rc=0} 22:36:49.895331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24730): Launched 22:36:50.212810 run osmo-hlr_10.42.42.2(pid=24731): Launched 22:36:50.333867 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:50.883322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24733): Launched 22:36:51.199822 run osmo-stp_10.42.42.5(pid=24734): Launched 22:36:51.321545 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:36:51.869224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24736): Launched 22:36:51.990825 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:36:52.258118 run patchelf(pid=24737): Launched 22:36:52.434516 run osmo-stp_10.42.42.5(pid=24734): ERR: Terminated: ERROR {rc=1} [trial-2365↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24734)] 22:36:52.569136 run osmo-stp_10.42.42.5(pid=24734): stdout: | (launched: 2022-12-09_22:36:51.141975) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:52.705394 run osmo-stp_10.42.42.5(pid=24734): stderr: | 20221209223651333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223651333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223651334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223651334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223651334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223651334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223651335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:52.841933 run osmo-stp_10.42.42.5(pid=24734): stdout: | (launched: 2022-12-09_22:36:51.141975) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:52.971595 run osmo-stp_10.42.42.5(pid=24734): stderr: | 20221209223651333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223651333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223651334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223651334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223651334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223651334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223651335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:53.125067 run patchelf(pid=24737): Terminating (SIGINT) 22:36:53.304925 run patchelf(pid=24737): Terminated: ok {rc=0} 22:36:53.433669 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24734): Process ended prematurely: osmo-stp_10.42.42.5(pid=24734) [trial-2365↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24734)] [trial-2365↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:36:53.443062 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 22:36:53.471023 run osmo-hlr_10.42.42.2(pid=24731): ERR: Terminated: ERROR {rc=237} [trial-2365↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24731)] 22:36:53.520882 run osmo-hlr_10.42.42.2(pid=24731): stdout: | (launched: 2022-12-09_22:36:50.155234) 22:36:53.572485 run osmo-hlr_10.42.42.2(pid=24731): stderr: | 20221209223650354 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223650354 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223650354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223650354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223650354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223650354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223650366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223650376 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223650376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223650376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:53.624229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24730): Terminating (SIGTERM) 22:36:53.665528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24733): Terminating (SIGTERM) 22:36:53.707057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24736): Terminating (SIGTERM) 22:36:53.748784 --- ParallelTerminationStrategy: PID 24730 died... 22:36:53.768902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24730): Terminated: ok {rc=0} 22:36:53.815027 --- ParallelTerminationStrategy: PID 24733 died... 22:36:53.834842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24733): Terminated: ok {rc=0} 22:36:53.880704 --- ParallelTerminationStrategy: PID 24736 died... 22:36:53.900244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24736): Terminated: ok {rc=0} 22:36:53.986593 bus /gobi_0: Setting Powered False 22:36:55.086698 bus /gobi_0: Setting Powered False 22:36:56.201617 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:36:57.456362 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:36:57.462471 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:36:57.496497 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:36:57.532214 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:36:57.586011 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:36:57.619533 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:36:57.654365 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:36:58.212057 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2365 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:36:58.217978 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:58.229433 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:36:58.297341 tst switch_tch_pdch.py: using LAC 24136 22:36:58.413818 tst switch_tch_pdch.py: using RAC 166 22:36:58.535353 tst switch_tch_pdch.py: using CellId 24136 22:36:58.651414 tst switch_tch_pdch.py: using BVCI 24137 22:36:58.758812 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:58.769825 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:58.780428 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:58.791348 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:58.802083 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:58.813029 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:58.824019 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:58.834927 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:36:58.952517 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:36:59.074724 tst switch_tch_pdch.py:51: start network... 22:36:59.289671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:59.752224 run create_hlr_db(pid=24741): Launched 22:36:59.882057 bus /gobi_6: Setting Powered False 22:37:00.947706 run create_hlr_db(pid=24741): Terminated: ok {rc=0} 22:37:01.473780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24743): Launched 22:37:01.800930 run osmo-hlr_10.42.42.2(pid=24744): Launched 22:37:02.126343 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:02.683756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24746): Launched 22:37:02.982598 run osmo-stp_10.42.42.5(pid=24747): Launched 22:37:03.097062 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:37:03.585813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24749): Launched 22:37:03.701984 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:37:03.955877 run patchelf(pid=24750): Launched 22:37:04.122153 run osmo-stp_10.42.42.5(pid=24747): ERR: Terminated: ERROR {rc=1} [trial-2365↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24747)] 22:37:04.248748 run osmo-stp_10.42.42.5(pid=24747): stdout: | (launched: 2022-12-09_22:37:02.927865) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:04.376692 run osmo-stp_10.42.42.5(pid=24747): stderr: | 20221209223703099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223703099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223703099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223703099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223703100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223703100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223703100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:04.505215 run osmo-stp_10.42.42.5(pid=24747): stdout: | (launched: 2022-12-09_22:37:02.927865) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:04.627177 run osmo-stp_10.42.42.5(pid=24747): stderr: | 20221209223703099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223703099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223703099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223703099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223703100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223703100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223703100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:04.771229 run patchelf(pid=24750): Terminating (SIGINT) 22:37:04.940347 run patchelf(pid=24750): Terminated: ok {rc=0} 22:37:05.061610 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24747): Process ended prematurely: osmo-stp_10.42.42.5(pid=24747) [trial-2365↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24747)] [trial-2365↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:37:05.070434 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 22:37:05.097603 run osmo-hlr_10.42.42.2(pid=24744): ERR: Terminated: ERROR {rc=237} [trial-2365↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24744)] 22:37:05.144866 run osmo-hlr_10.42.42.2(pid=24744): stdout: | (launched: 2022-12-09_22:37:01.736406) 22:37:05.193992 run osmo-hlr_10.42.42.2(pid=24744): stderr: | 20221209223701981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223701981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223701981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223701981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223701981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223701981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223701999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223702012 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223702013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223702013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:05.243625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24743): Terminating (SIGTERM) 22:37:05.283037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24746): Terminating (SIGTERM) 22:37:05.323040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24749): Terminating (SIGTERM) 22:37:05.362971 --- ParallelTerminationStrategy: PID 24743 died... 22:37:05.381958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24743): Terminated: ok {rc=0} 22:37:05.426196 --- ParallelTerminationStrategy: PID 24746 died... 22:37:05.444744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24746): Terminated: ok {rc=0} 22:37:05.489647 --- ParallelTerminationStrategy: PID 24749 died... 22:37:05.508242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24749): Terminated: ok {rc=0} 22:37:05.595402 bus /gobi_0: Setting Powered False 22:37:06.695795 bus /gobi_0: Setting Powered False 22:37:07.811449 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 22:37:09.058599 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:09.062487 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:37:09.091484 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 22:37:09.098182 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 22:37:09.150159 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:37:09.179136 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 22:37:09.185800 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 22:37:09.724757 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 22:37:09.729725 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 22:37:09.740487 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:37:09.784653 tst mo_mt_sms.py: using LAC 24137 22:37:09.902487 tst mo_mt_sms.py: using RAC 167 22:37:10.018191 tst mo_mt_sms.py: using CellId 24137 22:37:10.134272 tst mo_mt_sms.py: using BVCI 24138 22:37:10.241253 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 22:37:10.359172 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 22:37:10.472476 tst mo_mt_sms.py:9: start nitb and bts... 22:37:10.674138 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:37:11.280508 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24755): Launched 22:37:11.577876 run osmo-nitb_10.42.42.2(pid=24756): Launched 22:37:11.743210 run osmo-nitb_10.42.42.2(pid=24756): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24756)] 22:37:11.877108 run osmo-nitb_10.42.42.2(pid=24756): stdout: | (launched: 2022-12-09_22:37:11.523761) 22:37:12.012339 run osmo-nitb_10.42.42.2(pid=24756): stderr: | (launched: 2022-12-09_22:37:11.567844) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:37:12.147323 run osmo-nitb_10.42.42.2(pid=24756): stdout: | (launched: 2022-12-09_22:37:11.523761) 22:37:12.276349 run osmo-nitb_10.42.42.2(pid=24756): stderr: | (launched: 2022-12-09_22:37:11.567844) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24756): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24756) [trial-2365↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24756)] 22:37:12.690825 tst osmo-nitb_10.42.42.2(pid=24756): stdout: | (launched: 2022-12-09_22:37:11.523761) 22:37:12.812083 tst osmo-nitb_10.42.42.2(pid=24756): stderr: | (launched: 2022-12-09_22:37:11.567844) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:37:12.954936 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=24756): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24756) [trial-2365↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24756)] [trial-2365↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 22:37:12.963284 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 22:37:12.969894 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24755): Terminating (SIGTERM) 22:37:13.179366 --- ParallelTerminationStrategy: PID 24755 died... 22:37:13.200152 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24755): Terminated: ok {rc=0} 22:37:13.286635 bus /sierra_3: Setting Powered False 22:37:14.387627 bus /sierra_3: Setting Powered False 22:37:15.502170 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 22:37:16.698370 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:16.702312 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:37:16.740482 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 22:37:16.773539 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 22:37:16.837396 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:37:16.882905 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 22:37:16.918728 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 22:37:17.439767 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 22:37:17.445437 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:17.456557 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:37:17.501105 tst mo_mt_sms.py: using LAC 24138 22:37:17.615381 tst mo_mt_sms.py: using RAC 168 22:37:17.729981 tst mo_mt_sms.py: using CellId 24138 22:37:17.844546 tst mo_mt_sms.py: using BVCI 24139 22:37:17.951458 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:17.962100 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:17.972703 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:17.983453 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:17.994292 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:18.004912 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 22:37:18.124248 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 22:37:18.240568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:18.699560 run create_hlr_db(pid=24760): Launched 22:37:18.812278 bus /sierra_2: Setting Powered False 22:37:19.872583 run create_hlr_db(pid=24760): Terminated: ok {rc=0} 22:37:20.308151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24762): Launched 22:37:20.624720 run osmo-hlr_10.42.42.2(pid=24763): Launched 22:37:20.745097 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:21.292237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24765): Launched 22:37:21.611785 run osmo-stp_10.42.42.5(pid=24766): Launched 22:37:21.732277 run osmo-msc_10.42.42.6: Starting osmo-msc 22:37:22.307263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24768): Launched 22:37:22.607059 run osmo-msc_10.42.42.6(pid=24769): Launched 22:37:22.774714 run osmo-stp_10.42.42.5(pid=24766): ERR: Terminated: ERROR {rc=1} [trial-2365↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24766)] 22:37:22.900301 run osmo-stp_10.42.42.5(pid=24766): stdout: | (launched: 2022-12-09_22:37:21.554183) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:23.027371 run osmo-stp_10.42.42.5(pid=24766): stderr: | 20221209223721746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223721747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223721747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223721747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223721748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223721748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223721748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:23.151939 run osmo-stp_10.42.42.5(pid=24766): stdout: | (launched: 2022-12-09_22:37:21.554183) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:23.270107 run osmo-stp_10.42.42.5(pid=24766): stderr: | 20221209223721746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223721747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223721747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223721747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223721748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223721748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223721748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:23.411727 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=24766): Process ended prematurely: osmo-stp_10.42.42.5(pid=24766) [trial-2365↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24766)] [trial-2365↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 22:37:23.419907 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 22:37:23.446849 run osmo-hlr_10.42.42.2(pid=24763): ERR: Terminated: ERROR {rc=237} [trial-2365↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24763)] 22:37:23.495290 run osmo-hlr_10.42.42.2(pid=24763): stdout: | (launched: 2022-12-09_22:37:20.567091) 22:37:23.545278 run osmo-hlr_10.42.42.2(pid=24763): stderr: | 20221209223720768 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223720768 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223720768 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223720768 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223720768 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223720768 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223720780 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223720792 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223720792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223720792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:23.614744 run osmo-msc_10.42.42.6(pid=24769): ERR: Terminated: ERROR {rc=2} [trial-2365↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24769)] 22:37:23.662918 run osmo-msc_10.42.42.6(pid=24769): stdout: | (launched: 2022-12-09_22:37:22.552146) 22:37:23.712743 run osmo-msc_10.42.42.6(pid=24769): stderr: | 20221209223722822 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223722822 DLGLOBAL DEBUG validating counter group 0x7fed22108c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223722822 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223722822 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223722823 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223722823 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223722824 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223722825 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223722825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223722825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:37:23.763072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24762): Terminating (SIGTERM) 22:37:23.802982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24765): Terminating (SIGTERM) 22:37:23.842986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24768): Terminating (SIGTERM) 22:37:23.883183 --- ParallelTerminationStrategy: PID 24762 died... 22:37:23.902463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24762): Terminated: ok {rc=0} 22:37:23.947215 --- ParallelTerminationStrategy: PID 24765 died... 22:37:23.965968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24765): Terminated: ok {rc=0} 22:37:24.010892 --- ParallelTerminationStrategy: PID 24768 died... 22:37:24.029610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24768): Terminated: ok {rc=0} 22:37:24.115824 bus /sierra_3: Setting Powered False 22:37:25.218455 bus /sierra_3: Setting Powered False 22:37:26.336524 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 22:37:27.563167 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:27.567519 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:37:27.597187 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 22:37:27.604436 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 22:37:27.642445 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:37:27.672179 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 22:37:27.679013 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 22:37:28.196268 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2365 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 22:37:28.201582 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 22:37:28.212303 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:37:28.257791 tst assert_extension.py: using LAC 24139 22:37:28.377461 tst assert_extension.py: using RAC 169 22:37:28.503858 tst assert_extension.py: using CellId 24139 22:37:28.627479 tst assert_extension.py: using BVCI 24140 22:37:28.741782 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 22:37:28.858644 tst assert_extension.py:10: start nitb and bts... 22:37:29.058450 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:37:29.667628 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24774): Launched 22:37:29.966089 run osmo-nitb_10.42.42.2(pid=24775): Launched 22:37:30.131900 run osmo-nitb_10.42.42.2(pid=24775): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24775)] 22:37:30.266538 run osmo-nitb_10.42.42.2(pid=24775): stdout: | (launched: 2022-12-09_22:37:29.911390) 22:37:30.402296 run osmo-nitb_10.42.42.2(pid=24775): stderr: | (launched: 2022-12-09_22:37:29.955652) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:37:30.538210 run osmo-nitb_10.42.42.2(pid=24775): stdout: | (launched: 2022-12-09_22:37:29.911390) 22:37:30.668081 run osmo-nitb_10.42.42.2(pid=24775): stderr: | (launched: 2022-12-09_22:37:29.955652) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24775): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24775) [trial-2365↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24775)] 22:37:31.078898 tst osmo-nitb_10.42.42.2(pid=24775): stdout: | (launched: 2022-12-09_22:37:29.911390) 22:37:31.201450 tst osmo-nitb_10.42.42.2(pid=24775): stderr: | (launched: 2022-12-09_22:37:29.955652) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:37:31.347310 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=24775): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24775) [trial-2365↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24775)] [trial-2365↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 22:37:31.356091 tst assert_extension.py:12: Test FAILED (3.1 sec) 22:37:31.363252 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24774): Terminating (SIGTERM) 22:37:31.573971 --- ParallelTerminationStrategy: PID 24774 died... 22:37:31.596087 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24774): Terminated: ok {rc=0} 22:37:31.686547 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 22:37:32.881107 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:32.885916 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:37:32.918196 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 22:37:32.946287 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 22:37:32.982721 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:37:33.012924 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 22:37:33.040186 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 22:37:33.574880 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2365 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 22:37:33.581685 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:33.593735 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:37:33.645266 tst assert_extension.py: using LAC 24140 22:37:33.769969 tst assert_extension.py: using RAC 170 22:37:33.893151 tst assert_extension.py: using CellId 24140 22:37:34.015925 tst assert_extension.py: using BVCI 24141 22:37:34.132219 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:34.143642 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:34.154910 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:34.166707 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:34.178505 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:34.190328 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 22:37:34.306092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:34.766556 run create_hlr_db(pid=24779): Launched 22:37:34.880112 bus /sierra_2: Setting Powered False 22:37:35.942331 run create_hlr_db(pid=24779): Terminated: ok {rc=0} 22:37:36.378718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24781): Launched 22:37:36.696179 run osmo-hlr_10.42.42.2(pid=24782): Launched 22:37:36.817126 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:37.369534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24784): Launched 22:37:37.689591 run osmo-stp_10.42.42.5(pid=24785): Launched 22:37:37.811968 run osmo-msc_10.42.42.6: Starting osmo-msc 22:37:38.390220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24787): Launched 22:37:38.707324 run osmo-msc_10.42.42.6(pid=24788): Launched 22:37:38.885196 run osmo-stp_10.42.42.5(pid=24785): ERR: Terminated: ERROR {rc=1} [trial-2365↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24785)] 22:37:39.019157 run osmo-stp_10.42.42.5(pid=24785): stdout: | (launched: 2022-12-09_22:37:37.631399) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:39.153761 run osmo-stp_10.42.42.5(pid=24785): stderr: | 20221209223737825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223737825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223737826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223737826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223737826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223737827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223737827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:39.287052 run osmo-stp_10.42.42.5(pid=24785): stdout: | (launched: 2022-12-09_22:37:37.631399) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:39.413244 run osmo-stp_10.42.42.5(pid=24785): stderr: | 20221209223737825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223737825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223737826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223737826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223737826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223737827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223737827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:39.564429 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24785): Process ended prematurely: osmo-stp_10.42.42.5(pid=24785) [trial-2365↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24785)] [trial-2365↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 22:37:39.573189 tst assert_extension.py:17: Test FAILED (6.0 sec) 22:37:39.601043 run osmo-hlr_10.42.42.2(pid=24782): ERR: Terminated: ERROR {rc=237} [trial-2365↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24782)] 22:37:39.650939 run osmo-hlr_10.42.42.2(pid=24782): stdout: | (launched: 2022-12-09_22:37:36.638530) 22:37:39.702619 run osmo-hlr_10.42.42.2(pid=24782): stderr: | 20221209223736835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223736835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223736835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223736835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223736835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223736835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223736847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223736855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223736856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223736856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:39.774674 run osmo-msc_10.42.42.6(pid=24788): ERR: Terminated: ERROR {rc=2} [trial-2365↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24788)] 22:37:39.824514 run osmo-msc_10.42.42.6(pid=24788): stdout: | (launched: 2022-12-09_22:37:38.649658) 22:37:39.876390 run osmo-msc_10.42.42.6(pid=24788): stderr: | 20221209223738970 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223738970 DLGLOBAL DEBUG validating counter group 0x7ff29ac6fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223738970 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223738970 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223738971 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223738971 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223738973 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223738973 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223738973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223738973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:37:39.928192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24781): Terminating (SIGTERM) 22:37:39.969692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24784): Terminating (SIGTERM) 22:37:40.011094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24787): Terminating (SIGTERM) 22:37:40.052785 --- ParallelTerminationStrategy: PID 24781 died... 22:37:40.072406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24781): Terminated: ok {rc=0} 22:37:40.118549 --- ParallelTerminationStrategy: PID 24784 died... 22:37:40.138094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24784): Terminated: ok {rc=0} 22:37:40.183849 --- ParallelTerminationStrategy: PID 24787 died... 22:37:40.203348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24787): Terminated: ok {rc=0} 22:37:40.290340 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:37:41.495238 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:41.501843 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:37:41.531867 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:37:41.558448 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:37:41.610822 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:37:41.640417 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:37:41.666950 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:37:42.218494 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:37:42.267919 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:42.279325 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:37:42.347458 tst mo_mt_call.py: using LAC 24141 22:37:42.465640 tst mo_mt_call.py: using RAC 171 22:37:42.591507 tst mo_mt_call.py: using CellId 24141 22:37:42.717124 tst mo_mt_call.py: using BVCI 24142 22:37:42.834807 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:42.846703 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:42.858833 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:42.870893 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:42.882522 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:42.893986 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:37:43.010595 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:37:43.127217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:43.597180 run create_hlr_db(pid=24793): Launched 22:37:43.713548 bus /sierra_2: Setting Powered False 22:37:44.773878 run create_hlr_db(pid=24793): Terminated: ok {rc=0} 22:37:45.216256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24795): Launched 22:37:45.539425 run osmo-hlr_10.42.42.2(pid=24796): Launched 22:37:45.664370 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:46.281287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24798): Launched 22:37:46.621709 run osmo-stp_10.42.42.5(pid=24799): Launched 22:37:46.745712 run osmo-msc_10.42.42.6: Starting osmo-msc 22:37:47.493511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24801): Launched 22:37:47.819520 run osmo-msc_10.42.42.6(pid=24802): Launched 22:37:48.000101 run osmo-stp_10.42.42.5(pid=24799): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24799)] 22:37:48.135431 run osmo-stp_10.42.42.5(pid=24799): stdout: | (launched: 2022-12-09_22:37:46.551576) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:48.271864 run osmo-stp_10.42.42.5(pid=24799): stderr: | 20221209223746911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223746911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223746912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223746912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223746912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223746921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223746921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:48.407768 run osmo-stp_10.42.42.5(pid=24799): stdout: | (launched: 2022-12-09_22:37:46.551576) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:48.535976 run osmo-stp_10.42.42.5(pid=24799): stderr: | 20221209223746911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223746911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223746912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223746912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223746912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223746921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223746921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:48.689702 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24799): Process ended prematurely: osmo-stp_10.42.42.5(pid=24799) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24799)] [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:37:48.699083 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 22:37:48.726758 run osmo-hlr_10.42.42.2(pid=24796): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24796)] 22:37:48.776584 run osmo-hlr_10.42.42.2(pid=24796): stdout: | (launched: 2022-12-09_22:37:45.480705) 22:37:48.828320 run osmo-hlr_10.42.42.2(pid=24796): stderr: | 20221209223745677 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223745677 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223745677 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223745677 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223745677 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223745678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223745690 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223745700 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223745701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223745701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:48.900924 run osmo-msc_10.42.42.6(pid=24802): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24802)] 22:37:48.950803 run osmo-msc_10.42.42.6(pid=24802): stdout: | (launched: 2022-12-09_22:37:47.760362) 22:37:49.002587 run osmo-msc_10.42.42.6(pid=24802): stderr: | 20221209223748082 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223748082 DLGLOBAL DEBUG validating counter group 0x7f6d7d1e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223748082 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223748082 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223748083 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223748083 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223748084 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223748085 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223748085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223748085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:37:49.054507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24795): Terminating (SIGTERM) 22:37:49.096095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24798): Terminating (SIGTERM) 22:37:49.137798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24801): Terminating (SIGTERM) 22:37:49.179631 --- ParallelTerminationStrategy: PID 24795 died... 22:37:49.199597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24795): Terminated: ok {rc=0} 22:37:49.245624 --- ParallelTerminationStrategy: PID 24798 died... 22:37:49.265284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24798): Terminated: ok {rc=0} 22:37:49.311152 --- ParallelTerminationStrategy: PID 24801 died... 22:37:49.330700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24801): Terminated: ok {rc=0} 22:37:49.416911 bus /sierra_3: Setting Powered False 22:37:50.516033 bus /sierra_3: Setting Powered False 22:37:51.631489 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:37:52.780681 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:52.793292 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:37:52.861282 tst mo_mt_call_osmux.py: using LAC 24142 22:37:52.988494 tst mo_mt_call_osmux.py: using RAC 172 22:37:53.114340 tst mo_mt_call_osmux.py: using CellId 24142 22:37:53.241426 tst mo_mt_call_osmux.py: using BVCI 24143 22:37:53.360661 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:53.372382 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:53.383913 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:53.395471 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:53.407072 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:53.418575 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:37:53.534504 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:37:53.656254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:54.158013 run create_hlr_db(pid=24804): Launched 22:37:54.289545 bus /sierra_2: Setting Powered False 22:37:55.353843 run create_hlr_db(pid=24804): Terminated: ok {rc=0} 22:37:55.786940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24806): Launched 22:37:56.090337 run osmo-hlr_10.42.42.2(pid=24807): Launched 22:37:56.205664 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:56.746166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24809): Launched 22:37:57.048033 run osmo-stp_10.42.42.5(pid=24810): Launched 22:37:57.163158 run osmo-msc_10.42.42.6: Starting osmo-msc 22:37:57.712739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24812): Launched 22:37:58.016410 run osmo-msc_10.42.42.6(pid=24813): Launched 22:37:58.187395 run osmo-stp_10.42.42.5(pid=24810): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24810)] 22:37:58.315991 run osmo-stp_10.42.42.5(pid=24810): stdout: | (launched: 2022-12-09_22:37:56.992749) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:58.444826 run osmo-stp_10.42.42.5(pid=24810): stderr: | 20221209223757163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223757164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223757164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223757164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223757165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223757165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223757165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:58.571303 run osmo-stp_10.42.42.5(pid=24810): stdout: | (launched: 2022-12-09_22:37:56.992749) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:58.691636 run osmo-stp_10.42.42.5(pid=24810): stderr: | 20221209223757163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223757164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223757164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223757164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223757165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223757165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223757165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:58.835787 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24810): Process ended prematurely: osmo-stp_10.42.42.5(pid=24810) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24810)] [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:37:58.844561 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:37:58.871693 run osmo-hlr_10.42.42.2(pid=24807): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24807)] 22:37:58.919620 run osmo-hlr_10.42.42.2(pid=24807): stdout: | (launched: 2022-12-09_22:37:56.035033) 22:37:58.969349 run osmo-hlr_10.42.42.2(pid=24807): stderr: | 20221209223756211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223756211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223756211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223756211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223756211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223756211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223756223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223756232 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223756232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223756232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:59.038453 run osmo-msc_10.42.42.6(pid=24813): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24813)] 22:37:59.086281 run osmo-msc_10.42.42.6(pid=24813): stdout: | (launched: 2022-12-09_22:37:57.960603) 22:37:59.135684 run osmo-msc_10.42.42.6(pid=24813): stderr: | 20221209223758231 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223758231 DLGLOBAL DEBUG validating counter group 0x7f5fe16dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223758232 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223758232 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223758232 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223758232 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223758234 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223758234 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223758234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223758234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:37:59.185571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24806): Terminating (SIGTERM) 22:37:59.225154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24809): Terminating (SIGTERM) 22:37:59.264743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24812): Terminating (SIGTERM) 22:37:59.304819 --- ParallelTerminationStrategy: PID 24806 died... 22:37:59.323909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24806): Terminated: ok {rc=0} 22:37:59.368716 --- ParallelTerminationStrategy: PID 24809 died... 22:37:59.387462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24809): Terminated: ok {rc=0} 22:37:59.431719 --- ParallelTerminationStrategy: PID 24812 died... 22:37:59.450529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24812): Terminated: ok {rc=0} 22:37:59.536740 bus /sierra_3: Setting Powered False 22:38:00.635534 bus /sierra_3: Setting Powered False 22:38:01.765651 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:38:03.037436 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:38:03.045319 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:38:03.077670 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:38:03.106863 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:38:03.158654 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:38:03.189641 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:38:03.218257 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:38:03.773593 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:38:03.827858 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:03.840433 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:38:03.907805 tst mo_mt_call.py: using LAC 24143 22:38:04.037474 tst mo_mt_call.py: using RAC 173 22:38:04.169339 tst mo_mt_call.py: using CellId 24143 22:38:04.298451 tst mo_mt_call.py: using BVCI 24144 22:38:04.421136 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:04.433685 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:04.446135 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:04.458775 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:04.471437 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:04.483764 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:38:04.610339 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:38:04.734707 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:05.252263 run create_hlr_db(pid=24829): Launched 22:38:05.421306 bus /sierra_2: Setting Powered False 22:38:06.482709 run create_hlr_db(pid=24829): Terminated: ok {rc=0} 22:38:06.938006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24833): Launched 22:38:07.266405 run osmo-hlr_10.42.42.2(pid=24834): Launched 22:38:07.512672 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:08.241739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24836): Launched 22:38:08.570194 run osmo-stp_10.42.42.5(pid=24837): Launched 22:38:08.816078 run osmo-msc_10.42.42.6: Starting osmo-msc 22:38:09.548641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24839): Launched 22:38:09.881841 run osmo-msc_10.42.42.6(pid=24840): Launched 22:38:10.313449 run osmo-stp_10.42.42.5(pid=24837): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24837)] 22:38:10.595238 run osmo-stp_10.42.42.5(pid=24837): stdout: | (launched: 2022-12-09_22:38:08.508838) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:10.886984 run osmo-stp_10.42.42.5(pid=24837): stderr: | 20221209223808845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223808845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223808845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223808846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223808846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223808846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223808846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:11.071136 run osmo-stp_10.42.42.5(pid=24837): stdout: | (launched: 2022-12-09_22:38:08.508838) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:11.227897 run osmo-stp_10.42.42.5(pid=24837): stderr: | 20221209223808845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223808845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223808845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223808846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223808846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223808846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223808846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:11.419302 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24837): Process ended prematurely: osmo-stp_10.42.42.5(pid=24837) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24837)] [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:38:11.431402 tst mo_mt_call.py:8: Test FAILED (7.6 sec) 22:38:11.469866 run osmo-hlr_10.42.42.2(pid=24834): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24834)] 22:38:11.527621 run osmo-hlr_10.42.42.2(pid=24834): stdout: | (launched: 2022-12-09_22:38:07.204047) 22:38:11.591703 run osmo-hlr_10.42.42.2(pid=24834): stderr: | 20221209223807549 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223807549 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223807549 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223807549 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223807549 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223807549 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223807569 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223807582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223807582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223807582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:11.679040 run osmo-msc_10.42.42.6(pid=24840): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24840)] 22:38:11.744309 run osmo-msc_10.42.42.6(pid=24840): stdout: | (launched: 2022-12-09_22:38:09.819043) 22:38:11.809700 run osmo-msc_10.42.42.6(pid=24840): stderr: | 20221209223810501 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223810501 DLGLOBAL DEBUG validating counter group 0x7f60dd1f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223810501 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223810501 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223810501 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223810502 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223810503 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223810504 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223810504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223810504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:38:11.869906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24833): Terminating (SIGTERM) 22:38:11.923664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24836): Terminating (SIGTERM) 22:38:11.983613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24839): Terminating (SIGTERM) 22:38:12.037526 --- ParallelTerminationStrategy: PID 24833 died... 22:38:12.061919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24833): Terminated: ok {rc=0} 22:38:12.120061 --- ParallelTerminationStrategy: PID 24836 died... 22:38:12.148609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24836): Terminated: ok {rc=0} 22:38:12.205015 --- ParallelTerminationStrategy: PID 24839 died... 22:38:12.228862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24839): Terminated: ok {rc=0} 22:38:12.333451 bus /sierra_3: Setting Powered False 22:38:13.445404 bus /sierra_3: Setting Powered False 22:38:14.563202 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:38:15.714133 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:15.728392 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:38:15.797754 tst mo_mt_call_osmux.py: using LAC 24144 22:38:15.942750 tst mo_mt_call_osmux.py: using RAC 174 22:38:16.093704 tst mo_mt_call_osmux.py: using CellId 24144 22:38:16.249655 tst mo_mt_call_osmux.py: using BVCI 24145 22:38:16.417605 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:16.432084 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:16.448573 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:16.465524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:16.480550 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:16.496998 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:38:16.676128 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:38:16.849371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:17.347059 run create_hlr_db(pid=25100): Launched 22:38:17.509467 bus /sierra_2: Setting Powered False 22:38:18.575547 run create_hlr_db(pid=25100): Terminated: ok {rc=0} 22:38:19.044910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25102): Launched 22:38:19.394463 run osmo-hlr_10.42.42.2(pid=25103): Launched 22:38:19.651016 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:20.309706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25105): Launched 22:38:20.659717 run osmo-stp_10.42.42.5(pid=25106): Launched 22:38:20.907569 run osmo-msc_10.42.42.6: Starting osmo-msc 22:38:21.604994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25108): Launched 22:38:21.958994 run osmo-msc_10.42.42.6(pid=25109): Launched 22:38:22.285348 run osmo-stp_10.42.42.5(pid=25106): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25106)] 22:38:22.570388 run osmo-stp_10.42.42.5(pid=25106): stdout: | (launched: 2022-12-09_22:38:20.594703) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:22.786220 run osmo-stp_10.42.42.5(pid=25106): stderr: | 20221209223820909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223820909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223820910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223820910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223820911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223820911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223820911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:22.928051 run osmo-stp_10.42.42.5(pid=25106): stdout: | (launched: 2022-12-09_22:38:20.594703) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:23.061553 run osmo-stp_10.42.42.5(pid=25106): stderr: | 20221209223820909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223820909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223820910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223820910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223820911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223820911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223820911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:23.222363 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25106): Process ended prematurely: osmo-stp_10.42.42.5(pid=25106) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25106)] [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:38:23.232834 tst mo_mt_call_osmux.py:8: Test FAILED (7.6 sec) 22:38:23.262788 run osmo-hlr_10.42.42.2(pid=25103): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25103)] 22:38:23.315910 run osmo-hlr_10.42.42.2(pid=25103): stdout: | (launched: 2022-12-09_22:38:19.330508) 22:38:23.370729 run osmo-hlr_10.42.42.2(pid=25103): stderr: | 20221209223819646 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223819646 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223819646 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223819646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223819646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223819646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223819678 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223819686 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223819686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223819687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:23.445834 run osmo-msc_10.42.42.6(pid=25109): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25109)] 22:38:23.498383 run osmo-msc_10.42.42.6(pid=25109): stdout: | (launched: 2022-12-09_22:38:21.891974) 22:38:23.553175 run osmo-msc_10.42.42.6(pid=25109): stderr: | 20221209223822445 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223822445 DLGLOBAL DEBUG validating counter group 0x7ff4e07eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223822445 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223822446 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223822446 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223822446 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223822451 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223822451 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223822453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223822453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:38:23.607946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25102): Terminating (SIGTERM) 22:38:23.652102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25105): Terminating (SIGTERM) 22:38:23.698230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25108): Terminating (SIGTERM) 22:38:23.745377 --- ParallelTerminationStrategy: PID 25102 died... 22:38:23.766770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25102): Terminated: ok {rc=0} 22:38:23.816636 --- ParallelTerminationStrategy: PID 25105 died... 22:38:23.837623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25105): Terminated: ok {rc=0} 22:38:23.887013 --- ParallelTerminationStrategy: PID 25108 died... 22:38:23.909108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25108): Terminated: ok {rc=0} 22:38:24.002296 bus /sierra_3: Setting Powered False 22:38:25.101923 bus /sierra_3: Setting Powered False 22:38:26.217236 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:38:27.461219 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:38:27.467739 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:38:27.498042 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:38:27.524895 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:38:27.577743 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:38:27.607559 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:38:27.633820 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:38:28.185308 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:38:28.239953 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:28.251824 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:38:28.321300 tst mo_mt_call.py: using LAC 24145 22:38:28.449176 tst mo_mt_call.py: using RAC 175 22:38:28.577283 tst mo_mt_call.py: using CellId 24145 22:38:28.706369 tst mo_mt_call.py: using BVCI 24146 22:38:28.824732 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:28.836422 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:28.847835 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:28.859221 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:28.870722 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:28.882598 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:38:29.002155 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:38:29.118663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:29.587817 run create_hlr_db(pid=25115): Launched 22:38:29.704683 bus /sierra_2: Setting Powered False 22:38:30.765993 run create_hlr_db(pid=25115): Terminated: ok {rc=0} 22:38:31.274919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25117): Launched 22:38:31.612487 run osmo-hlr_10.42.42.2(pid=25118): Launched 22:38:31.752297 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:32.481305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25120): Launched 22:38:32.785328 run osmo-stp_10.42.42.5(pid=25121): Launched 22:38:32.901577 run osmo-msc_10.42.42.6: Starting osmo-msc 22:38:33.453012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25123): Launched 22:38:33.757568 run osmo-msc_10.42.42.6(pid=25124): Launched 22:38:33.929787 run osmo-stp_10.42.42.5(pid=25121): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25121)] 22:38:34.060447 run osmo-stp_10.42.42.5(pid=25121): stdout: | (launched: 2022-12-09_22:38:32.729697) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:34.190789 run osmo-stp_10.42.42.5(pid=25121): stderr: | 20221209223832900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223832900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223832900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223832901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223832901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223832901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223832901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:34.318754 run osmo-stp_10.42.42.5(pid=25121): stdout: | (launched: 2022-12-09_22:38:32.729697) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:34.440196 run osmo-stp_10.42.42.5(pid=25121): stderr: | 20221209223832900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223832900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223832900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223832901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223832901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223832901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223832901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:34.586150 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25121): Process ended prematurely: osmo-stp_10.42.42.5(pid=25121) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25121)] [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:38:34.594917 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:38:34.624640 run osmo-hlr_10.42.42.2(pid=25118): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25118)] 22:38:34.674625 run osmo-hlr_10.42.42.2(pid=25118): stdout: | (launched: 2022-12-09_22:38:31.547307) 22:38:34.726421 run osmo-hlr_10.42.42.2(pid=25118): stderr: | 20221209223831914 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223831914 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223831914 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223831914 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223831914 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223831914 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223831935 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223831948 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223831948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223831948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:34.798749 run osmo-msc_10.42.42.6(pid=25124): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25124)] 22:38:34.848684 run osmo-msc_10.42.42.6(pid=25124): stdout: | (launched: 2022-12-09_22:38:33.701736) 22:38:34.900645 run osmo-msc_10.42.42.6(pid=25124): stderr: | 20221209223833975 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223833975 DLGLOBAL DEBUG validating counter group 0x7f1827094c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223833975 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223833975 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223833975 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223833975 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223833977 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223833977 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223833978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223833978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:38:34.952533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25117): Terminating (SIGTERM) 22:38:34.994512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25120): Terminating (SIGTERM) 22:38:35.036532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25123): Terminating (SIGTERM) 22:38:35.079199 --- ParallelTerminationStrategy: PID 25117 died... 22:38:35.099399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25117): Terminated: ok {rc=0} 22:38:35.146457 --- ParallelTerminationStrategy: PID 25120 died... 22:38:35.166135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25120): Terminated: ok {rc=0} 22:38:35.212650 --- ParallelTerminationStrategy: PID 25123 died... 22:38:35.232382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25123): Terminated: ok {rc=0} 22:38:35.320521 bus /sierra_3: Setting Powered False 22:38:36.419621 bus /sierra_3: Setting Powered False 22:38:37.535556 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:38:38.678138 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:38.690113 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:38:38.755866 tst mo_mt_call_osmux.py: using LAC 24146 22:38:38.883928 tst mo_mt_call_osmux.py: using RAC 176 22:38:39.013107 tst mo_mt_call_osmux.py: using CellId 24146 22:38:39.140099 tst mo_mt_call_osmux.py: using BVCI 24147 22:38:39.257797 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:39.269667 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:39.281387 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:39.293240 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:39.305131 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:39.316592 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:38:39.437617 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:38:39.558847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:40.061175 run create_hlr_db(pid=25126): Launched 22:38:40.192848 bus /sierra_2: Setting Powered False 22:38:41.257212 run create_hlr_db(pid=25126): Terminated: ok {rc=0} 22:38:41.690579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25128): Launched 22:38:41.993489 run osmo-hlr_10.42.42.2(pid=25129): Launched 22:38:42.110426 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:42.639086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25131): Launched 22:38:42.942416 run osmo-stp_10.42.42.5(pid=25132): Launched 22:38:43.058420 run osmo-msc_10.42.42.6: Starting osmo-msc 22:38:43.605542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25134): Launched 22:38:43.912858 run osmo-msc_10.42.42.6(pid=25135): Launched 22:38:44.096443 run osmo-stp_10.42.42.5(pid=25132): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25132)] 22:38:44.234947 run osmo-stp_10.42.42.5(pid=25132): stdout: | (launched: 2022-12-09_22:38:42.886673) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:44.374842 run osmo-stp_10.42.42.5(pid=25132): stderr: | 20221209223843056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223843056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223843057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223843057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223843057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223843057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223843058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:44.511124 run osmo-stp_10.42.42.5(pid=25132): stdout: | (launched: 2022-12-09_22:38:42.886673) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:44.640142 run osmo-stp_10.42.42.5(pid=25132): stderr: | 20221209223843056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223843056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223843057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223843057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223843057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223843057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223843058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:44.794119 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25132): Process ended prematurely: osmo-stp_10.42.42.5(pid=25132) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25132)] [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:38:44.803829 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:38:44.832390 run osmo-hlr_10.42.42.2(pid=25129): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25129)] 22:38:44.882913 run osmo-hlr_10.42.42.2(pid=25129): stdout: | (launched: 2022-12-09_22:38:41.938291) 22:38:44.935470 run osmo-hlr_10.42.42.2(pid=25129): stderr: | 20221209223842117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223842118 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223842118 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223842118 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223842118 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223842118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223842130 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223842139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223842140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223842140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:45.008373 run osmo-msc_10.42.42.6(pid=25135): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25135)] 22:38:45.058445 run osmo-msc_10.42.42.6(pid=25135): stdout: | (launched: 2022-12-09_22:38:43.856397) 22:38:45.110209 run osmo-msc_10.42.42.6(pid=25135): stderr: | 20221209223844172 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223844172 DLGLOBAL DEBUG validating counter group 0x7f45b0df2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223844172 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223844172 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223844173 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223844173 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223844174 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223844175 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223844175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223844175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:38:45.162271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25128): Terminating (SIGTERM) 22:38:45.203954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25131): Terminating (SIGTERM) 22:38:45.245774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25134): Terminating (SIGTERM) 22:38:45.287898 --- ParallelTerminationStrategy: PID 25128 died... 22:38:45.308356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25128): Terminated: ok {rc=0} 22:38:45.355248 --- ParallelTerminationStrategy: PID 25131 died... 22:38:45.374942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25131): Terminated: ok {rc=0} 22:38:45.421694 --- ParallelTerminationStrategy: PID 25134 died... 22:38:45.441512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25134): Terminated: ok {rc=0} 22:38:45.529788 bus /sierra_3: Setting Powered False 22:38:46.628728 bus /sierra_3: Setting Powered False 22:38:47.746017 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:38:48.992272 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:38:49.000028 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:38:49.031614 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:38:49.058722 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:38:49.108551 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:38:49.138565 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:38:49.165469 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:38:49.717885 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:38:49.767426 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:49.778659 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:38:49.842898 tst mo_mt_call.py: using LAC 24147 22:38:49.960154 tst mo_mt_call.py: using RAC 177 22:38:50.076921 tst mo_mt_call.py: using CellId 24147 22:38:50.194200 tst mo_mt_call.py: using BVCI 24148 22:38:50.305410 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:50.316598 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:50.327736 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:50.339108 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:50.350582 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:50.361811 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:38:50.476734 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:38:50.592333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:51.063027 run create_hlr_db(pid=25140): Launched 22:38:51.179500 bus /sierra_2: Setting Powered False 22:38:52.240482 run create_hlr_db(pid=25140): Terminated: ok {rc=0} 22:38:52.684928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25142): Launched 22:38:53.009989 run osmo-hlr_10.42.42.2(pid=25143): Launched 22:38:53.133849 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:53.690438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25145): Launched 22:38:54.014865 run osmo-stp_10.42.42.5(pid=25146): Launched 22:38:54.138537 run osmo-msc_10.42.42.6: Starting osmo-msc 22:38:54.723660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25148): Launched 22:38:55.048694 run osmo-msc_10.42.42.6(pid=25149): Launched 22:38:55.230317 run osmo-stp_10.42.42.5(pid=25146): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25146)] 22:38:55.366851 run osmo-stp_10.42.42.5(pid=25146): stdout: | (launched: 2022-12-09_22:38:53.955949) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:55.503706 run osmo-stp_10.42.42.5(pid=25146): stderr: | 20221209223854149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223854149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223854150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223854150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223854151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223854151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223854151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:55.640227 run osmo-stp_10.42.42.5(pid=25146): stdout: | (launched: 2022-12-09_22:38:53.955949) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:55.769327 run osmo-stp_10.42.42.5(pid=25146): stderr: | 20221209223854149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223854149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223854150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223854150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223854151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223854151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223854151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:55.923707 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25146): Process ended prematurely: osmo-stp_10.42.42.5(pid=25146) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25146)] [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:38:55.933285 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:38:55.961372 run osmo-hlr_10.42.42.2(pid=25143): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25143)] 22:38:56.011464 run osmo-hlr_10.42.42.2(pid=25143): stdout: | (launched: 2022-12-09_22:38:52.951350) 22:38:56.063338 run osmo-hlr_10.42.42.2(pid=25143): stderr: | 20221209223853149 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223853149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223853149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223853149 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223853149 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223853150 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223853166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223853176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223853176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223853176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:56.135705 run osmo-msc_10.42.42.6(pid=25149): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25149)] 22:38:56.185873 run osmo-msc_10.42.42.6(pid=25149): stdout: | (launched: 2022-12-09_22:38:54.989590) 22:38:56.237474 run osmo-msc_10.42.42.6(pid=25149): stderr: | 20221209223855313 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223855313 DLGLOBAL DEBUG validating counter group 0x7fada8242c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223855313 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223855313 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223855314 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223855314 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223855315 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223855316 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223855316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223855316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:38:56.289354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25142): Terminating (SIGTERM) 22:38:56.330952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25145): Terminating (SIGTERM) 22:38:56.372470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25148): Terminating (SIGTERM) 22:38:56.414440 --- ParallelTerminationStrategy: PID 25142 died... 22:38:56.434463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25142): Terminated: ok {rc=0} 22:38:56.481071 --- ParallelTerminationStrategy: PID 25145 died... 22:38:56.500627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25145): Terminated: ok {rc=0} 22:38:56.546730 --- ParallelTerminationStrategy: PID 25148 died... 22:38:56.566263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25148): Terminated: ok {rc=0} 22:38:56.653399 bus /sierra_3: Setting Powered False 22:38:57.753663 bus /sierra_3: Setting Powered False 22:38:58.870650 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:39:00.015965 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:39:00.028109 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:39:00.094036 tst mo_mt_call_osmux.py: using LAC 24148 22:39:00.213365 tst mo_mt_call_osmux.py: using RAC 178 22:39:00.334088 tst mo_mt_call_osmux.py: using CellId 24148 22:39:00.455156 tst mo_mt_call_osmux.py: using BVCI 24149 22:39:00.566382 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:39:00.577986 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:39:00.589606 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:39:00.601252 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:39:00.613019 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:39:00.624548 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:39:00.739948 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:39:00.881525 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:01.378767 run create_hlr_db(pid=25151): Launched 22:39:01.507099 bus /sierra_2: Setting Powered False 22:39:02.568571 run create_hlr_db(pid=25151): Terminated: ok {rc=0} 22:39:03.012359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25153): Launched 22:39:03.336503 run osmo-hlr_10.42.42.2(pid=25154): Launched 22:39:03.459661 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:04.015908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25156): Launched 22:39:04.340393 run osmo-stp_10.42.42.5(pid=25157): Launched 22:39:04.464226 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:05.049700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25159): Launched 22:39:05.376835 run osmo-msc_10.42.42.6(pid=25160): Launched 22:39:05.556804 run osmo-stp_10.42.42.5(pid=25157): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25157)] 22:39:05.693561 run osmo-stp_10.42.42.5(pid=25157): stdout: | (launched: 2022-12-09_22:39:04.281190) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:05.830514 run osmo-stp_10.42.42.5(pid=25157): stderr: | 20221209223904475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223904475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223904475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223904475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223904476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223904476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223904476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:05.967015 run osmo-stp_10.42.42.5(pid=25157): stdout: | (launched: 2022-12-09_22:39:04.281190) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:06.096022 run osmo-stp_10.42.42.5(pid=25157): stderr: | 20221209223904475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223904475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223904475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223904475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223904476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223904476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223904476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:06.250244 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25157): Process ended prematurely: osmo-stp_10.42.42.5(pid=25157) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25157)] [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:39:06.259803 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:39:06.288472 run osmo-hlr_10.42.42.2(pid=25154): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25154)] 22:39:06.338863 run osmo-hlr_10.42.42.2(pid=25154): stdout: | (launched: 2022-12-09_22:39:03.277422) 22:39:06.390837 run osmo-hlr_10.42.42.2(pid=25154): stderr: | 20221209223903479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223903479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223903479 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223903479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223903479 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223903479 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223903492 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223903501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223903501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223903501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:06.463139 run osmo-msc_10.42.42.6(pid=25160): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25160)] 22:39:06.513145 run osmo-msc_10.42.42.6(pid=25160): stdout: | (launched: 2022-12-09_22:39:05.317361) 22:39:06.564743 run osmo-msc_10.42.42.6(pid=25160): stderr: | 20221209223905641 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223905641 DLGLOBAL DEBUG validating counter group 0x7f334d026c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223905641 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223905641 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223905641 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223905642 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223905643 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223905644 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223905644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223905644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:39:06.616999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25153): Terminating (SIGTERM) 22:39:06.658646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25156): Terminating (SIGTERM) 22:39:06.700337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25159): Terminating (SIGTERM) 22:39:06.743015 --- ParallelTerminationStrategy: PID 25153 died... 22:39:06.763194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25153): Terminated: ok {rc=0} 22:39:06.809603 --- ParallelTerminationStrategy: PID 25156 died... 22:39:06.829284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25156): Terminated: ok {rc=0} 22:39:06.875391 --- ParallelTerminationStrategy: PID 25159 died... 22:39:06.895330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25159): Terminated: ok {rc=0} 22:39:06.983421 bus /sierra_3: Setting Powered False 22:39:08.082563 bus /sierra_3: Setting Powered False 22:39:09.197642 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:39:10.446992 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:39:10.453907 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:39:10.483471 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:39:10.510417 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:39:10.563469 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:39:10.593429 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:39:10.620595 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:39:11.175087 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:39:11.224583 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:11.235923 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:39:11.300285 tst mo_mt_call.py: using LAC 24149 22:39:11.417624 tst mo_mt_call.py: using RAC 179 22:39:11.542236 tst mo_mt_call.py: using CellId 24149 22:39:11.663128 tst mo_mt_call.py: using BVCI 24150 22:39:11.775348 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:11.786575 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:11.797550 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:11.808631 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:11.820033 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:11.831134 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:39:11.951036 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:39:12.069379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:12.541368 run create_hlr_db(pid=25169): Launched 22:39:12.659615 bus /sierra_2: Setting Powered False 22:39:13.719903 run create_hlr_db(pid=25169): Terminated: ok {rc=0} 22:39:14.144869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25171): Launched 22:39:14.449879 run osmo-hlr_10.42.42.2(pid=25172): Launched 22:39:14.566423 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:15.091533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25174): Launched 22:39:15.395524 run osmo-stp_10.42.42.5(pid=25175): Launched 22:39:15.511563 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:16.106633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25177): Launched 22:39:16.429482 run osmo-msc_10.42.42.6(pid=25178): Launched 22:39:16.857909 run osmo-stp_10.42.42.5(pid=25175): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25175)] 22:39:17.129179 run osmo-stp_10.42.42.5(pid=25175): stdout: | (launched: 2022-12-09_22:39:15.339995) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:17.267635 run osmo-stp_10.42.42.5(pid=25175): stderr: | 20221209223915512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223915512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223915513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223915513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223915514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223915514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223915514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:17.407624 run osmo-stp_10.42.42.5(pid=25175): stdout: | (launched: 2022-12-09_22:39:15.339995) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:17.537876 run osmo-stp_10.42.42.5(pid=25175): stderr: | 20221209223915512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223915512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223915513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223915513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223915514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223915514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223915514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:17.693102 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25175): Process ended prematurely: osmo-stp_10.42.42.5(pid=25175) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25175)] [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:39:17.702828 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 22:39:17.731835 run osmo-hlr_10.42.42.2(pid=25172): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25172)] 22:39:17.782573 run osmo-hlr_10.42.42.2(pid=25172): stdout: | (launched: 2022-12-09_22:39:14.394427) 22:39:17.835288 run osmo-hlr_10.42.42.2(pid=25172): stderr: | 20221209223914573 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223914573 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223914573 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223914573 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223914573 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223914573 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223914585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223914594 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223914594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223914594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:17.908690 run osmo-msc_10.42.42.6(pid=25178): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25178)] 22:39:17.959519 run osmo-msc_10.42.42.6(pid=25178): stdout: | (launched: 2022-12-09_22:39:16.364189) 22:39:18.011887 run osmo-msc_10.42.42.6(pid=25178): stderr: | 20221209223916757 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223916757 DLGLOBAL DEBUG validating counter group 0x7f884e0d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223916757 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223916757 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223916757 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223916758 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223916762 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223916762 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223916762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223916763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:39:18.064664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25171): Terminating (SIGTERM) 22:39:18.107314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25174): Terminating (SIGTERM) 22:39:18.149896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25177): Terminating (SIGTERM) 22:39:18.192746 --- ParallelTerminationStrategy: PID 25171 died... 22:39:18.212995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25171): Terminated: ok {rc=0} 22:39:18.260374 --- ParallelTerminationStrategy: PID 25174 died... 22:39:18.279982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25174): Terminated: ok {rc=0} 22:39:18.327378 --- ParallelTerminationStrategy: PID 25177 died... 22:39:18.347167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25177): Terminated: ok {rc=0} 22:39:18.436136 bus /sierra_3: Setting Powered False 22:39:19.535366 bus /sierra_3: Setting Powered False 22:39:20.651466 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:39:21.800194 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:21.812503 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:39:21.879853 tst mo_mt_call_osmux.py: using LAC 24150 22:39:22.008039 tst mo_mt_call_osmux.py: using RAC 180 22:39:22.128475 tst mo_mt_call_osmux.py: using CellId 24150 22:39:22.248382 tst mo_mt_call_osmux.py: using BVCI 24151 22:39:22.358568 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:22.369874 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:22.381356 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:22.392875 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:22.404280 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:22.415436 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:39:22.536027 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:39:22.654829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:23.126336 run create_hlr_db(pid=25180): Launched 22:39:23.242309 bus /sierra_2: Setting Powered False 22:39:24.302892 run create_hlr_db(pid=25180): Terminated: ok {rc=0} 22:39:24.749307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25182): Launched 22:39:25.075753 run osmo-hlr_10.42.42.2(pid=25183): Launched 22:39:25.200384 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:25.764577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25185): Launched 22:39:26.089538 run osmo-stp_10.42.42.5(pid=25186): Launched 22:39:26.214317 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:26.804603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25188): Launched 22:39:27.129728 run osmo-msc_10.42.42.6(pid=25189): Launched 22:39:27.311191 run osmo-stp_10.42.42.5(pid=25186): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25186)] 22:39:27.447811 run osmo-stp_10.42.42.5(pid=25186): stdout: | (launched: 2022-12-09_22:39:26.030403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:27.585163 run osmo-stp_10.42.42.5(pid=25186): stderr: | 20221209223926226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223926226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223926226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223926227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223926227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223926227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223926227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:27.721616 run osmo-stp_10.42.42.5(pid=25186): stdout: | (launched: 2022-12-09_22:39:26.030403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:27.850214 run osmo-stp_10.42.42.5(pid=25186): stderr: | 20221209223926226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223926226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223926226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223926227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223926227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223926227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223926227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:28.005071 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25186): Process ended prematurely: osmo-stp_10.42.42.5(pid=25186) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25186)] [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:39:28.014781 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:39:28.042791 run osmo-hlr_10.42.42.2(pid=25183): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25183)] 22:39:28.092493 run osmo-hlr_10.42.42.2(pid=25183): stdout: | (launched: 2022-12-09_22:39:25.016755) 22:39:28.144177 run osmo-hlr_10.42.42.2(pid=25183): stderr: | 20221209223925214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223925214 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223925214 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223925214 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223925214 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223925214 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223925226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223925235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223925235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223925235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:28.216212 run osmo-msc_10.42.42.6(pid=25189): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25189)] 22:39:28.265998 run osmo-msc_10.42.42.6(pid=25189): stdout: | (launched: 2022-12-09_22:39:27.070403) 22:39:28.317408 run osmo-msc_10.42.42.6(pid=25189): stderr: | 20221209223927395 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223927395 DLGLOBAL DEBUG validating counter group 0x7f173646ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223927395 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223927395 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223927395 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223927396 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223927397 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223927398 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223927398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223927398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:39:28.369386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25182): Terminating (SIGTERM) 22:39:28.410927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25185): Terminating (SIGTERM) 22:39:28.453158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25188): Terminating (SIGTERM) 22:39:28.495386 --- ParallelTerminationStrategy: PID 25182 died... 22:39:28.515473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25182): Terminated: ok {rc=0} 22:39:28.562115 --- ParallelTerminationStrategy: PID 25185 died... 22:39:28.581901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25185): Terminated: ok {rc=0} 22:39:28.627862 --- ParallelTerminationStrategy: PID 25188 died... 22:39:28.647588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25188): Terminated: ok {rc=0} 22:39:28.735199 bus /sierra_3: Setting Powered False 22:39:29.833354 bus /sierra_3: Setting Powered False 22:39:30.955028 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:39:32.214599 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:39:32.221148 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:39:32.251064 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:39:32.278454 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:39:32.332139 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:39:32.362336 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:39:32.388743 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:39:32.945742 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:39:32.998907 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:33.010889 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:39:33.076756 tst mo_mt_call.py: using LAC 24151 22:39:33.203408 tst mo_mt_call.py: using RAC 181 22:39:33.329124 tst mo_mt_call.py: using CellId 24151 22:39:33.454519 tst mo_mt_call.py: using BVCI 24152 22:39:33.572162 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:33.584173 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:33.595701 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:33.607287 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:33.618961 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:33.630504 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:39:33.747941 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:39:33.868308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:34.341767 run create_hlr_db(pid=25194): Launched 22:39:34.460611 bus /sierra_2: Setting Powered False 22:39:35.521725 run create_hlr_db(pid=25194): Terminated: ok {rc=0} 22:39:35.966839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25196): Launched 22:39:36.292548 run osmo-hlr_10.42.42.2(pid=25197): Launched 22:39:36.416585 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:36.976588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25199): Launched 22:39:37.301627 run osmo-stp_10.42.42.5(pid=25200): Launched 22:39:37.426889 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:38.019948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25202): Launched 22:39:38.345957 run osmo-msc_10.42.42.6(pid=25203): Launched 22:39:38.528055 run osmo-stp_10.42.42.5(pid=25200): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25200)] 22:39:38.664923 run osmo-stp_10.42.42.5(pid=25200): stdout: | (launched: 2022-12-09_22:39:37.242269) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:38.802865 run osmo-stp_10.42.42.5(pid=25200): stderr: | 20221209223937434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223937435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223937435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223937435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223937436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223937436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223937436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:38.939546 run osmo-stp_10.42.42.5(pid=25200): stdout: | (launched: 2022-12-09_22:39:37.242269) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:39.068806 run osmo-stp_10.42.42.5(pid=25200): stderr: | 20221209223937434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223937435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223937435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223937435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223937436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223937436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223937436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:39.223883 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25200): Process ended prematurely: osmo-stp_10.42.42.5(pid=25200) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25200)] [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:39:39.233609 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:39:39.261756 run osmo-hlr_10.42.42.2(pid=25197): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25197)] 22:39:39.312406 run osmo-hlr_10.42.42.2(pid=25197): stdout: | (launched: 2022-12-09_22:39:36.233408) 22:39:39.364382 run osmo-hlr_10.42.42.2(pid=25197): stderr: | 20221209223936433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223936433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223936433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223936433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223936433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223936433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223936449 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223936458 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223936458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223936459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:39.436853 run osmo-msc_10.42.42.6(pid=25203): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25203)] 22:39:39.487193 run osmo-msc_10.42.42.6(pid=25203): stdout: | (launched: 2022-12-09_22:39:38.286380) 22:39:39.539288 run osmo-msc_10.42.42.6(pid=25203): stderr: | 20221209223938608 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223938608 DLGLOBAL DEBUG validating counter group 0x7f1b9ba0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223938608 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223938608 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223938608 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223938609 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223938610 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223938611 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223938611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223938611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:39:39.591838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25196): Terminating (SIGTERM) 22:39:39.633525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25199): Terminating (SIGTERM) 22:39:39.675046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25202): Terminating (SIGTERM) 22:39:39.717146 --- ParallelTerminationStrategy: PID 25196 died... 22:39:39.737360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25196): Terminated: ok {rc=0} 22:39:39.783974 --- ParallelTerminationStrategy: PID 25199 died... 22:39:39.803774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25199): Terminated: ok {rc=0} 22:39:39.850096 --- ParallelTerminationStrategy: PID 25202 died... 22:39:39.869936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25202): Terminated: ok {rc=0} 22:39:39.957826 bus /sierra_3: Setting Powered False 22:39:41.057157 bus /sierra_3: Setting Powered False 22:39:42.173396 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:39:43.322487 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:43.334889 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:39:43.402587 tst mo_mt_call_osmux.py: using LAC 24152 22:39:43.522689 tst mo_mt_call_osmux.py: using RAC 182 22:39:43.643418 tst mo_mt_call_osmux.py: using CellId 24152 22:39:43.763763 tst mo_mt_call_osmux.py: using BVCI 24153 22:39:43.874043 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:43.885556 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:43.896795 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:43.908193 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:43.919739 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:43.931051 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:39:44.049063 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:39:44.171694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:44.675085 run create_hlr_db(pid=25205): Launched 22:39:44.807234 bus /sierra_2: Setting Powered False 22:39:45.891122 run create_hlr_db(pid=25205): Terminated: ok {rc=0} 22:39:46.383396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25207): Launched 22:39:46.785746 run osmo-hlr_10.42.42.2(pid=25208): Launched 22:39:47.036936 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:47.633611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25210): Launched 22:39:47.941725 run osmo-stp_10.42.42.5(pid=25211): Launched 22:39:48.059083 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:48.614384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25213): Launched 22:39:48.919142 run osmo-msc_10.42.42.6(pid=25214): Launched 22:39:49.089159 run osmo-stp_10.42.42.5(pid=25211): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25211)] 22:39:49.217134 run osmo-stp_10.42.42.5(pid=25211): stdout: | (launched: 2022-12-09_22:39:47.885320) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:49.345882 run osmo-stp_10.42.42.5(pid=25211): stderr: | 20221209223948054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223948054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223948054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223948055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223948057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223948057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223948057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:49.472755 run osmo-stp_10.42.42.5(pid=25211): stdout: | (launched: 2022-12-09_22:39:47.885320) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:49.593577 run osmo-stp_10.42.42.5(pid=25211): stderr: | 20221209223948054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223948054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223948054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223948055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223948057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223948057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223948057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:49.738436 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25211): Process ended prematurely: osmo-stp_10.42.42.5(pid=25211) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25211)] [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:39:49.747471 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:39:49.775032 run osmo-hlr_10.42.42.2(pid=25208): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25208)] 22:39:49.823398 run osmo-hlr_10.42.42.2(pid=25208): stdout: | (launched: 2022-12-09_22:39:46.712833) 22:39:49.873277 run osmo-hlr_10.42.42.2(pid=25208): stderr: | 20221209223947007 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223947007 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223947008 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223947008 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223947008 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223947008 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223947031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223947057 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223947057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223947057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:49.943142 run osmo-msc_10.42.42.6(pid=25214): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25214)] 22:39:49.991430 run osmo-msc_10.42.42.6(pid=25214): stdout: | (launched: 2022-12-09_22:39:48.862977) 22:39:50.041316 run osmo-msc_10.42.42.6(pid=25214): stderr: | 20221209223949136 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209223949136 DLGLOBAL DEBUG validating counter group 0x7fcc81f40c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209223949137 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209223949137 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209223949137 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209223949137 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209223949140 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209223949140 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209223949140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209223949140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:39:50.091559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25207): Terminating (SIGTERM) 22:39:50.131869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25210): Terminating (SIGTERM) 22:39:50.172081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25213): Terminating (SIGTERM) 22:39:50.212703 --- ParallelTerminationStrategy: PID 25207 died... 22:39:50.232036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25207): Terminated: ok {rc=0} 22:39:50.277232 --- ParallelTerminationStrategy: PID 25210 died... 22:39:50.296322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25210): Terminated: ok {rc=0} 22:39:50.341176 --- ParallelTerminationStrategy: PID 25213 died... 22:39:50.360045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25213): Terminated: ok {rc=0} 22:39:50.447467 bus /sierra_3: Setting Powered False 22:39:51.546782 bus /sierra_3: Setting Powered False 22:39:52.663856 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:39:53.923441 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:39:53.929945 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:39:53.959440 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:39:53.986547 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:39:54.039717 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:39:54.069524 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:39:54.096552 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:39:54.649905 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:39:54.701742 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:54.713268 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:39:54.784570 tst mo_mt_call.py: using LAC 24153 22:39:54.914017 tst mo_mt_call.py: using RAC 183 22:39:55.033589 tst mo_mt_call.py: using CellId 24153 22:39:55.159542 tst mo_mt_call.py: using BVCI 24154 22:39:55.277168 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:55.288703 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:55.300032 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:55.311435 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:55.322986 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:55.334313 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:39:55.455093 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:39:55.571228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:56.043072 run create_hlr_db(pid=25219): Launched 22:39:56.159847 bus /sierra_2: Setting Powered False 22:39:57.221232 run create_hlr_db(pid=25219): Terminated: ok {rc=0} 22:39:57.667447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25221): Launched 22:39:57.992638 run osmo-hlr_10.42.42.2(pid=25222): Launched 22:39:58.116841 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:58.681243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25224): Launched 22:39:59.005492 run osmo-stp_10.42.42.5(pid=25225): Launched 22:39:59.130734 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:59.721518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25227): Launched 22:40:00.049544 run osmo-msc_10.42.42.6(pid=25228): Launched 22:40:00.232623 run osmo-stp_10.42.42.5(pid=25225): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25225)] 22:40:00.371213 run osmo-stp_10.42.42.5(pid=25225): stdout: | (launched: 2022-12-09_22:39:58.946526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:00.510707 run osmo-stp_10.42.42.5(pid=25225): stderr: | 20221209223959139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223959139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223959139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223959140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223959140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223959140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223959140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:00.648757 run osmo-stp_10.42.42.5(pid=25225): stdout: | (launched: 2022-12-09_22:39:58.946526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:00.779002 run osmo-stp_10.42.42.5(pid=25225): stderr: | 20221209223959139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209223959139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209223959139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209223959140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209223959140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209223959140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209223959140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:00.945841 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25225): Process ended prematurely: osmo-stp_10.42.42.5(pid=25225) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25225)] [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:40:00.955939 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:40:00.987312 run osmo-hlr_10.42.42.2(pid=25222): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25222)] 22:40:01.039385 run osmo-hlr_10.42.42.2(pid=25222): stdout: | (launched: 2022-12-09_22:39:57.933733) 22:40:01.093580 run osmo-hlr_10.42.42.2(pid=25222): stderr: | 20221209223958134 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209223958134 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209223958134 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209223958135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209223958135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209223958135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209223958147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209223958157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209223958157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209223958157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:01.177726 run osmo-msc_10.42.42.6(pid=25228): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25228)] 22:40:01.242455 run osmo-msc_10.42.42.6(pid=25228): stdout: | (launched: 2022-12-09_22:39:59.989985) 22:40:01.310375 run osmo-msc_10.42.42.6(pid=25228): stderr: | 20221209224000312 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224000312 DLGLOBAL DEBUG validating counter group 0x7fed413e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224000312 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224000312 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224000313 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224000313 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224000315 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224000315 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224000315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224000316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:40:01.374886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25221): Terminating (SIGTERM) 22:40:01.420140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25224): Terminating (SIGTERM) 22:40:01.464870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25227): Terminating (SIGTERM) 22:40:01.510948 --- ParallelTerminationStrategy: PID 25221 died... 22:40:01.531424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25221): Terminated: ok {rc=0} 22:40:01.581911 --- ParallelTerminationStrategy: PID 25224 died... 22:40:01.601648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25224): Terminated: ok {rc=0} 22:40:01.650040 --- ParallelTerminationStrategy: PID 25227 died... 22:40:01.670406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25227): Terminated: ok {rc=0} 22:40:01.760145 bus /sierra_3: Setting Powered False 22:40:02.858328 bus /sierra_3: Setting Powered False 22:40:03.975516 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:40:05.123302 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:05.135459 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:40:05.202407 tst mo_mt_call_osmux.py: using LAC 24154 22:40:05.323403 tst mo_mt_call_osmux.py: using RAC 184 22:40:05.446379 tst mo_mt_call_osmux.py: using CellId 24154 22:40:05.565402 tst mo_mt_call_osmux.py: using BVCI 24155 22:40:05.675968 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:05.687290 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:05.698456 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:05.709775 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:05.721543 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:05.733374 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:40:05.853428 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:40:05.968640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:06.438292 run create_hlr_db(pid=25233): Launched 22:40:06.554419 bus /sierra_2: Setting Powered False 22:40:07.615404 run create_hlr_db(pid=25233): Terminated: ok {rc=0} 22:40:08.040160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25235): Launched 22:40:08.345570 run osmo-hlr_10.42.42.2(pid=25236): Launched 22:40:08.463631 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:08.990991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25238): Launched 22:40:09.294034 run osmo-stp_10.42.42.5(pid=25239): Launched 22:40:09.410599 run osmo-msc_10.42.42.6: Starting osmo-msc 22:40:09.956765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25241): Launched 22:40:10.261901 run osmo-msc_10.42.42.6(pid=25242): Launched 22:40:10.432656 run osmo-stp_10.42.42.5(pid=25239): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25239)] 22:40:10.561774 run osmo-stp_10.42.42.5(pid=25239): stdout: | (launched: 2022-12-09_22:40:09.238560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:10.690870 run osmo-stp_10.42.42.5(pid=25239): stderr: | 20221209224009409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224009409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224009409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224009410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224009410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224009410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224009410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:10.818105 run osmo-stp_10.42.42.5(pid=25239): stdout: | (launched: 2022-12-09_22:40:09.238560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:10.938941 run osmo-stp_10.42.42.5(pid=25239): stderr: | 20221209224009409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224009409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224009409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224009410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224009410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224009410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224009410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:11.083527 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25239): Process ended prematurely: osmo-stp_10.42.42.5(pid=25239) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25239)] [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:40:11.092526 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:40:11.119807 run osmo-hlr_10.42.42.2(pid=25236): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25236)] 22:40:11.167746 run osmo-hlr_10.42.42.2(pid=25236): stdout: | (launched: 2022-12-09_22:40:08.290014) 22:40:11.217261 run osmo-hlr_10.42.42.2(pid=25236): stderr: | 20221209224008467 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224008467 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224008467 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224008467 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224008468 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224008468 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224008480 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224008489 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224008489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224008489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:11.286224 run osmo-msc_10.42.42.6(pid=25242): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25242)] 22:40:11.333834 run osmo-msc_10.42.42.6(pid=25242): stdout: | (launched: 2022-12-09_22:40:10.206261) 22:40:11.383050 run osmo-msc_10.42.42.6(pid=25242): stderr: | 20221209224010477 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224010477 DLGLOBAL DEBUG validating counter group 0x7f06e9d77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224010477 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224010478 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224010478 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224010478 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224010480 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224010480 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224010480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224010480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:40:11.432751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25235): Terminating (SIGTERM) 22:40:11.472397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25238): Terminating (SIGTERM) 22:40:11.511913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25241): Terminating (SIGTERM) 22:40:11.552019 --- ParallelTerminationStrategy: PID 25235 died... 22:40:11.570995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25235): Terminated: ok {rc=0} 22:40:11.615635 --- ParallelTerminationStrategy: PID 25238 died... 22:40:11.634513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25238): Terminated: ok {rc=0} 22:40:11.678910 --- ParallelTerminationStrategy: PID 25241 died... 22:40:11.697536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25241): Terminated: ok {rc=0} 22:40:11.783716 bus /sierra_3: Setting Powered False 22:40:12.883646 bus /sierra_3: Setting Powered False 22:40:13.999661 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 22:40:15.246420 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:40:15.251027 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:40:15.281028 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 22:40:15.308262 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 22:40:15.394378 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:40:15.423997 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 22:40:15.451049 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 22:40:16.061151 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2365 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 22:40:16.066456 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:16.078939 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:40:16.129315 tst emergency_mo_mt_call.py: using LAC 24155 22:40:16.254225 tst emergency_mo_mt_call.py: using RAC 185 22:40:16.375078 tst emergency_mo_mt_call.py: using CellId 24155 22:40:16.494088 tst emergency_mo_mt_call.py: using BVCI 24156 22:40:16.650188 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:16.665576 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:16.682116 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:16.697233 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:16.712203 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:16.727576 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:16.873895 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:16.994093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:17.468292 run create_hlr_db(pid=25247): Launched 22:40:17.583504 bus /sierra_2: Setting Powered False 22:40:18.643330 run create_hlr_db(pid=25247): Terminated: ok {rc=0} 22:40:19.081915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25249): Launched 22:40:19.401266 run osmo-hlr_10.42.42.2(pid=25250): Launched 22:40:19.523621 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:20.071663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25252): Launched 22:40:20.390003 run osmo-stp_10.42.42.5(pid=25253): Launched 22:40:20.521553 tst emergency_mo_mt_call.py: using MSISDN 7409 22:40:20.686905 run osmo-msc_10.42.42.6: Starting osmo-msc 22:40:21.264556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25255): Launched 22:40:21.583506 run osmo-msc_10.42.42.6(pid=25256): Launched 22:40:21.760558 run osmo-stp_10.42.42.5(pid=25253): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25253)] 22:40:21.895381 run osmo-stp_10.42.42.5(pid=25253): stdout: | (launched: 2022-12-09_22:40:20.332076) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:22.030915 run osmo-stp_10.42.42.5(pid=25253): stderr: | 20221209224020523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224020523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224020524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224020524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224020526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224020526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224020527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:22.165352 run osmo-stp_10.42.42.5(pid=25253): stdout: | (launched: 2022-12-09_22:40:20.332076) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:22.292025 run osmo-stp_10.42.42.5(pid=25253): stderr: | 20221209224020523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224020523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224020524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224020524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224020526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224020526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224020527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:22.444218 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25253): Process ended prematurely: osmo-stp_10.42.42.5(pid=25253) [trial-2365↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25253)] [trial-2365↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 22:40:22.453275 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 22:40:22.480840 run osmo-hlr_10.42.42.2(pid=25250): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25250)] 22:40:22.531024 run osmo-hlr_10.42.42.2(pid=25250): stdout: | (launched: 2022-12-09_22:40:19.343214) 22:40:22.582777 run osmo-hlr_10.42.42.2(pid=25250): stderr: | 20221209224019543 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224019543 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224019543 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224019543 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224019543 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224019543 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224019556 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224019564 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224019564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224019564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:22.654816 run osmo-msc_10.42.42.6(pid=25256): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25256)] 22:40:22.704572 run osmo-msc_10.42.42.6(pid=25256): stdout: | (launched: 2022-12-09_22:40:21.525028) 22:40:22.756047 run osmo-msc_10.42.42.6(pid=25256): stderr: | 20221209224021848 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224021848 DLGLOBAL DEBUG validating counter group 0x7f1d37c9fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224021848 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224021848 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224021848 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224021849 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224021851 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224021851 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224021851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224021851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:40:22.807870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25249): Terminating (SIGTERM) 22:40:22.849254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25252): Terminating (SIGTERM) 22:40:22.891757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25255): Terminating (SIGTERM) 22:40:22.934269 --- ParallelTerminationStrategy: PID 25249 died... 22:40:22.954335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25249): Terminated: ok {rc=0} 22:40:23.000701 --- ParallelTerminationStrategy: PID 25252 died... 22:40:23.020474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25252): Terminated: ok {rc=0} 22:40:23.066461 --- ParallelTerminationStrategy: PID 25255 died... 22:40:23.086664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25255): Terminated: ok {rc=0} 22:40:23.173745 bus /sierra_3: Setting Powered False 22:40:24.273377 bus /sierra_3: Setting Powered False 22:40:25.389604 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 22:40:26.476661 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:26.488686 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:40:26.537784 tst emergency_preemptive_call.py: using LAC 24156 22:40:26.663863 tst emergency_preemptive_call.py: using RAC 186 22:40:26.788134 tst emergency_preemptive_call.py: using CellId 24156 22:40:26.912815 tst emergency_preemptive_call.py: using BVCI 24157 22:40:27.021615 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:27.032512 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:27.043306 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:27.054598 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:27.065715 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:27.077245 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:27.195368 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:27.314012 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:27.434314 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:27.550409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:28.013599 run create_hlr_db(pid=25258): Launched 22:40:28.129317 bus /sierra_2: Setting Powered False 22:40:29.189542 run create_hlr_db(pid=25258): Terminated: ok {rc=0} 22:40:29.608425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25260): Launched 22:40:29.908102 run osmo-hlr_10.42.42.2(pid=25261): Launched 22:40:30.022066 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:30.553884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25264): Launched 22:40:30.861798 run osmo-stp_10.42.42.5(pid=25265): Launched 22:40:31.104627 tst emergency_preemptive_call.py: using MSISDN 7410 22:40:31.327513 run osmo-msc_10.42.42.6: Starting osmo-msc 22:40:31.931204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25267): Launched 22:40:32.285735 run osmo-msc_10.42.42.6(pid=25268): Launched 22:40:32.548237 run osmo-stp_10.42.42.5(pid=25265): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25265)] 22:40:32.681962 run osmo-stp_10.42.42.5(pid=25265): stdout: | (launched: 2022-12-09_22:40:30.798766) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:32.819001 run osmo-stp_10.42.42.5(pid=25265): stderr: | 20221209224031071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224031071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224031071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224031072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224031072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224031074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224031074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:32.953149 run osmo-stp_10.42.42.5(pid=25265): stdout: | (launched: 2022-12-09_22:40:30.798766) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:33.080783 run osmo-stp_10.42.42.5(pid=25265): stderr: | 20221209224031071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224031071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224031071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224031072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224031072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224031074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224031074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:33.232927 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25265): Process ended prematurely: osmo-stp_10.42.42.5(pid=25265) [trial-2365↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25265)] [trial-2365↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 22:40:33.241970 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 22:40:33.270561 run osmo-hlr_10.42.42.2(pid=25261): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25261)] 22:40:33.321535 run osmo-hlr_10.42.42.2(pid=25261): stdout: | (launched: 2022-12-09_22:40:29.853492) 22:40:33.374260 run osmo-hlr_10.42.42.2(pid=25261): stderr: | 20221209224030030 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224030030 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224030030 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224030030 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224030030 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224030030 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224030042 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224030051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224030051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224030051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:33.447639 run osmo-msc_10.42.42.6(pid=25268): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25268)] 22:40:33.498317 run osmo-msc_10.42.42.6(pid=25268): stdout: | (launched: 2022-12-09_22:40:32.223869) 22:40:33.550805 run osmo-msc_10.42.42.6(pid=25268): stderr: | 20221209224032566 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224032567 DLGLOBAL DEBUG validating counter group 0x7f920b4f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224032567 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224032567 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224032567 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224032567 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224032569 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224032569 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224032570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224032570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:40:33.603869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25260): Terminating (SIGTERM) 22:40:33.646239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25264): Terminating (SIGTERM) 22:40:33.688806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25267): Terminating (SIGTERM) 22:40:33.731679 --- ParallelTerminationStrategy: PID 25260 died... 22:40:33.751919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25260): Terminated: ok {rc=0} 22:40:33.799494 --- ParallelTerminationStrategy: PID 25264 died... 22:40:33.819275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25264): Terminated: ok {rc=0} 22:40:33.866698 --- ParallelTerminationStrategy: PID 25267 died... 22:40:33.886341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25267): Terminated: ok {rc=0} 22:40:33.976400 bus /sierra_9: Setting Powered False 22:40:35.075770 bus /sierra_9: Setting Powered False 22:40:36.192614 bus /sierra_8: Setting Powered False 22:40:37.292504 bus /sierra_8: Setting Powered False 22:40:38.407500 bus /sierra_3: Setting Powered False 22:40:39.506954 bus /sierra_3: Setting Powered False 22:40:40.624384 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 22:40:41.907366 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:40:41.922344 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:40:41.956232 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 22:40:41.996135 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 22:40:42.091398 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:40:42.122323 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 22:40:42.161971 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 22:40:42.749104 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 22:40:42.802808 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:42.813998 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:40:42.860163 tst cs_paging_gprs_active.py: using LAC 24157 22:40:42.980065 tst cs_paging_gprs_active.py: using RAC 187 22:40:43.098902 tst cs_paging_gprs_active.py: using CellId 24157 22:40:43.216537 tst cs_paging_gprs_active.py: using BVCI 24158 22:40:43.326804 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:43.337786 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:43.348540 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:43.359543 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:43.370443 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:43.381313 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:43.392335 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:43.403209 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:43.414248 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:43.535227 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:43.656836 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:40:43.877264 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:40:44.204411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25273): Launched 22:40:44.487664 run iperf3-srv_10.42.42.10(pid=25274): Launched 22:40:44.609595 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:40:44.828141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:40:45.155242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25275): Launched 22:40:45.438195 run iperf3-srv_10.42.42.10(pid=25276): Launched 22:40:45.559870 tst cs_paging_gprs_active.py:38: start network... 22:40:45.778648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:46.299585 run create_hlr_db(pid=25277): Launched 22:40:46.459907 bus /sierra_2: Setting Powered False 22:40:47.523933 run create_hlr_db(pid=25277): Terminated: ok {rc=0} 22:40:47.959103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25279): Launched 22:40:48.263645 run osmo-hlr_10.42.42.2(pid=25280): Launched 22:40:48.380713 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:48.919151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25282): Launched 22:40:49.226018 run osmo-stp_10.42.42.5(pid=25283): Launched 22:40:49.342414 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:40:49.879923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25285): Launched 22:40:50.007423 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:40:50.282256 run patchelf(pid=25286): Launched 22:40:50.464163 run osmo-stp_10.42.42.5(pid=25283): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25283)] 22:40:50.602418 run osmo-stp_10.42.42.5(pid=25283): stdout: | (launched: 2022-12-09_22:40:49.169869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:50.741800 run osmo-stp_10.42.42.5(pid=25283): stderr: | 20221209224049341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224049341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224049341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224049342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224049342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224049342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224049342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:50.881588 run osmo-stp_10.42.42.5(pid=25283): stdout: | (launched: 2022-12-09_22:40:49.169869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:51.015801 run osmo-stp_10.42.42.5(pid=25283): stderr: | 20221209224049341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224049341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224049341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224049342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224049342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224049342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224049342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:51.174550 run patchelf(pid=25286): Terminating (SIGINT) 22:40:51.358495 run patchelf(pid=25286): Terminated: ok {rc=0} 22:40:51.490863 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25283): Process ended prematurely: osmo-stp_10.42.42.5(pid=25283) [trial-2365↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25283)] [trial-2365↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 22:40:51.501104 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:40:51.529951 run osmo-hlr_10.42.42.2(pid=25280): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25280)] 22:40:51.579765 run osmo-hlr_10.42.42.2(pid=25280): stdout: | (launched: 2022-12-09_22:40:48.207822) 22:40:51.631050 run osmo-hlr_10.42.42.2(pid=25280): stderr: | 20221209224048386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224048386 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224048386 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224048386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224048386 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224048386 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224048398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224048407 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224048407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224048407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:51.682589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25273): Terminating (SIGTERM) 22:40:51.724248 run iperf3-srv_10.42.42.10(pid=25274): Terminating (SIGTERM) 22:40:51.765783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25275): Terminating (SIGTERM) 22:40:51.807366 run iperf3-srv_10.42.42.10(pid=25276): Terminating (SIGTERM) 22:40:51.848798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25279): Terminating (SIGTERM) 22:40:51.890919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25282): Terminating (SIGTERM) 22:40:51.932788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25285): Terminating (SIGTERM) 22:40:51.975127 --- ParallelTerminationStrategy: PID 25273 died... 22:40:51.995293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25273): Terminated: ok {rc=0} 22:40:52.041484 --- ParallelTerminationStrategy: PID 25274 died... 22:40:52.060875 run iperf3-srv_10.42.42.10(pid=25274): Terminated {rc=256} 22:40:52.106637 --- ParallelTerminationStrategy: PID 25275 died... 22:40:52.126148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25275): Terminated: ok {rc=0} 22:40:52.171873 --- ParallelTerminationStrategy: PID 25276 died... 22:40:52.191760 run iperf3-srv_10.42.42.10(pid=25276): Terminated {rc=256} 22:40:52.237496 --- ParallelTerminationStrategy: PID 25279 died... 22:40:52.256682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25279): Terminated: ok {rc=0} 22:40:52.303169 --- ParallelTerminationStrategy: PID 25282 died... 22:40:52.322715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25282): Terminated: ok {rc=0} 22:40:52.368711 --- ParallelTerminationStrategy: PID 25285 died... 22:40:52.388282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25285): Terminated: ok {rc=0} 22:40:52.474786 bus /gobi_0: Setting Powered False 22:40:53.572424 bus /gobi_0: Setting Powered False 22:40:54.687432 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 22:40:55.837274 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:55.849129 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:40:55.898323 tst iperf3.py: using LAC 24158 22:40:56.027685 tst iperf3.py: using RAC 188 22:40:56.156025 tst iperf3.py: using CellId 24158 22:40:56.283405 tst iperf3.py: using BVCI 24159 22:40:56.401414 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:56.412620 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:56.423732 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:56.434780 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:56.445810 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:56.456613 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:56.467768 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:56.479156 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:56.490274 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:56.610740 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:40:56.828868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:40:57.155400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25287): Launched 22:40:57.438051 run iperf3-srv_10.42.42.10(pid=25288): Launched 22:40:57.559985 tst iperf3.py:8: start network... 22:40:57.778627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:58.281329 run create_hlr_db(pid=25289): Launched 22:40:58.413590 bus /gobi_6: Setting Powered False 22:40:59.478192 run create_hlr_db(pid=25289): Terminated: ok {rc=0} 22:40:59.910314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25291): Launched 22:41:00.214125 run osmo-hlr_10.42.42.2(pid=25292): Launched 22:41:00.330265 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:00.903099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25294): Launched 22:41:01.248648 run osmo-stp_10.42.42.5(pid=25295): Launched 22:41:01.445232 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:02.163628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25297): Launched 22:41:02.298400 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:02.574097 run patchelf(pid=25298): Launched 22:41:02.755535 run osmo-stp_10.42.42.5(pid=25295): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25295)] 22:41:02.893706 run osmo-stp_10.42.42.5(pid=25295): stdout: | (launched: 2022-12-09_22:41:01.185248) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:03.033542 run osmo-stp_10.42.42.5(pid=25295): stderr: | 20221209224101502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224101502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224101502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224101503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224101503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224101503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224101503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:03.173445 run osmo-stp_10.42.42.5(pid=25295): stdout: | (launched: 2022-12-09_22:41:01.185248) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:03.306326 run osmo-stp_10.42.42.5(pid=25295): stderr: | 20221209224101502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224101502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224101502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224101503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224101503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224101503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224101503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:03.463726 run patchelf(pid=25298): Terminating (SIGINT) 22:41:03.647544 run patchelf(pid=25298): Terminated: ok {rc=0} 22:41:03.779623 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25295): Process ended prematurely: osmo-stp_10.42.42.5(pid=25295) [trial-2365↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25295)] [trial-2365↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 22:41:03.789753 tst iperf3.py:8: Test FAILED (8.0 sec) 22:41:03.818406 run osmo-hlr_10.42.42.2(pid=25292): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25292)] 22:41:03.867981 run osmo-hlr_10.42.42.2(pid=25292): stdout: | (launched: 2022-12-09_22:41:00.158565) 22:41:03.919426 run osmo-hlr_10.42.42.2(pid=25292): stderr: | 20221209224100335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224100335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224100335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224100335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224100335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224100335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224100346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224100355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224100355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224100355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:03.971920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25287): Terminating (SIGTERM) 22:41:04.013783 run iperf3-srv_10.42.42.10(pid=25288): Terminating (SIGTERM) 22:41:04.055968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25291): Terminating (SIGTERM) 22:41:04.097756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25294): Terminating (SIGTERM) 22:41:04.139399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25297): Terminating (SIGTERM) 22:41:04.181681 --- ParallelTerminationStrategy: PID 25287 died... 22:41:04.201787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25287): Terminated: ok {rc=0} 22:41:04.248241 --- ParallelTerminationStrategy: PID 25288 died... 22:41:04.267785 run iperf3-srv_10.42.42.10(pid=25288): Terminated {rc=256} 22:41:04.314205 --- ParallelTerminationStrategy: PID 25291 died... 22:41:04.333972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25291): Terminated: ok {rc=0} 22:41:04.380267 --- ParallelTerminationStrategy: PID 25294 died... 22:41:04.399827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25294): Terminated: ok {rc=0} 22:41:04.446074 --- ParallelTerminationStrategy: PID 25297 died... 22:41:04.465719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25297): Terminated: ok {rc=0} 22:41:04.553862 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 22:41:05.705828 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:05.718123 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:41:05.764602 tst iperf3m4.py: using LAC 24159 22:41:05.893437 tst iperf3m4.py: using RAC 189 22:41:06.021419 tst iperf3m4.py: using CellId 24159 22:41:06.149661 tst iperf3m4.py: using BVCI 24160 22:41:06.267065 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:06.278425 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:06.289479 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:06.300458 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:06.311498 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:06.322570 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:06.333730 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:06.344538 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:06.355654 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:06.473550 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:06.593476 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:06.714449 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:06.836657 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:41:07.041985 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:07.348854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25299): Launched 22:41:07.614892 run iperf3-srv_10.42.42.10(pid=25300): Launched 22:41:07.730132 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:41:07.934276 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:08.240059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25301): Launched 22:41:08.505641 run iperf3-srv_10.42.42.10(pid=25302): Launched 22:41:08.622195 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:41:08.828689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:09.137618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25303): Launched 22:41:09.406277 run iperf3-srv_10.42.42.10(pid=25304): Launched 22:41:09.521597 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:41:09.726253 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:10.032097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25305): Launched 22:41:10.299070 run iperf3-srv_10.42.42.10(pid=25306): Launched 22:41:10.414694 tst iperf3m4.py:8: start network... 22:41:10.619225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:11.090458 run create_hlr_db(pid=25307): Launched 22:41:11.208142 bus /gobi_6: Setting Powered False 22:41:12.269566 run create_hlr_db(pid=25307): Terminated: ok {rc=0} 22:41:12.714887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25309): Launched 22:41:13.041701 run osmo-hlr_10.42.42.2(pid=25310): Launched 22:41:13.165906 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:13.829939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25312): Launched 22:41:14.149104 run osmo-stp_10.42.42.5(pid=25313): Launched 22:41:14.270336 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:14.823160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25315): Launched 22:41:14.945904 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:15.215067 run patchelf(pid=25316): Launched 22:41:15.393253 run osmo-stp_10.42.42.5(pid=25313): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25313)] 22:41:15.528906 run osmo-stp_10.42.42.5(pid=25313): stdout: | (launched: 2022-12-09_22:41:14.090997) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:15.665608 run osmo-stp_10.42.42.5(pid=25313): stderr: | 20221209224114282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224114282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224114283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224114283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224114283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224114284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224114284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:15.802380 run osmo-stp_10.42.42.5(pid=25313): stdout: | (launched: 2022-12-09_22:41:14.090997) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:15.949244 run osmo-stp_10.42.42.5(pid=25313): stderr: | 20221209224114282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224114282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224114283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224114283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224114283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224114284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224114284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:16.107637 run patchelf(pid=25316): Terminating (SIGINT) 22:41:16.292121 run patchelf(pid=25316): Terminated: ok {rc=0} 22:41:16.425014 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25313): Process ended prematurely: osmo-stp_10.42.42.5(pid=25313) [trial-2365↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25313)] [trial-2365↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 22:41:16.435847 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:41:16.466091 run osmo-hlr_10.42.42.2(pid=25310): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25310)] 22:41:16.517531 run osmo-hlr_10.42.42.2(pid=25310): stdout: | (launched: 2022-12-09_22:41:12.982156) 22:41:16.570301 run osmo-hlr_10.42.42.2(pid=25310): stderr: | 20221209224113184 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224113184 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224113184 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224113184 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224113184 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224113184 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224113197 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224113205 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224113205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224113205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:16.624203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25299): Terminating (SIGTERM) 22:41:16.667415 run iperf3-srv_10.42.42.10(pid=25300): Terminating (SIGTERM) 22:41:16.713277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25301): Terminating (SIGTERM) 22:41:16.756741 run iperf3-srv_10.42.42.10(pid=25302): Terminating (SIGTERM) 22:41:16.802227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25303): Terminating (SIGTERM) 22:41:16.845730 run iperf3-srv_10.42.42.10(pid=25304): Terminating (SIGTERM) 22:41:16.891089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25305): Terminating (SIGTERM) 22:41:16.934718 run iperf3-srv_10.42.42.10(pid=25306): Terminating (SIGTERM) 22:41:16.981845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25309): Terminating (SIGTERM) 22:41:17.025525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25312): Terminating (SIGTERM) 22:41:17.068382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25315): Terminating (SIGTERM) 22:41:17.111521 --- ParallelTerminationStrategy: PID 25299 died... 22:41:17.132212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25299): Terminated: ok {rc=0} 22:41:17.180565 --- ParallelTerminationStrategy: PID 25300 died... 22:41:17.200815 run iperf3-srv_10.42.42.10(pid=25300): Terminated {rc=256} 22:41:17.247739 --- ParallelTerminationStrategy: PID 25301 died... 22:41:17.267893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25301): Terminated: ok {rc=0} 22:41:17.314643 --- ParallelTerminationStrategy: PID 25302 died... 22:41:17.334335 run iperf3-srv_10.42.42.10(pid=25302): Terminated {rc=256} 22:41:17.380522 --- ParallelTerminationStrategy: PID 25303 died... 22:41:17.400317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25303): Terminated: ok {rc=0} 22:41:17.446268 --- ParallelTerminationStrategy: PID 25304 died... 22:41:17.465946 run iperf3-srv_10.42.42.10(pid=25304): Terminated {rc=256} 22:41:17.512037 --- ParallelTerminationStrategy: PID 25305 died... 22:41:17.531739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25305): Terminated: ok {rc=0} 22:41:17.577739 --- ParallelTerminationStrategy: PID 25306 died... 22:41:17.597813 run iperf3-srv_10.42.42.10(pid=25306): Terminated {rc=256} 22:41:17.643755 --- ParallelTerminationStrategy: PID 25309 died... 22:41:17.663482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25309): Terminated: ok {rc=0} 22:41:17.709277 --- ParallelTerminationStrategy: PID 25312 died... 22:41:17.728793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25312): Terminated: ok {rc=0} 22:41:17.774735 --- ParallelTerminationStrategy: PID 25315 died... 22:41:17.794297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25315): Terminated: ok {rc=0} 22:41:17.882052 bus /gobi_4: Setting Powered False 22:41:18.980557 bus /gobi_4: Setting Powered False 22:41:20.094855 bus /gobi_1: Setting Powered False 22:41:21.193286 bus /gobi_1: Setting Powered False 22:41:22.311182 bus /gobi_0: Setting Powered False 22:41:23.412936 bus /gobi_0: Setting Powered False 22:41:24.529872 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 22:41:25.631220 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:25.643212 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:41:25.688672 tst ping.py: using LAC 24160 22:41:25.805430 tst ping.py: using RAC 190 22:41:25.929402 tst ping.py: using CellId 24160 22:41:26.053112 tst ping.py: using BVCI 24161 22:41:26.167691 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:26.178981 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:26.190178 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:26.201364 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:26.212334 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:26.223330 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:26.234404 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:26.245269 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:26.363701 tst ping.py:19: start network... 22:41:26.574155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:27.056805 run create_hlr_db(pid=25317): Launched 22:41:27.183866 bus /gobi_6: Setting Powered False 22:41:28.246753 run create_hlr_db(pid=25317): Terminated: ok {rc=0} 22:41:28.683770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25319): Launched 22:41:28.996511 run osmo-hlr_10.42.42.2(pid=25320): Launched 22:41:29.116533 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:29.657716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25322): Launched 22:41:29.973664 run osmo-stp_10.42.42.5(pid=25323): Launched 22:41:30.093974 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:30.637582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25325): Launched 22:41:30.758185 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:31.037942 run patchelf(pid=25326): Launched 22:41:31.233858 run osmo-stp_10.42.42.5(pid=25323): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25323)] 22:41:31.364340 run osmo-stp_10.42.42.5(pid=25323): stdout: | (launched: 2022-12-09_22:41:29.915959) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:31.496473 run osmo-stp_10.42.42.5(pid=25323): stderr: | 20221209224130104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224130104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224130104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224130105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224130107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224130107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224130107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:31.629996 run osmo-stp_10.42.42.5(pid=25323): stdout: | (launched: 2022-12-09_22:41:29.915959) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:31.757452 run osmo-stp_10.42.42.5(pid=25323): stderr: | 20221209224130104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224130104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224130104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224130105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224130107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224130107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224130107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:31.905743 run patchelf(pid=25326): Terminating (SIGINT) 22:41:32.082075 run patchelf(pid=25326): Terminated: ok {rc=0} 22:41:32.206944 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25323): Process ended prematurely: osmo-stp_10.42.42.5(pid=25323) [trial-2365↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25323)] [trial-2365↪gprs:trx-lms-limenet-micro↪ping.py:22] 22:41:32.217181 tst ping.py:22: Test FAILED (6.6 sec) 22:41:32.247239 run osmo-hlr_10.42.42.2(pid=25320): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25320)] 22:41:32.297733 run osmo-hlr_10.42.42.2(pid=25320): stdout: | (launched: 2022-12-09_22:41:28.939568) 22:41:32.348481 run osmo-hlr_10.42.42.2(pid=25320): stderr: | 20221209224129135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224129136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224129136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224129136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224129136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224129136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224129151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224129161 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224129161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224129161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:32.398832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25319): Terminating (SIGTERM) 22:41:32.439052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25322): Terminating (SIGTERM) 22:41:32.479774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25325): Terminating (SIGTERM) 22:41:32.520248 --- ParallelTerminationStrategy: PID 25319 died... 22:41:32.539440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25319): Terminated: ok {rc=0} 22:41:32.584668 --- ParallelTerminationStrategy: PID 25322 died... 22:41:32.603418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25322): Terminated: ok {rc=0} 22:41:32.648416 --- ParallelTerminationStrategy: PID 25325 died... 22:41:32.667113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25325): Terminated: ok {rc=0} 22:41:32.752899 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 22:41:33.840831 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:33.852707 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:41:33.899738 tst ping_idle_ping.py: using LAC 24161 22:41:34.017392 tst ping_idle_ping.py: using RAC 191 22:41:34.135829 tst ping_idle_ping.py: using CellId 24161 22:41:34.251047 tst ping_idle_ping.py: using BVCI 24162 22:41:34.357647 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:34.368326 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:34.379117 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:34.390117 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:34.400892 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:34.411845 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:34.422781 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:34.433792 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:34.552511 tst ping_idle_ping.py:24: start network... 22:41:34.766422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:35.255493 run create_hlr_db(pid=25327): Launched 22:41:35.384034 bus /gobi_6: Setting Powered False 22:41:36.447049 run create_hlr_db(pid=25327): Terminated: ok {rc=0} 22:41:36.886225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25329): Launched 22:41:37.201495 run osmo-hlr_10.42.42.2(pid=25330): Launched 22:41:37.322938 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:37.874296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25332): Launched 22:41:38.188691 run osmo-stp_10.42.42.5(pid=25333): Launched 22:41:38.309021 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:38.851312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25335): Launched 22:41:38.971924 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:39.237598 run patchelf(pid=25336): Launched 22:41:39.414312 run osmo-stp_10.42.42.5(pid=25333): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25333)] 22:41:39.549447 run osmo-stp_10.42.42.5(pid=25333): stdout: | (launched: 2022-12-09_22:41:38.131590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:39.685948 run osmo-stp_10.42.42.5(pid=25333): stderr: | 20221209224138324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224138324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224138325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224138325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224138326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224138326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224138326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:39.822518 run osmo-stp_10.42.42.5(pid=25333): stdout: | (launched: 2022-12-09_22:41:38.131590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:39.953754 run osmo-stp_10.42.42.5(pid=25333): stderr: | 20221209224138324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224138324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224138325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224138325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224138326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224138326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224138326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:40.108655 run patchelf(pid=25336): Terminating (SIGINT) 22:41:40.288325 run patchelf(pid=25336): Terminated: ok {rc=0} 22:41:40.417794 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25333): Process ended prematurely: osmo-stp_10.42.42.5(pid=25333) [trial-2365↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25333)] [trial-2365↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 22:41:40.427145 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:41:40.455019 run osmo-hlr_10.42.42.2(pid=25330): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25330)] 22:41:40.504933 run osmo-hlr_10.42.42.2(pid=25330): stdout: | (launched: 2022-12-09_22:41:37.144390) 22:41:40.556653 run osmo-hlr_10.42.42.2(pid=25330): stderr: | 20221209224137344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224137344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224137344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224137344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224137344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224137344 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224137356 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224137364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224137365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224137365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:40.608735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25329): Terminating (SIGTERM) 22:41:40.650336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25332): Terminating (SIGTERM) 22:41:40.691884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25335): Terminating (SIGTERM) 22:41:40.733736 --- ParallelTerminationStrategy: PID 25329 died... 22:41:40.753574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25329): Terminated: ok {rc=0} 22:41:40.799612 --- ParallelTerminationStrategy: PID 25332 died... 22:41:40.819239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25332): Terminated: ok {rc=0} 22:41:40.865096 --- ParallelTerminationStrategy: PID 25335 died... 22:41:40.884451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25335): Terminated: ok {rc=0} 22:41:40.972789 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 22:41:42.274689 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:41:42.280253 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:41:42.309724 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:41:42.349294 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:41:42.439080 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:41:42.468821 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:41:42.507698 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:41:43.104738 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:41:43.155883 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:43.167181 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:41:43.214866 tst cs_paging_gprs_active.py: using LAC 24162 22:41:43.341420 tst cs_paging_gprs_active.py: using RAC 192 22:41:43.467609 tst cs_paging_gprs_active.py: using CellId 24162 22:41:43.595768 tst cs_paging_gprs_active.py: using BVCI 24163 22:41:43.713812 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:43.725374 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:43.736467 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:43.747677 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:43.758770 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:43.770008 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:43.781264 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:43.792237 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:43.803554 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:41:43.924069 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:41:44.044903 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:41:44.261855 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:44.583127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25342): Launched 22:41:44.861939 run iperf3-srv_10.42.42.10(pid=25343): Launched 22:41:44.982213 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:41:45.198102 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:45.519151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25344): Launched 22:41:45.800904 run iperf3-srv_10.42.42.10(pid=25345): Launched 22:41:45.952109 tst cs_paging_gprs_active.py:38: start network... 22:41:46.174818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:46.686111 run create_hlr_db(pid=25346): Launched 22:41:46.851242 bus /gobi_6: Setting Powered False 22:41:47.915025 run create_hlr_db(pid=25346): Terminated: ok {rc=0} 22:41:48.345207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25348): Launched 22:41:48.646527 run osmo-hlr_10.42.42.2(pid=25349): Launched 22:41:48.760847 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:49.279269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25351): Launched 22:41:49.581440 run osmo-stp_10.42.42.5(pid=25352): Launched 22:41:49.698454 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:50.223635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25354): Launched 22:41:50.340196 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:50.594685 run patchelf(pid=25355): Launched 22:41:50.762990 run osmo-stp_10.42.42.5(pid=25352): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25352)] 22:41:50.891008 run osmo-stp_10.42.42.5(pid=25352): stdout: | (launched: 2022-12-09_22:41:49.526167) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:51.020542 run osmo-stp_10.42.42.5(pid=25352): stderr: | 20221209224149695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224149695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224149695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224149696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224149698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224149698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224149698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:51.150286 run osmo-stp_10.42.42.5(pid=25352): stdout: | (launched: 2022-12-09_22:41:49.526167) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:51.274503 run osmo-stp_10.42.42.5(pid=25352): stderr: | 20221209224149695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224149695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224149695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224149696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224149698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224149698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224149698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:51.421083 run patchelf(pid=25355): Terminating (SIGINT) 22:41:51.592552 run patchelf(pid=25355): Terminated: ok {rc=0} 22:41:51.715733 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25352): Process ended prematurely: osmo-stp_10.42.42.5(pid=25352) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25352)] [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:41:51.725238 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:41:51.752385 run osmo-hlr_10.42.42.2(pid=25349): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25349)] 22:41:51.800122 run osmo-hlr_10.42.42.2(pid=25349): stdout: | (launched: 2022-12-09_22:41:48.591545) 22:41:51.849406 run osmo-hlr_10.42.42.2(pid=25349): stderr: | 20221209224148766 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224148766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224148766 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224148766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224148766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224148766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224148778 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224148787 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224148787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224148788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:51.899443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25342): Terminating (SIGTERM) 22:41:51.939027 run iperf3-srv_10.42.42.10(pid=25343): Terminating (SIGTERM) 22:41:51.978554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25344): Terminating (SIGTERM) 22:41:52.018259 run iperf3-srv_10.42.42.10(pid=25345): Terminating (SIGTERM) 22:41:52.057661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25348): Terminating (SIGTERM) 22:41:52.097228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25351): Terminating (SIGTERM) 22:41:52.137315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25354): Terminating (SIGTERM) 22:41:52.177510 --- ParallelTerminationStrategy: PID 25342 died... 22:41:52.196542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25342): Terminated: ok {rc=0} 22:41:52.240861 --- ParallelTerminationStrategy: PID 25343 died... 22:41:52.259746 run iperf3-srv_10.42.42.10(pid=25343): Terminated {rc=256} 22:41:52.303817 --- ParallelTerminationStrategy: PID 25344 died... 22:41:52.322308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25344): Terminated: ok {rc=0} 22:41:52.366474 --- ParallelTerminationStrategy: PID 25345 died... 22:41:52.384838 run iperf3-srv_10.42.42.10(pid=25345): Terminated {rc=256} 22:41:52.429058 --- ParallelTerminationStrategy: PID 25348 died... 22:41:52.447569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25348): Terminated: ok {rc=0} 22:41:52.491722 --- ParallelTerminationStrategy: PID 25351 died... 22:41:52.510183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25351): Terminated: ok {rc=0} 22:41:52.554457 --- ParallelTerminationStrategy: PID 25354 died... 22:41:52.573005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25354): Terminated: ok {rc=0} 22:41:52.659101 bus /gobi_0: Setting Powered False 22:41:53.758320 bus /gobi_0: Setting Powered False 22:41:54.872800 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:41:56.018259 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:56.029951 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:41:56.076400 tst iperf3.py: using LAC 24163 22:41:56.197894 tst iperf3.py: using RAC 193 22:41:56.322993 tst iperf3.py: using CellId 24163 22:41:56.439819 tst iperf3.py: using BVCI 24164 22:41:56.547986 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:56.558962 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:56.569806 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:56.580768 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:56.591729 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:56.602761 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:56.613897 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:56.624799 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:56.635942 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:41:56.751481 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:41:56.952411 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:57.253188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25356): Launched 22:41:57.514341 run iperf3-srv_10.42.42.10(pid=25357): Launched 22:41:57.628193 tst iperf3.py:8: start network... 22:41:57.829641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:58.292503 run create_hlr_db(pid=25358): Launched 22:41:58.408348 bus /gobi_6: Setting Powered False 22:41:59.468868 run create_hlr_db(pid=25358): Terminated: ok {rc=0} 22:41:59.908244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25360): Launched 22:42:00.229306 run osmo-hlr_10.42.42.2(pid=25361): Launched 22:42:00.351944 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:00.933776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25365): Launched 22:42:01.325359 run osmo-stp_10.42.42.5(pid=25366): Launched 22:42:01.611403 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:42:02.228096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25368): Launched 22:42:02.362976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:42:02.635270 run patchelf(pid=25369): Launched 22:42:02.813733 run osmo-stp_10.42.42.5(pid=25366): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25366)] 22:42:02.950011 run osmo-stp_10.42.42.5(pid=25366): stdout: | (launched: 2022-12-09_22:42:01.254721) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:03.087603 run osmo-stp_10.42.42.5(pid=25366): stderr: | 20221209224201491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224201491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224201491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224201492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224201492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224201492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224201492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:03.225156 run osmo-stp_10.42.42.5(pid=25366): stdout: | (launched: 2022-12-09_22:42:01.254721) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:03.355617 run osmo-stp_10.42.42.5(pid=25366): stderr: | 20221209224201491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224201491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224201491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224201492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224201492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224201492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224201492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:03.510820 run patchelf(pid=25369): Terminating (SIGINT) 22:42:03.692338 run patchelf(pid=25369): Terminated: ok {rc=0} 22:42:03.822519 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25366): Process ended prematurely: osmo-stp_10.42.42.5(pid=25366) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25366)] [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 22:42:03.832764 tst iperf3.py:8: Test FAILED (7.8 sec) 22:42:03.861446 run osmo-hlr_10.42.42.2(pid=25361): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25361)] 22:42:03.911283 run osmo-hlr_10.42.42.2(pid=25361): stdout: | (launched: 2022-12-09_22:42:00.170924) 22:42:03.963001 run osmo-hlr_10.42.42.2(pid=25361): stderr: | 20221209224200370 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224200370 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224200370 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224200370 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224200370 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224200371 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224200382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224200390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224200390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224200390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:04.015348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25356): Terminating (SIGTERM) 22:42:04.057482 run iperf3-srv_10.42.42.10(pid=25357): Terminating (SIGTERM) 22:42:04.099303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25360): Terminating (SIGTERM) 22:42:04.141162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25365): Terminating (SIGTERM) 22:42:04.183034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25368): Terminating (SIGTERM) 22:42:04.224897 --- ParallelTerminationStrategy: PID 25356 died... 22:42:04.244845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25356): Terminated: ok {rc=0} 22:42:04.291063 --- ParallelTerminationStrategy: PID 25357 died... 22:42:04.310643 run iperf3-srv_10.42.42.10(pid=25357): Terminated {rc=256} 22:42:04.356613 --- ParallelTerminationStrategy: PID 25360 died... 22:42:04.376124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25360): Terminated: ok {rc=0} 22:42:04.422432 --- ParallelTerminationStrategy: PID 25365 died... 22:42:04.442070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25365): Terminated: ok {rc=0} 22:42:04.488151 --- ParallelTerminationStrategy: PID 25368 died... 22:42:04.507941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25368): Terminated: ok {rc=0} 22:42:04.596942 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:42:05.746909 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:05.758964 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:42:05.806809 tst iperf3m4.py: using LAC 24164 22:42:05.934141 tst iperf3m4.py: using RAC 194 22:42:06.059865 tst iperf3m4.py: using CellId 24164 22:42:06.185339 tst iperf3m4.py: using BVCI 24165 22:42:06.300863 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:06.312305 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:06.323602 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:06.334873 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:06.346159 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:06.357399 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:06.368634 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:06.380266 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:06.392122 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:06.516329 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:06.633521 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:06.753100 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:06.870898 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:42:07.073140 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:07.374632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25370): Launched 22:42:07.636596 run iperf3-srv_10.42.42.10(pid=25371): Launched 22:42:07.750973 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:42:07.952799 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:08.255187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25372): Launched 22:42:08.517995 run iperf3-srv_10.42.42.10(pid=25373): Launched 22:42:08.631190 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:42:08.832507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:09.134489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25374): Launched 22:42:09.396736 run iperf3-srv_10.42.42.10(pid=25375): Launched 22:42:09.509939 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:42:09.711163 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:10.012282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25376): Launched 22:42:10.273808 run iperf3-srv_10.42.42.10(pid=25377): Launched 22:42:10.386658 tst iperf3m4.py:8: start network... 22:42:10.587381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:11.051616 run create_hlr_db(pid=25378): Launched 22:42:11.168686 bus /gobi_6: Setting Powered False 22:42:12.229273 run create_hlr_db(pid=25378): Terminated: ok {rc=0} 22:42:12.668283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25380): Launched 22:42:12.988606 run osmo-hlr_10.42.42.2(pid=25381): Launched 22:42:13.111669 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:13.663978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25383): Launched 22:42:13.985396 run osmo-stp_10.42.42.5(pid=25384): Launched 22:42:14.109441 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:42:14.663940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25386): Launched 22:42:14.787250 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:42:15.058868 run patchelf(pid=25387): Launched 22:42:15.238759 run osmo-stp_10.42.42.5(pid=25384): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25384)] 22:42:15.375783 run osmo-stp_10.42.42.5(pid=25384): stdout: | (launched: 2022-12-09_22:42:13.926653) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:15.513764 run osmo-stp_10.42.42.5(pid=25384): stderr: | 20221209224214118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224214118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224214118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224214118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224214119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224214119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224214119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:15.651679 run osmo-stp_10.42.42.5(pid=25384): stdout: | (launched: 2022-12-09_22:42:13.926653) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:15.784278 run osmo-stp_10.42.42.5(pid=25384): stderr: | 20221209224214118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224214118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224214118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224214118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224214119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224214119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224214119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:15.947686 run patchelf(pid=25387): Terminating (SIGINT) 22:42:16.133897 run patchelf(pid=25387): Terminated: ok {rc=0} 22:42:16.267214 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25384): Process ended prematurely: osmo-stp_10.42.42.5(pid=25384) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25384)] [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 22:42:16.278567 tst iperf3m4.py:8: Test FAILED (10.6 sec) 22:42:16.308299 run osmo-hlr_10.42.42.2(pid=25381): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25381)] 22:42:16.359290 run osmo-hlr_10.42.42.2(pid=25381): stdout: | (launched: 2022-12-09_22:42:12.930617) 22:42:16.412226 run osmo-hlr_10.42.42.2(pid=25381): stderr: | 20221209224213129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224213129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224213129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224213129 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224213129 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224213129 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224213140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224213148 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224213149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224213149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:16.465048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25370): Terminating (SIGTERM) 22:42:16.508120 run iperf3-srv_10.42.42.10(pid=25371): Terminating (SIGTERM) 22:42:16.553602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25372): Terminating (SIGTERM) 22:42:16.596794 run iperf3-srv_10.42.42.10(pid=25373): Terminating (SIGTERM) 22:42:16.643725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25374): Terminating (SIGTERM) 22:42:16.687165 run iperf3-srv_10.42.42.10(pid=25375): Terminating (SIGTERM) 22:42:16.732569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25376): Terminating (SIGTERM) 22:42:16.776462 run iperf3-srv_10.42.42.10(pid=25377): Terminating (SIGTERM) 22:42:16.822171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25380): Terminating (SIGTERM) 22:42:16.864705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25383): Terminating (SIGTERM) 22:42:16.906877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25386): Terminating (SIGTERM) 22:42:16.949334 --- ParallelTerminationStrategy: PID 25370 died... 22:42:16.969344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25370): Terminated: ok {rc=0} 22:42:17.016469 --- ParallelTerminationStrategy: PID 25371 died... 22:42:17.036741 run iperf3-srv_10.42.42.10(pid=25371): Terminated {rc=256} 22:42:17.084668 --- ParallelTerminationStrategy: PID 25372 died... 22:42:17.105255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25372): Terminated: ok {rc=0} 22:42:17.152585 --- ParallelTerminationStrategy: PID 25373 died... 22:42:17.173142 run iperf3-srv_10.42.42.10(pid=25373): Terminated {rc=256} 22:42:17.220029 --- ParallelTerminationStrategy: PID 25374 died... 22:42:17.239875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25374): Terminated: ok {rc=0} 22:42:17.286620 --- ParallelTerminationStrategy: PID 25375 died... 22:42:17.306450 run iperf3-srv_10.42.42.10(pid=25375): Terminated {rc=256} 22:42:17.352212 --- ParallelTerminationStrategy: PID 25376 died... 22:42:17.371714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25376): Terminated: ok {rc=0} 22:42:17.417840 --- ParallelTerminationStrategy: PID 25377 died... 22:42:17.437412 run iperf3-srv_10.42.42.10(pid=25377): Terminated {rc=256} 22:42:17.483241 --- ParallelTerminationStrategy: PID 25380 died... 22:42:17.502816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25380): Terminated: ok {rc=0} 22:42:17.548698 --- ParallelTerminationStrategy: PID 25383 died... 22:42:17.568215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25383): Terminated: ok {rc=0} 22:42:17.614075 --- ParallelTerminationStrategy: PID 25386 died... 22:42:17.633520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25386): Terminated: ok {rc=0} 22:42:17.721044 bus /gobi_4: Setting Powered False 22:42:18.820309 bus /gobi_4: Setting Powered False 22:42:19.936400 bus /gobi_1: Setting Powered False 22:42:21.035409 bus /gobi_1: Setting Powered False 22:42:22.151530 bus /gobi_0: Setting Powered False 22:42:23.250640 bus /gobi_0: Setting Powered False 22:42:24.368886 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 22:42:25.471087 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:25.483072 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:42:25.532373 tst ping.py: using LAC 24165 22:42:25.656781 tst ping.py: using RAC 195 22:42:25.779854 tst ping.py: using CellId 24165 22:42:25.904142 tst ping.py: using BVCI 24166 22:42:26.020617 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:26.032157 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:26.043425 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:26.054956 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:26.066149 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:26.077688 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:26.088934 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:26.100225 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:26.218649 tst ping.py:19: start network... 22:42:26.430720 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:26.915665 run create_hlr_db(pid=25388): Launched 22:42:27.048167 bus /gobi_6: Setting Powered False 22:42:28.110250 run create_hlr_db(pid=25388): Terminated: ok {rc=0} 22:42:28.532050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25390): Launched 22:42:28.827793 run osmo-hlr_10.42.42.2(pid=25391): Launched 22:42:28.940885 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:29.465782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25393): Launched 22:42:29.760241 run osmo-stp_10.42.42.5(pid=25394): Launched 22:42:29.872900 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:42:30.382778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25396): Launched 22:42:30.496867 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:42:30.746601 run patchelf(pid=25397): Launched 22:42:30.937271 run osmo-stp_10.42.42.5(pid=25394): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25394)] 22:42:31.067211 run osmo-stp_10.42.42.5(pid=25394): stdout: | (launched: 2022-12-09_22:42:29.706654) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:31.200558 run osmo-stp_10.42.42.5(pid=25394): stderr: | 20221209224229875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224229875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224229875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224229876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224229876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224229876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224229877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:31.332527 run osmo-stp_10.42.42.5(pid=25394): stdout: | (launched: 2022-12-09_22:42:29.706654) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:31.457903 run osmo-stp_10.42.42.5(pid=25394): stderr: | 20221209224229875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224229875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224229875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224229876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224229876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224229876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224229877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:31.606235 run patchelf(pid=25397): Terminating (SIGINT) 22:42:31.778956 run patchelf(pid=25397): Terminated: ok {rc=0} 22:42:31.904135 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25394): Process ended prematurely: osmo-stp_10.42.42.5(pid=25394) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25394)] [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 22:42:31.914296 tst ping.py:22: Test FAILED (6.4 sec) 22:42:31.946864 run osmo-hlr_10.42.42.2(pid=25391): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25391)] 22:42:31.997474 run osmo-hlr_10.42.42.2(pid=25391): stdout: | (launched: 2022-12-09_22:42:28.773792) 22:42:32.049770 run osmo-hlr_10.42.42.2(pid=25391): stderr: | 20221209224228948 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224228948 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224228948 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224228948 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224228948 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224228948 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224228960 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224228968 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224228968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224228968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:32.102459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25390): Terminating (SIGTERM) 22:42:32.143491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25393): Terminating (SIGTERM) 22:42:32.185928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25396): Terminating (SIGTERM) 22:42:32.227938 --- ParallelTerminationStrategy: PID 25390 died... 22:42:32.247049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25390): Terminated: ok {rc=0} 22:42:32.292908 --- ParallelTerminationStrategy: PID 25393 died... 22:42:32.311763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25393): Terminated: ok {rc=0} 22:42:32.357324 --- ParallelTerminationStrategy: PID 25396 died... 22:42:32.376201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25396): Terminated: ok {rc=0} 22:42:32.463892 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:42:33.554203 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:33.567032 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:42:33.616725 tst ping_idle_ping.py: using LAC 24166 22:42:33.743686 tst ping_idle_ping.py: using RAC 196 22:42:33.868317 tst ping_idle_ping.py: using CellId 24166 22:42:33.986587 tst ping_idle_ping.py: using BVCI 24167 22:42:34.095388 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:34.106616 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:34.117728 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:34.129002 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:34.140107 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:34.151080 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:34.162263 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:34.173231 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:34.287536 tst ping_idle_ping.py:24: start network... 22:42:34.486268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:34.944633 run create_hlr_db(pid=25398): Launched 22:42:35.058451 bus /gobi_6: Setting Powered False 22:42:36.118440 run create_hlr_db(pid=25398): Terminated: ok {rc=0} 22:42:36.532820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25400): Launched 22:42:36.829622 run osmo-hlr_10.42.42.2(pid=25401): Launched 22:42:36.944492 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:37.471338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25403): Launched 22:42:37.767868 run osmo-stp_10.42.42.5(pid=25404): Launched 22:42:37.882046 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:42:38.391657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25406): Launched 22:42:38.505225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:42:38.755231 run patchelf(pid=25407): Launched 22:42:38.920432 run osmo-stp_10.42.42.5(pid=25404): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25404)] 22:42:39.046703 run osmo-stp_10.42.42.5(pid=25404): stdout: | (launched: 2022-12-09_22:42:37.713946) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:39.174745 run osmo-stp_10.42.42.5(pid=25404): stderr: | 20221209224237879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224237879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224237880 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224237880 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224237882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224237882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224237882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:39.302558 run osmo-stp_10.42.42.5(pid=25404): stdout: | (launched: 2022-12-09_22:42:37.713946) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:39.424203 run osmo-stp_10.42.42.5(pid=25404): stderr: | 20221209224237879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224237879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224237880 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224237880 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224237882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224237882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224237882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:39.568575 run patchelf(pid=25407): Terminating (SIGINT) 22:42:39.736785 run patchelf(pid=25407): Terminated: ok {rc=0} 22:42:39.857850 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25404): Process ended prematurely: osmo-stp_10.42.42.5(pid=25404) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25404)] [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 22:42:39.866798 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 22:42:39.893299 run osmo-hlr_10.42.42.2(pid=25401): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25401)] 22:42:39.941427 run osmo-hlr_10.42.42.2(pid=25401): stdout: | (launched: 2022-12-09_22:42:36.775486) 22:42:39.991329 run osmo-hlr_10.42.42.2(pid=25401): stderr: | 20221209224236947 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224236947 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224236947 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224236947 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224236947 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224236948 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224236959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224236968 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224236968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224236968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:40.041218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25400): Terminating (SIGTERM) 22:42:40.081389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25403): Terminating (SIGTERM) 22:42:40.121240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25406): Terminating (SIGTERM) 22:42:40.161824 --- ParallelTerminationStrategy: PID 25400 died... 22:42:40.180821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25400): Terminated: ok {rc=0} 22:42:40.225469 --- ParallelTerminationStrategy: PID 25403 died... 22:42:40.243947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25403): Terminated: ok {rc=0} 22:42:40.288494 --- ParallelTerminationStrategy: PID 25406 died... 22:42:40.307222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25406): Terminated: ok {rc=0} 22:42:40.394295 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:42:41.690446 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:42:41.698264 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:42:41.728456 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:42:41.767836 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:42:41.856325 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:42:41.886326 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:42:41.925758 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:42:42.523914 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:42:42.576157 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:42.587828 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:42:42.655719 tst cs_paging_gprs_active.py: using LAC 24167 22:42:42.781920 tst cs_paging_gprs_active.py: using RAC 197 22:42:42.907491 tst cs_paging_gprs_active.py: using CellId 24167 22:42:43.026392 tst cs_paging_gprs_active.py: using BVCI 24168 22:42:43.137390 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:43.148409 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:43.159414 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:43.170827 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:43.182114 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:43.193289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:43.204269 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:43.215223 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:43.226457 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:42:43.346106 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:42:43.463247 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:42:43.666079 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:43.968200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25411): Launched 22:42:44.232619 run iperf3-srv_10.42.42.10(pid=25412): Launched 22:42:44.346317 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:42:44.548448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:44.851255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25413): Launched 22:42:45.115035 run iperf3-srv_10.42.42.10(pid=25414): Launched 22:42:45.228723 tst cs_paging_gprs_active.py:38: start network... 22:42:45.430452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:45.899718 run create_hlr_db(pid=25415): Launched 22:42:46.089726 bus /gobi_6: Setting Powered False 22:42:47.151147 run create_hlr_db(pid=25415): Terminated: ok {rc=0} 22:42:47.576925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25417): Launched 22:42:47.882553 run osmo-hlr_10.42.42.2(pid=25418): Launched 22:42:47.998866 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:48.532684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25420): Launched 22:42:48.835936 run osmo-stp_10.42.42.5(pid=25421): Launched 22:42:48.952247 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:42:49.473609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25423): Launched 22:42:49.591322 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:42:49.849329 run patchelf(pid=25424): Launched 22:42:50.018299 run osmo-stp_10.42.42.5(pid=25421): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25421)] 22:42:50.147355 run osmo-stp_10.42.42.5(pid=25421): stdout: | (launched: 2022-12-09_22:42:48.780689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:50.277117 run osmo-stp_10.42.42.5(pid=25421): stderr: | 20221209224248951 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224248951 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224248951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224248952 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224248952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224248952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224248952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:50.406742 run osmo-stp_10.42.42.5(pid=25421): stdout: | (launched: 2022-12-09_22:42:48.780689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:50.530615 run osmo-stp_10.42.42.5(pid=25421): stderr: | 20221209224248951 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224248951 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224248951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224248952 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224248952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224248952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224248952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:50.677667 run patchelf(pid=25424): Terminating (SIGINT) 22:42:50.849467 run patchelf(pid=25424): Terminated: ok {rc=0} 22:42:50.972908 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25421): Process ended prematurely: osmo-stp_10.42.42.5(pid=25421) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25421)] [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:42:50.982597 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 22:42:51.010294 run osmo-hlr_10.42.42.2(pid=25418): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25418)] 22:42:51.058832 run osmo-hlr_10.42.42.2(pid=25418): stdout: | (launched: 2022-12-09_22:42:47.827038) 22:42:51.108542 run osmo-hlr_10.42.42.2(pid=25418): stderr: | 20221209224248002 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224248002 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224248002 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224248002 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224248002 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224248002 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224248014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224248023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224248023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224248023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:51.158729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25411): Terminating (SIGTERM) 22:42:51.198678 run iperf3-srv_10.42.42.10(pid=25412): Terminating (SIGTERM) 22:42:51.238692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25413): Terminating (SIGTERM) 22:42:51.278765 run iperf3-srv_10.42.42.10(pid=25414): Terminating (SIGTERM) 22:42:51.318685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25417): Terminating (SIGTERM) 22:42:51.358827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25420): Terminating (SIGTERM) 22:42:51.398384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25423): Terminating (SIGTERM) 22:42:51.438876 --- ParallelTerminationStrategy: PID 25411 died... 22:42:51.458003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25411): Terminated: ok {rc=0} 22:42:51.502797 --- ParallelTerminationStrategy: PID 25412 died... 22:42:51.521467 run iperf3-srv_10.42.42.10(pid=25412): Terminated {rc=256} 22:42:51.565887 --- ParallelTerminationStrategy: PID 25413 died... 22:42:51.584642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25413): Terminated: ok {rc=0} 22:42:51.629046 --- ParallelTerminationStrategy: PID 25414 died... 22:42:51.647738 run iperf3-srv_10.42.42.10(pid=25414): Terminated {rc=256} 22:42:51.692198 --- ParallelTerminationStrategy: PID 25417 died... 22:42:51.710944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25417): Terminated: ok {rc=0} 22:42:51.755237 --- ParallelTerminationStrategy: PID 25420 died... 22:42:51.773773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25420): Terminated: ok {rc=0} 22:42:51.818228 --- ParallelTerminationStrategy: PID 25423 died... 22:42:51.836727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25423): Terminated: ok {rc=0} 22:42:51.936305 bus /gobi_0: Setting Powered False 22:42:53.035977 bus /gobi_0: Setting Powered False 22:42:54.150001 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:42:55.299547 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:55.311905 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:42:55.389279 tst iperf3.py: using LAC 24168 22:42:55.515433 tst iperf3.py: using RAC 198 22:42:55.641718 tst iperf3.py: using CellId 24168 22:42:55.767730 tst iperf3.py: using BVCI 24169 22:42:55.885492 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:55.897093 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:55.908469 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:55.920413 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:55.932402 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:55.944079 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:55.956257 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:55.968078 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:55.980112 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:42:56.102768 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:42:56.319241 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:56.641639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25425): Launched 22:42:56.924737 run iperf3-srv_10.42.42.10(pid=25426): Launched 22:42:57.046502 tst iperf3.py:8: start network... 22:42:57.263068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:57.758498 run create_hlr_db(pid=25427): Launched 22:42:57.888992 bus /gobi_6: Setting Powered False 22:42:58.952636 run create_hlr_db(pid=25427): Terminated: ok {rc=0} 22:42:59.382994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25429): Launched 22:42:59.684754 run osmo-hlr_10.42.42.2(pid=25430): Launched 22:42:59.800071 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:00.326281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25432): Launched 22:43:00.626900 run osmo-stp_10.42.42.5(pid=25433): Launched 22:43:00.741810 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:43:01.297158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25435): Launched 22:43:01.471326 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:43:01.787077 run patchelf(pid=25436): Launched 22:43:01.972383 run osmo-stp_10.42.42.5(pid=25433): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25433)] 22:43:02.104504 run osmo-stp_10.42.42.5(pid=25433): stdout: | (launched: 2022-12-09_22:43:00.571840) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:02.238722 run osmo-stp_10.42.42.5(pid=25433): stderr: | 20221209224300743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224300744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224300744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224300744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224300745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224300745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224300745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:02.373596 run osmo-stp_10.42.42.5(pid=25433): stdout: | (launched: 2022-12-09_22:43:00.571840) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:02.497963 run osmo-stp_10.42.42.5(pid=25433): stderr: | 20221209224300743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224300744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224300744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224300744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224300745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224300745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224300745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:02.646061 run patchelf(pid=25436): Terminating (SIGINT) 22:43:02.819017 run patchelf(pid=25436): Terminated: ok {rc=0} 22:43:02.943098 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25433): Process ended prematurely: osmo-stp_10.42.42.5(pid=25433) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25433)] [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 22:43:02.952822 tst iperf3.py:8: Test FAILED (7.7 sec) 22:43:02.980905 run osmo-hlr_10.42.42.2(pid=25430): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25430)] 22:43:03.029462 run osmo-hlr_10.42.42.2(pid=25430): stdout: | (launched: 2022-12-09_22:42:59.629946) 22:43:03.079443 run osmo-hlr_10.42.42.2(pid=25430): stderr: | 20221209224259808 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224259808 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224259808 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224259808 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224259808 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224259808 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224259821 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224259830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224259830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224259830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:03.130329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25425): Terminating (SIGTERM) 22:43:03.170434 run iperf3-srv_10.42.42.10(pid=25426): Terminating (SIGTERM) 22:43:03.212216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25429): Terminating (SIGTERM) 22:43:03.252475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25432): Terminating (SIGTERM) 22:43:03.292981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25435): Terminating (SIGTERM) 22:43:03.333493 --- ParallelTerminationStrategy: PID 25425 died... 22:43:03.352630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25425): Terminated: ok {rc=0} 22:43:03.397753 --- ParallelTerminationStrategy: PID 25426 died... 22:43:03.416381 run iperf3-srv_10.42.42.10(pid=25426): Terminated {rc=256} 22:43:03.461220 --- ParallelTerminationStrategy: PID 25429 died... 22:43:03.479884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25429): Terminated: ok {rc=0} 22:43:03.525008 --- ParallelTerminationStrategy: PID 25432 died... 22:43:03.543710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25432): Terminated: ok {rc=0} 22:43:03.588544 --- ParallelTerminationStrategy: PID 25435 died... 22:43:03.607435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25435): Terminated: ok {rc=0} 22:43:03.695011 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:43:04.842489 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:04.854257 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:43:04.920834 tst iperf3m4.py: using LAC 24169 22:43:05.038631 tst iperf3m4.py: using RAC 199 22:43:05.156194 tst iperf3m4.py: using CellId 24169 22:43:05.278398 tst iperf3m4.py: using BVCI 24170 22:43:05.388039 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:05.399005 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:05.409934 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:05.421099 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:05.431980 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:05.443002 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:05.454106 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:05.465136 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:05.476217 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:05.595615 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:05.716309 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:05.835907 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:05.952432 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:43:06.154231 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:06.455843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25438): Launched 22:43:06.718723 run iperf3-srv_10.42.42.10(pid=25439): Launched 22:43:06.832262 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:43:07.033844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:07.336314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25440): Launched 22:43:07.599043 run iperf3-srv_10.42.42.10(pid=25441): Launched 22:43:07.712847 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:43:07.914463 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:08.217631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25442): Launched 22:43:08.483840 run iperf3-srv_10.42.42.10(pid=25443): Launched 22:43:08.597499 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:43:08.799810 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:09.103540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25444): Launched 22:43:09.366868 run iperf3-srv_10.42.42.10(pid=25445): Launched 22:43:09.480722 tst iperf3m4.py:8: start network... 22:43:09.682569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:10.149530 run create_hlr_db(pid=25446): Launched 22:43:10.266821 bus /gobi_6: Setting Powered False 22:43:11.326678 run create_hlr_db(pid=25446): Terminated: ok {rc=0} 22:43:11.746928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25448): Launched 22:43:12.049136 run osmo-hlr_10.42.42.2(pid=25449): Launched 22:43:12.164732 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:12.698551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25451): Launched 22:43:13.001733 run osmo-stp_10.42.42.5(pid=25452): Launched 22:43:13.118855 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:43:13.643418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25454): Launched 22:43:13.759266 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:43:14.014500 run patchelf(pid=25455): Launched 22:43:14.183183 run osmo-stp_10.42.42.5(pid=25452): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25452)] 22:43:14.312622 run osmo-stp_10.42.42.5(pid=25452): stdout: | (launched: 2022-12-09_22:43:12.946291) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:14.442423 run osmo-stp_10.42.42.5(pid=25452): stderr: | 20221209224313116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224313116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224313116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224313117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224313117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224313117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224313117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:14.572286 run osmo-stp_10.42.42.5(pid=25452): stdout: | (launched: 2022-12-09_22:43:12.946291) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:14.695997 run osmo-stp_10.42.42.5(pid=25452): stderr: | 20221209224313116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224313116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224313116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224313117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224313117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224313117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224313117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:14.842510 run patchelf(pid=25455): Terminating (SIGINT) 22:43:15.014164 run patchelf(pid=25455): Terminated: ok {rc=0} 22:43:15.137427 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25452): Process ended prematurely: osmo-stp_10.42.42.5(pid=25452) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25452)] [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:43:15.146878 tst iperf3m4.py:8: Test FAILED (10.3 sec) 22:43:15.174475 run osmo-hlr_10.42.42.2(pid=25449): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25449)] 22:43:15.222676 run osmo-hlr_10.42.42.2(pid=25449): stdout: | (launched: 2022-12-09_22:43:11.993387) 22:43:15.272074 run osmo-hlr_10.42.42.2(pid=25449): stderr: | 20221209224312172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224312172 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224312172 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224312172 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224312172 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224312172 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224312183 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224312191 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224312191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224312191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:15.322011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25438): Terminating (SIGTERM) 22:43:15.362006 run iperf3-srv_10.42.42.10(pid=25439): Terminating (SIGTERM) 22:43:15.402001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25440): Terminating (SIGTERM) 22:43:15.442098 run iperf3-srv_10.42.42.10(pid=25441): Terminating (SIGTERM) 22:43:15.481792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25442): Terminating (SIGTERM) 22:43:15.521988 run iperf3-srv_10.42.42.10(pid=25443): Terminating (SIGTERM) 22:43:15.561788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25444): Terminating (SIGTERM) 22:43:15.601634 run iperf3-srv_10.42.42.10(pid=25445): Terminating (SIGTERM) 22:43:15.641931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25448): Terminating (SIGTERM) 22:43:15.681847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25451): Terminating (SIGTERM) 22:43:15.721639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25454): Terminating (SIGTERM) 22:43:15.761642 --- ParallelTerminationStrategy: PID 25438 died... 22:43:15.780756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25438): Terminated: ok {rc=0} 22:43:15.825350 --- ParallelTerminationStrategy: PID 25439 died... 22:43:15.844160 run iperf3-srv_10.42.42.10(pid=25439): Terminated {rc=256} 22:43:15.889206 --- ParallelTerminationStrategy: PID 25440 died... 22:43:15.908157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25440): Terminated: ok {rc=0} 22:43:15.953446 --- ParallelTerminationStrategy: PID 25441 died... 22:43:15.972125 run iperf3-srv_10.42.42.10(pid=25441): Terminated {rc=256} 22:43:16.019060 --- ParallelTerminationStrategy: PID 25442 died... 22:43:16.038638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25442): Terminated: ok {rc=0} 22:43:16.085468 --- ParallelTerminationStrategy: PID 25443 died... 22:43:16.104678 run iperf3-srv_10.42.42.10(pid=25443): Terminated {rc=256} 22:43:16.151974 --- ParallelTerminationStrategy: PID 25444 died... 22:43:16.171508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25444): Terminated: ok {rc=0} 22:43:16.218594 --- ParallelTerminationStrategy: PID 25445 died... 22:43:16.238378 run iperf3-srv_10.42.42.10(pid=25445): Terminated {rc=256} 22:43:16.285547 --- ParallelTerminationStrategy: PID 25448 died... 22:43:16.304789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25448): Terminated: ok {rc=0} 22:43:16.352006 --- ParallelTerminationStrategy: PID 25451 died... 22:43:16.371597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25451): Terminated: ok {rc=0} 22:43:16.418964 --- ParallelTerminationStrategy: PID 25454 died... 22:43:16.438639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25454): Terminated: ok {rc=0} 22:43:16.534799 bus /gobi_4: Setting Powered False 22:43:17.646645 bus /gobi_4: Setting Powered False 22:43:18.760162 bus /gobi_1: Setting Powered False 22:43:19.858356 bus /gobi_1: Setting Powered False 22:43:20.974851 bus /gobi_0: Setting Powered False 22:43:22.073057 bus /gobi_0: Setting Powered False 22:43:23.190481 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:43:24.293948 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:24.306491 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:43:24.375125 tst ping.py: using LAC 24170 22:43:24.491916 tst ping.py: using RAC 200 22:43:24.609366 tst ping.py: using CellId 24170 22:43:24.736757 tst ping.py: using BVCI 24171 22:43:24.851707 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:24.863444 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:24.875183 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:24.886977 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:24.898506 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:24.910209 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:24.921591 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:24.932908 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:25.052514 tst ping.py:19: start network... 22:43:25.266670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:25.754617 run create_hlr_db(pid=25456): Launched 22:43:25.882761 bus /gobi_6: Setting Powered False 22:43:26.945583 run create_hlr_db(pid=25456): Terminated: ok {rc=0} 22:43:27.370021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25458): Launched 22:43:27.666671 run osmo-hlr_10.42.42.2(pid=25459): Launched 22:43:27.780720 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:28.309646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25461): Launched 22:43:28.608204 run osmo-stp_10.42.42.5(pid=25462): Launched 22:43:28.722134 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:43:29.232577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25464): Launched 22:43:29.346049 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:43:29.595899 run patchelf(pid=25465): Launched 22:43:29.762275 run osmo-stp_10.42.42.5(pid=25462): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25462)] 22:43:29.888399 run osmo-stp_10.42.42.5(pid=25462): stdout: | (launched: 2022-12-09_22:43:28.553693) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:30.015891 run osmo-stp_10.42.42.5(pid=25462): stderr: | 20221209224328725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224328725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224328726 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224328726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224328726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224328726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224328727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:30.143572 run osmo-stp_10.42.42.5(pid=25462): stdout: | (launched: 2022-12-09_22:43:28.553693) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:30.264560 run osmo-stp_10.42.42.5(pid=25462): stderr: | 20221209224328725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224328725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224328726 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224328726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224328726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224328726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224328727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:30.409266 run patchelf(pid=25465): Terminating (SIGINT) 22:43:30.577512 run patchelf(pid=25465): Terminated: ok {rc=0} 22:43:30.698122 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25462): Process ended prematurely: osmo-stp_10.42.42.5(pid=25462) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25462)] [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 22:43:30.706960 tst ping.py:22: Test FAILED (6.4 sec) 22:43:30.733807 run osmo-hlr_10.42.42.2(pid=25459): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25459)] 22:43:30.781914 run osmo-hlr_10.42.42.2(pid=25459): stdout: | (launched: 2022-12-09_22:43:27.612424) 22:43:30.834190 run osmo-hlr_10.42.42.2(pid=25459): stderr: | 20221209224327788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224327788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224327788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224327788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224327789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224327789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224327801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224327810 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224327810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224327810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:30.886907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25458): Terminating (SIGTERM) 22:43:30.932442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25461): Terminating (SIGTERM) 22:43:30.977107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25464): Terminating (SIGTERM) 22:43:31.020776 --- ParallelTerminationStrategy: PID 25458 died... 22:43:31.041311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25458): Terminated: ok {rc=0} 22:43:31.088534 --- ParallelTerminationStrategy: PID 25461 died... 22:43:31.107997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25461): Terminated: ok {rc=0} 22:43:31.153601 --- ParallelTerminationStrategy: PID 25464 died... 22:43:31.172666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25464): Terminated: ok {rc=0} 22:43:31.260600 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:43:32.344787 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:32.356618 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:43:32.422855 tst ping_idle_ping.py: using LAC 24171 22:43:32.539043 tst ping_idle_ping.py: using RAC 201 22:43:32.654895 tst ping_idle_ping.py: using CellId 24171 22:43:32.773163 tst ping_idle_ping.py: using BVCI 24172 22:43:32.889971 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:32.901628 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:32.913070 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:32.925146 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:32.937548 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:32.948890 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:32.961103 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:32.972862 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:33.090954 tst ping_idle_ping.py:24: start network... 22:43:33.289688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:33.749261 run create_hlr_db(pid=25466): Launched 22:43:33.862838 bus /gobi_6: Setting Powered False 22:43:34.923047 run create_hlr_db(pid=25466): Terminated: ok {rc=0} 22:43:35.337328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25468): Launched 22:43:35.634345 run osmo-hlr_10.42.42.2(pid=25469): Launched 22:43:35.758970 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:36.305946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25471): Launched 22:43:36.623632 run osmo-stp_10.42.42.5(pid=25472): Launched 22:43:36.746100 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:43:37.292082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25474): Launched 22:43:37.413566 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:43:37.682440 run patchelf(pid=25475): Launched 22:43:37.858730 run osmo-stp_10.42.42.5(pid=25472): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25472)] 22:43:37.993383 run osmo-stp_10.42.42.5(pid=25472): stdout: | (launched: 2022-12-09_22:43:36.566263) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:38.130059 run osmo-stp_10.42.42.5(pid=25472): stderr: | 20221209224336758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224336758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224336758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224336758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224336759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224336759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224336759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:38.266210 run osmo-stp_10.42.42.5(pid=25472): stdout: | (launched: 2022-12-09_22:43:36.566263) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:38.396416 run osmo-stp_10.42.42.5(pid=25472): stderr: | 20221209224336758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224336758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224336758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224336758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224336759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224336759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224336759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:38.550727 run patchelf(pid=25475): Terminating (SIGINT) 22:43:38.730275 run patchelf(pid=25475): Terminated: ok {rc=0} 22:43:38.859169 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25472): Process ended prematurely: osmo-stp_10.42.42.5(pid=25472) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25472)] [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:43:38.868649 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:43:38.897067 run osmo-hlr_10.42.42.2(pid=25469): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25469)] 22:43:38.946853 run osmo-hlr_10.42.42.2(pid=25469): stdout: | (launched: 2022-12-09_22:43:35.579708) 22:43:38.998504 run osmo-hlr_10.42.42.2(pid=25469): stderr: | 20221209224335771 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224335771 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224335771 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224335771 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224335771 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224335771 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224335784 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224335792 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224335792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224335792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:39.051139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25468): Terminating (SIGTERM) 22:43:39.093280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25471): Terminating (SIGTERM) 22:43:39.135263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25474): Terminating (SIGTERM) 22:43:39.177497 --- ParallelTerminationStrategy: PID 25468 died... 22:43:39.197682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25468): Terminated: ok {rc=0} 22:43:39.244398 --- ParallelTerminationStrategy: PID 25471 died... 22:43:39.264165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25471): Terminated: ok {rc=0} 22:43:39.310383 --- ParallelTerminationStrategy: PID 25474 died... 22:43:39.330102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25474): Terminated: ok {rc=0} 22:43:39.417572 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:43:40.726414 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:43:40.732927 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:43:40.763009 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:43:40.802404 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:43:40.889958 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:43:40.919553 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:43:40.958670 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:43:41.559856 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:43:41.610760 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:41.622064 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:43:41.685830 tst cs_paging_gprs_active.py: using LAC 24172 22:43:41.802429 tst cs_paging_gprs_active.py: using RAC 202 22:43:41.920570 tst cs_paging_gprs_active.py: using CellId 24172 22:43:42.039889 tst cs_paging_gprs_active.py: using BVCI 24173 22:43:42.150846 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:42.161893 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:42.172647 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:42.183452 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:42.194611 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:42.205687 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:42.216755 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:42.227716 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:42.239051 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:43:42.359201 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:43:42.475553 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:43:42.680003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:42.984354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25480): Launched 22:43:43.249157 run iperf3-srv_10.42.42.10(pid=25481): Launched 22:43:43.363606 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:43:43.566745 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:43.871476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25482): Launched 22:43:44.135811 run iperf3-srv_10.42.42.10(pid=25483): Launched 22:43:44.249655 tst cs_paging_gprs_active.py:38: start network... 22:43:44.453214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:44.921935 run create_hlr_db(pid=25484): Launched 22:43:45.038513 bus /gobi_6: Setting Powered False 22:43:46.098451 run create_hlr_db(pid=25484): Terminated: ok {rc=0} 22:43:46.530401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25486): Launched 22:43:46.862223 run osmo-hlr_10.42.42.2(pid=25487): Launched 22:43:47.053719 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:47.619483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25489): Launched 22:43:47.923556 run osmo-stp_10.42.42.5(pid=25490): Launched 22:43:48.040384 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:43:48.562255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25492): Launched 22:43:48.679220 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:43:48.941019 run patchelf(pid=25493): Launched 22:43:49.111083 run osmo-stp_10.42.42.5(pid=25490): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25490)] 22:43:49.240126 run osmo-stp_10.42.42.5(pid=25490): stdout: | (launched: 2022-12-09_22:43:47.867902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:49.370476 run osmo-stp_10.42.42.5(pid=25490): stderr: | 20221209224348037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224348037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224348037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224348038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224348040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224348040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224348040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:49.500298 run osmo-stp_10.42.42.5(pid=25490): stdout: | (launched: 2022-12-09_22:43:47.867902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:49.624493 run osmo-stp_10.42.42.5(pid=25490): stderr: | 20221209224348037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224348037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224348037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224348038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224348040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224348040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224348040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:49.771953 run patchelf(pid=25493): Terminating (SIGINT) 22:43:49.943922 run patchelf(pid=25493): Terminated: ok {rc=0} 22:43:50.067945 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25490): Process ended prematurely: osmo-stp_10.42.42.5(pid=25490) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25490)] [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:43:50.077543 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 22:43:50.105731 run osmo-hlr_10.42.42.2(pid=25487): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25487)] 22:43:50.153967 run osmo-hlr_10.42.42.2(pid=25487): stdout: | (launched: 2022-12-09_22:43:46.795439) 22:43:50.203513 run osmo-hlr_10.42.42.2(pid=25487): stderr: | 20221209224347154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224347154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224347154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224347154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224347154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224347154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224347171 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224347182 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224347182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224347182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:50.253832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25480): Terminating (SIGTERM) 22:43:50.293378 run iperf3-srv_10.42.42.10(pid=25481): Terminating (SIGTERM) 22:43:50.333567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25482): Terminating (SIGTERM) 22:43:50.373735 run iperf3-srv_10.42.42.10(pid=25483): Terminating (SIGTERM) 22:43:50.413353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25486): Terminating (SIGTERM) 22:43:50.453315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25489): Terminating (SIGTERM) 22:43:50.493245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25492): Terminating (SIGTERM) 22:43:50.534380 --- ParallelTerminationStrategy: PID 25480 died... 22:43:50.553588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25480): Terminated: ok {rc=0} 22:43:50.597832 --- ParallelTerminationStrategy: PID 25481 died... 22:43:50.616185 run iperf3-srv_10.42.42.10(pid=25481): Terminated {rc=256} 22:43:50.660422 --- ParallelTerminationStrategy: PID 25482 died... 22:43:50.678984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25482): Terminated: ok {rc=0} 22:43:50.722930 --- ParallelTerminationStrategy: PID 25483 died... 22:43:50.741603 run iperf3-srv_10.42.42.10(pid=25483): Terminated {rc=256} 22:43:50.785612 --- ParallelTerminationStrategy: PID 25486 died... 22:43:50.804261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25486): Terminated: ok {rc=0} 22:43:50.848494 --- ParallelTerminationStrategy: PID 25489 died... 22:43:50.867179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25489): Terminated: ok {rc=0} 22:43:50.911873 --- ParallelTerminationStrategy: PID 25492 died... 22:43:50.930539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25492): Terminated: ok {rc=0} 22:43:51.017802 bus /gobi_0: Setting Powered False 22:43:52.118042 bus /gobi_0: Setting Powered False 22:43:53.237841 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:43:54.383901 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:54.395584 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:43:54.461488 tst iperf3.py: using LAC 24173 22:43:54.582476 tst iperf3.py: using RAC 203 22:43:54.702331 tst iperf3.py: using CellId 24173 22:43:54.822236 tst iperf3.py: using BVCI 24174 22:43:54.933601 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:54.944501 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:54.955308 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:54.966207 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:54.977513 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:54.988481 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:54.999499 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:55.010666 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:55.022047 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:43:55.141936 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:43:55.359665 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:55.683622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25494): Launched 22:43:55.963570 run iperf3-srv_10.42.42.10(pid=25495): Launched 22:43:56.085508 tst iperf3.py:8: start network... 22:43:56.302515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:56.801397 run create_hlr_db(pid=25496): Launched 22:43:56.934248 bus /gobi_6: Setting Powered False 22:43:57.994704 run create_hlr_db(pid=25496): Terminated: ok {rc=0} 22:43:58.445673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25498): Launched 22:43:58.771661 run osmo-hlr_10.42.42.2(pid=25499): Launched 22:43:58.894960 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:59.455129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25501): Launched 22:43:59.778155 run osmo-stp_10.42.42.5(pid=25502): Launched 22:43:59.901347 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:44:00.457120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25504): Launched 22:44:00.580381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:44:00.858601 run patchelf(pid=25505): Launched 22:44:01.046511 run osmo-stp_10.42.42.5(pid=25502): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25502)] 22:44:01.181261 run osmo-stp_10.42.42.5(pid=25502): stdout: | (launched: 2022-12-09_22:43:59.719602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:01.316162 run osmo-stp_10.42.42.5(pid=25502): stderr: | 20221209224359910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224359910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224359910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224359911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224359911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224359911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224359911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:01.452735 run osmo-stp_10.42.42.5(pid=25502): stdout: | (launched: 2022-12-09_22:43:59.719602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:01.583840 run osmo-stp_10.42.42.5(pid=25502): stderr: | 20221209224359910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224359910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224359910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224359911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224359911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224359911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224359911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:01.738368 run patchelf(pid=25505): Terminating (SIGINT) 22:44:01.930609 run patchelf(pid=25505): Terminated: ok {rc=0} 22:44:02.058432 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25502): Process ended prematurely: osmo-stp_10.42.42.5(pid=25502) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25502)] [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 22:44:02.069338 tst iperf3.py:8: Test FAILED (7.7 sec) 22:44:02.098511 run osmo-hlr_10.42.42.2(pid=25499): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25499)] 22:44:02.151319 run osmo-hlr_10.42.42.2(pid=25499): stdout: | (launched: 2022-12-09_22:43:58.712672) 22:44:02.204130 run osmo-hlr_10.42.42.2(pid=25499): stderr: | 20221209224358913 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224358913 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224358913 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224358913 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224358913 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224358913 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224358926 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224358935 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224358935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224358935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:02.256619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25494): Terminating (SIGTERM) 22:44:02.297549 run iperf3-srv_10.42.42.10(pid=25495): Terminating (SIGTERM) 22:44:02.338308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25498): Terminating (SIGTERM) 22:44:02.379146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25501): Terminating (SIGTERM) 22:44:02.419694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25504): Terminating (SIGTERM) 22:44:02.460404 --- ParallelTerminationStrategy: PID 25494 died... 22:44:02.480912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25494): Terminated: ok {rc=0} 22:44:02.526432 --- ParallelTerminationStrategy: PID 25495 died... 22:44:02.545354 run iperf3-srv_10.42.42.10(pid=25495): Terminated {rc=256} 22:44:02.590453 --- ParallelTerminationStrategy: PID 25498 died... 22:44:02.609542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25498): Terminated: ok {rc=0} 22:44:02.654715 --- ParallelTerminationStrategy: PID 25501 died... 22:44:02.673894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25501): Terminated: ok {rc=0} 22:44:02.718947 --- ParallelTerminationStrategy: PID 25504 died... 22:44:02.738303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25504): Terminated: ok {rc=0} 22:44:02.824022 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:44:03.975869 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:03.988014 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:44:04.055037 tst iperf3m4.py: using LAC 24174 22:44:04.180019 tst iperf3m4.py: using RAC 204 22:44:04.303281 tst iperf3m4.py: using CellId 24174 22:44:04.428654 tst iperf3m4.py: using BVCI 24175 22:44:04.545742 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:04.557247 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:04.568677 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:04.580098 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:04.591417 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:04.602676 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:04.614067 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:04.625615 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:04.637271 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:04.756140 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:04.877323 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:04.998896 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:05.116711 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:44:05.320781 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:44:05.624023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25506): Launched 22:44:05.888445 run iperf3-srv_10.42.42.10(pid=25507): Launched 22:44:06.002895 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:44:06.205611 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:44:06.508207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25508): Launched 22:44:06.772788 run iperf3-srv_10.42.42.10(pid=25509): Launched 22:44:06.886968 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:44:07.089273 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:44:07.392527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25510): Launched 22:44:07.656684 run iperf3-srv_10.42.42.10(pid=25511): Launched 22:44:07.770660 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:44:07.972738 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:44:08.275920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25512): Launched 22:44:08.539305 run iperf3-srv_10.42.42.10(pid=25513): Launched 22:44:08.654033 tst iperf3m4.py:8: start network... 22:44:08.856326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:09.323362 run create_hlr_db(pid=25514): Launched 22:44:09.440919 bus /gobi_6: Setting Powered False 22:44:10.501039 run create_hlr_db(pid=25514): Terminated: ok {rc=0} 22:44:10.923767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25516): Launched 22:44:11.226611 run osmo-hlr_10.42.42.2(pid=25517): Launched 22:44:11.342747 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:11.882611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25519): Launched 22:44:12.186256 run osmo-stp_10.42.42.5(pid=25520): Launched 22:44:12.302141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:44:12.823914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25522): Launched 22:44:12.941108 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:44:13.196341 run patchelf(pid=25523): Launched 22:44:13.365603 run osmo-stp_10.42.42.5(pid=25520): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25520)] 22:44:13.494279 run osmo-stp_10.42.42.5(pid=25520): stdout: | (launched: 2022-12-09_22:44:12.130676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:13.624222 run osmo-stp_10.42.42.5(pid=25520): stderr: | 20221209224412299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224412299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224412299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224412300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224412300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224412300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224412300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:13.754251 run osmo-stp_10.42.42.5(pid=25520): stdout: | (launched: 2022-12-09_22:44:12.130676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:13.878051 run osmo-stp_10.42.42.5(pid=25520): stderr: | 20221209224412299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224412299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224412299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224412300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224412300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224412300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224412300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:14.024441 run patchelf(pid=25523): Terminating (SIGINT) 22:44:14.196324 run patchelf(pid=25523): Terminated: ok {rc=0} 22:44:14.319620 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25520): Process ended prematurely: osmo-stp_10.42.42.5(pid=25520) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25520)] [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:44:14.329192 tst iperf3m4.py:8: Test FAILED (10.4 sec) 22:44:14.357373 run osmo-hlr_10.42.42.2(pid=25517): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25517)] 22:44:14.405286 run osmo-hlr_10.42.42.2(pid=25517): stdout: | (launched: 2022-12-09_22:44:11.171018) 22:44:14.454778 run osmo-hlr_10.42.42.2(pid=25517): stderr: | 20221209224411347 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224411347 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224411347 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224411347 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224411347 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224411347 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224411359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224411367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224411367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224411368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:14.504803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25506): Terminating (SIGTERM) 22:44:14.544346 run iperf3-srv_10.42.42.10(pid=25507): Terminating (SIGTERM) 22:44:14.584480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25508): Terminating (SIGTERM) 22:44:14.623901 run iperf3-srv_10.42.42.10(pid=25509): Terminating (SIGTERM) 22:44:14.663876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25510): Terminating (SIGTERM) 22:44:14.703812 run iperf3-srv_10.42.42.10(pid=25511): Terminating (SIGTERM) 22:44:14.743434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25512): Terminating (SIGTERM) 22:44:14.783800 run iperf3-srv_10.42.42.10(pid=25513): Terminating (SIGTERM) 22:44:14.823415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25516): Terminating (SIGTERM) 22:44:14.863802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25519): Terminating (SIGTERM) 22:44:14.903617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25522): Terminating (SIGTERM) 22:44:14.943713 --- ParallelTerminationStrategy: PID 25506 died... 22:44:14.962921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25506): Terminated: ok {rc=0} 22:44:15.007356 --- ParallelTerminationStrategy: PID 25507 died... 22:44:15.025864 run iperf3-srv_10.42.42.10(pid=25507): Terminated {rc=256} 22:44:15.069843 --- ParallelTerminationStrategy: PID 25508 died... 22:44:15.088708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25508): Terminated: ok {rc=0} 22:44:15.132801 --- ParallelTerminationStrategy: PID 25509 died... 22:44:15.151713 run iperf3-srv_10.42.42.10(pid=25509): Terminated {rc=256} 22:44:15.195619 --- ParallelTerminationStrategy: PID 25510 died... 22:44:15.214513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25510): Terminated: ok {rc=0} 22:44:15.259042 --- ParallelTerminationStrategy: PID 25511 died... 22:44:15.277633 run iperf3-srv_10.42.42.10(pid=25511): Terminated {rc=256} 22:44:15.322163 --- ParallelTerminationStrategy: PID 25512 died... 22:44:15.340781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25512): Terminated: ok {rc=0} 22:44:15.384879 --- ParallelTerminationStrategy: PID 25513 died... 22:44:15.403886 run iperf3-srv_10.42.42.10(pid=25513): Terminated {rc=256} 22:44:15.447966 --- ParallelTerminationStrategy: PID 25516 died... 22:44:15.466536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25516): Terminated: ok {rc=0} 22:44:15.510583 --- ParallelTerminationStrategy: PID 25519 died... 22:44:15.529173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25519): Terminated: ok {rc=0} 22:44:15.573248 --- ParallelTerminationStrategy: PID 25522 died... 22:44:15.591739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25522): Terminated: ok {rc=0} 22:44:15.678420 bus /gobi_4: Setting Powered False 22:44:16.782350 bus /gobi_4: Setting Powered False 22:44:17.901594 bus /gobi_1: Setting Powered False 22:44:19.000625 bus /gobi_1: Setting Powered False 22:44:20.116514 bus /gobi_0: Setting Powered False 22:44:21.215735 bus /gobi_0: Setting Powered False 22:44:22.332552 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:44:23.436637 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:23.448886 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:44:23.518377 tst ping.py: using LAC 24175 22:44:23.643736 tst ping.py: using RAC 205 22:44:23.766583 tst ping.py: using CellId 24175 22:44:23.891571 tst ping.py: using BVCI 24176 22:44:24.005934 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:24.017596 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:24.029100 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:24.040484 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:24.051796 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:24.063713 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:24.075328 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:24.086852 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:24.202307 tst ping.py:19: start network... 22:44:24.400750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:24.858308 run create_hlr_db(pid=25526): Launched 22:44:24.971837 bus /gobi_6: Setting Powered False 22:44:26.032045 run create_hlr_db(pid=25526): Terminated: ok {rc=0} 22:44:26.465435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25528): Launched 22:44:26.784234 run osmo-hlr_10.42.42.2(pid=25529): Launched 22:44:26.905330 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:27.451339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25531): Launched 22:44:27.767568 run osmo-stp_10.42.42.5(pid=25532): Launched 22:44:27.888094 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:44:28.434033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25534): Launched 22:44:28.555670 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:44:28.823870 run patchelf(pid=25535): Launched 22:44:29.000618 run osmo-stp_10.42.42.5(pid=25532): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25532)] 22:44:29.135660 run osmo-stp_10.42.42.5(pid=25532): stdout: | (launched: 2022-12-09_22:44:27.709968) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:29.271733 run osmo-stp_10.42.42.5(pid=25532): stderr: | 20221209224427899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224427899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224427899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224427899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224427900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224427900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224427900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:29.407743 run osmo-stp_10.42.42.5(pid=25532): stdout: | (launched: 2022-12-09_22:44:27.709968) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:29.537322 run osmo-stp_10.42.42.5(pid=25532): stderr: | 20221209224427899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224427899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224427899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224427899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224427900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224427900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224427900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:29.690771 run patchelf(pid=25535): Terminating (SIGINT) 22:44:29.869679 run patchelf(pid=25535): Terminated: ok {rc=0} 22:44:29.998614 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25532): Process ended prematurely: osmo-stp_10.42.42.5(pid=25532) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25532)] [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 22:44:30.008137 tst ping.py:22: Test FAILED (6.6 sec) 22:44:30.036182 run osmo-hlr_10.42.42.2(pid=25529): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25529)] 22:44:30.086499 run osmo-hlr_10.42.42.2(pid=25529): stdout: | (launched: 2022-12-09_22:44:26.726528) 22:44:30.138292 run osmo-hlr_10.42.42.2(pid=25529): stderr: | 20221209224426923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224426923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224426923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224426923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224426923 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224426923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224426949 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224426959 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224426959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224426959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:30.190269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25528): Terminating (SIGTERM) 22:44:30.232061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25531): Terminating (SIGTERM) 22:44:30.273923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25534): Terminating (SIGTERM) 22:44:30.316194 --- ParallelTerminationStrategy: PID 25528 died... 22:44:30.336169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25528): Terminated: ok {rc=0} 22:44:30.382574 --- ParallelTerminationStrategy: PID 25531 died... 22:44:30.402224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25531): Terminated: ok {rc=0} 22:44:30.448063 --- ParallelTerminationStrategy: PID 25534 died... 22:44:30.467639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25534): Terminated: ok {rc=0} 22:44:30.554606 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:44:31.642713 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:31.655664 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:44:31.728334 tst ping_idle_ping.py: using LAC 24176 22:44:31.848595 tst ping_idle_ping.py: using RAC 206 22:44:31.995224 tst ping_idle_ping.py: using CellId 24176 22:44:32.136369 tst ping_idle_ping.py: using BVCI 24177 22:44:32.257386 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:32.269105 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:32.280534 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:32.293449 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:32.305378 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:32.317426 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:32.329553 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:32.342394 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:32.462445 tst ping_idle_ping.py:24: start network... 22:44:32.677790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:33.172693 run create_hlr_db(pid=25536): Launched 22:44:33.302917 bus /gobi_6: Setting Powered False 22:44:34.367143 run create_hlr_db(pid=25536): Terminated: ok {rc=0} 22:44:34.810583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25538): Launched 22:44:35.129571 run osmo-hlr_10.42.42.2(pid=25539): Launched 22:44:35.247410 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:35.773182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25541): Launched 22:44:36.071618 run osmo-stp_10.42.42.5(pid=25542): Launched 22:44:36.186190 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:44:36.698952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25544): Launched 22:44:36.814205 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:44:37.066353 run patchelf(pid=25545): Launched 22:44:37.232475 run osmo-stp_10.42.42.5(pid=25542): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25542)] 22:44:37.359049 run osmo-stp_10.42.42.5(pid=25542): stdout: | (launched: 2022-12-09_22:44:36.016830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:37.487180 run osmo-stp_10.42.42.5(pid=25542): stderr: | 20221209224436187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224436187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224436188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224436188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224436188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224436189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224436189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:37.615257 run osmo-stp_10.42.42.5(pid=25542): stdout: | (launched: 2022-12-09_22:44:36.016830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:37.736933 run osmo-stp_10.42.42.5(pid=25542): stderr: | 20221209224436187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224436187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224436188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224436188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224436188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224436189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224436189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:37.881259 run patchelf(pid=25545): Terminating (SIGINT) 22:44:38.050060 run patchelf(pid=25545): Terminated: ok {rc=0} 22:44:38.171850 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25542): Process ended prematurely: osmo-stp_10.42.42.5(pid=25542) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25542)] [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:44:38.180802 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:44:38.207941 run osmo-hlr_10.42.42.2(pid=25539): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25539)] 22:44:38.256078 run osmo-hlr_10.42.42.2(pid=25539): stdout: | (launched: 2022-12-09_22:44:35.071668) 22:44:38.305885 run osmo-hlr_10.42.42.2(pid=25539): stderr: | 20221209224435248 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224435248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224435248 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224435248 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224435248 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224435248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224435265 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224435274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224435274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224435274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:38.356087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25538): Terminating (SIGTERM) 22:44:38.395794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25541): Terminating (SIGTERM) 22:44:38.436111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25544): Terminating (SIGTERM) 22:44:38.476860 --- ParallelTerminationStrategy: PID 25538 died... 22:44:38.496225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25538): Terminated: ok {rc=0} 22:44:38.541800 --- ParallelTerminationStrategy: PID 25541 died... 22:44:38.560298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25541): Terminated: ok {rc=0} 22:44:38.604335 --- ParallelTerminationStrategy: PID 25544 died... 22:44:38.622889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25544): Terminated: ok {rc=0} 22:44:38.706835 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:44:40.014440 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:44:40.021823 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:44:40.052053 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:44:40.088088 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:44:40.143446 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:44:40.174601 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:44:40.210321 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:44:40.768271 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2365 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:44:40.773993 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:40.785894 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:44:40.853784 tst switch_tch_pdch.py: using LAC 24177 22:44:40.979410 tst switch_tch_pdch.py: using RAC 207 22:44:41.105061 tst switch_tch_pdch.py: using CellId 24177 22:44:41.229609 tst switch_tch_pdch.py: using BVCI 24178 22:44:41.343643 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:41.355291 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:41.366996 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:41.378799 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:41.390669 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:41.402556 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:41.414459 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:41.426355 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:44:41.541747 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:44:41.659967 tst switch_tch_pdch.py:51: start network... 22:44:41.873391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:42.361767 run create_hlr_db(pid=25549): Launched 22:44:42.490831 bus /gobi_6: Setting Powered False 22:44:43.554088 run create_hlr_db(pid=25549): Terminated: ok {rc=0} 22:44:43.978820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25551): Launched 22:44:44.275303 run osmo-hlr_10.42.42.2(pid=25552): Launched 22:44:44.389577 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:44.916192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25554): Launched 22:44:45.214099 run osmo-stp_10.42.42.5(pid=25555): Launched 22:44:45.328000 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:44:45.845899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25557): Launched 22:44:45.988924 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:44:46.247352 run patchelf(pid=25558): Launched 22:44:46.432773 run osmo-stp_10.42.42.5(pid=25555): ERR: Terminated: ERROR {rc=1} [trial-2365↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25555)] 22:44:46.562602 run osmo-stp_10.42.42.5(pid=25555): stdout: | (launched: 2022-12-09_22:44:45.159572) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:46.694216 run osmo-stp_10.42.42.5(pid=25555): stderr: | 20221209224445327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224445328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224445328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224445328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224445329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224445329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224445329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:46.826515 run osmo-stp_10.42.42.5(pid=25555): stdout: | (launched: 2022-12-09_22:44:45.159572) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:46.952083 run osmo-stp_10.42.42.5(pid=25555): stderr: | 20221209224445327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224445328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224445328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224445328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224445329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224445329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224445329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:47.100333 run patchelf(pid=25558): Terminating (SIGINT) 22:44:47.272803 run patchelf(pid=25558): Terminated: ok {rc=0} 22:44:47.394783 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25555): Process ended prematurely: osmo-stp_10.42.42.5(pid=25555) [trial-2365↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25555)] [trial-2365↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:44:47.403788 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 22:44:47.430999 run osmo-hlr_10.42.42.2(pid=25552): ERR: Terminated: ERROR {rc=237} [trial-2365↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25552)] 22:44:47.479585 run osmo-hlr_10.42.42.2(pid=25552): stdout: | (launched: 2022-12-09_22:44:44.221055) 22:44:47.529519 run osmo-hlr_10.42.42.2(pid=25552): stderr: | 20221209224444394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224444394 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224444394 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224444395 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224444395 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224444395 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224444406 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224444415 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224444415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224444415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:47.579718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25551): Terminating (SIGTERM) 22:44:47.619708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25554): Terminating (SIGTERM) 22:44:47.659845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25557): Terminating (SIGTERM) 22:44:47.700364 --- ParallelTerminationStrategy: PID 25551 died... 22:44:47.719316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25551): Terminated: ok {rc=0} 22:44:47.763912 --- ParallelTerminationStrategy: PID 25554 died... 22:44:47.782448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25554): Terminated: ok {rc=0} 22:44:47.827182 --- ParallelTerminationStrategy: PID 25557 died... 22:44:47.845820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25557): Terminated: ok {rc=0} 22:44:47.932449 bus /gobi_0: Setting Powered False 22:44:49.032216 bus /gobi_0: Setting Powered False 22:44:50.146954 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:44:51.404512 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:44:51.410933 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:44:51.441135 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:44:51.476357 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:44:51.532870 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:44:51.563664 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:44:51.598938 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:44:52.150980 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2365 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:44:52.156024 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:52.167132 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:44:52.232881 tst switch_tch_pdch.py: using LAC 24178 22:44:52.349045 tst switch_tch_pdch.py: using RAC 208 22:44:52.473658 tst switch_tch_pdch.py: using CellId 24178 22:44:52.599439 tst switch_tch_pdch.py: using BVCI 24179 22:44:52.715663 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:52.727707 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:52.739249 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:52.750951 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:52.762674 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:52.774336 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:52.786036 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:52.797504 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:44:52.914660 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:44:53.030774 tst switch_tch_pdch.py:51: start network... 22:44:53.228248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:53.658555 run create_hlr_db(pid=25562): Launched 22:44:53.773478 bus /gobi_6: Setting Powered False 22:44:54.832909 run create_hlr_db(pid=25562): Terminated: ok {rc=0} 22:44:55.240038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25564): Launched 22:44:55.556370 run osmo-hlr_10.42.42.2(pid=25565): Launched 22:44:55.678432 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:56.195657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25567): Launched 22:44:56.511322 run osmo-stp_10.42.42.5(pid=25568): Launched 22:44:56.631933 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:44:57.152495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25570): Launched 22:44:57.274026 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:44:57.540794 run patchelf(pid=25571): Launched 22:44:57.717251 run osmo-stp_10.42.42.5(pid=25568): ERR: Terminated: ERROR {rc=1} [trial-2365↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25568)] 22:44:57.851732 run osmo-stp_10.42.42.5(pid=25568): stdout: | (launched: 2022-12-09_22:44:56.454012) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:57.987926 run osmo-stp_10.42.42.5(pid=25568): stderr: | 20221209224456645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224456645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224456645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224456646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224456646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224456646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224456646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:58.124572 run osmo-stp_10.42.42.5(pid=25568): stdout: | (launched: 2022-12-09_22:44:56.454012) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:58.253991 run osmo-stp_10.42.42.5(pid=25568): stderr: | 20221209224456645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224456645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224456645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224456646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224456646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224456646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224456646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:58.407274 run patchelf(pid=25571): Terminating (SIGINT) 22:44:58.586433 run patchelf(pid=25571): Terminated: ok {rc=0} 22:44:58.715331 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25568): Process ended prematurely: osmo-stp_10.42.42.5(pid=25568) [trial-2365↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25568)] [trial-2365↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:44:58.724746 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 22:44:58.752914 run osmo-hlr_10.42.42.2(pid=25565): ERR: Terminated: ERROR {rc=237} [trial-2365↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25565)] 22:44:58.802877 run osmo-hlr_10.42.42.2(pid=25565): stdout: | (launched: 2022-12-09_22:44:55.498953) 22:44:58.854845 run osmo-hlr_10.42.42.2(pid=25565): stderr: | 20221209224455696 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224455696 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224455696 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224455696 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224455696 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224455696 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224455708 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224455717 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224455717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224455717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:58.907187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25564): Terminating (SIGTERM) 22:44:58.949060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25567): Terminating (SIGTERM) 22:44:58.991180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25570): Terminating (SIGTERM) 22:44:59.033709 --- ParallelTerminationStrategy: PID 25564 died... 22:44:59.054087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25564): Terminated: ok {rc=0} 22:44:59.101491 --- ParallelTerminationStrategy: PID 25567 died... 22:44:59.121229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25567): Terminated: ok {rc=0} 22:44:59.167446 --- ParallelTerminationStrategy: PID 25570 died... 22:44:59.187124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25570): Terminated: ok {rc=0} 22:44:59.274404 bus /gobi_0: Setting Powered False 22:45:00.374296 bus /gobi_0: Setting Powered False 22:45:01.503392 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_sms:nanobts --------------------------------------------------------------------- 22:45:02.747674 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:02.751377 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 22:45:02.775278 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 22:45:02.785153 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 22:45:02.838733 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 22:45:02.863445 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 22:45:02.870553 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 22:45:03.407904 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 22:45:03.413203 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 22:45:03.424364 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 22:45:03.465759 tst mo_mt_sms.py: using LAC 24179 22:45:03.589252 tst mo_mt_sms.py: using RAC 209 22:45:03.711219 tst mo_mt_sms.py: using CellId 24179 22:45:03.834180 tst mo_mt_sms.py: using BVCI 24180 22:45:03.949133 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 22:45:04.066629 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 22:45:04.182846 tst mo_mt_sms.py:9: start nitb and bts... 22:45:04.381548 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:45:04.985198 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25581): Launched 22:45:05.281468 run osmo-nitb_10.42.42.2(pid=25582): Launched 22:45:05.447208 run osmo-nitb_10.42.42.2(pid=25582): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25582)] 22:45:05.581882 run osmo-nitb_10.42.42.2(pid=25582): stdout: | (launched: 2022-12-09_22:45:05.227523) 22:45:05.717653 run osmo-nitb_10.42.42.2(pid=25582): stderr: | (launched: 2022-12-09_22:45:05.271450) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:45:05.853812 run osmo-nitb_10.42.42.2(pid=25582): stdout: | (launched: 2022-12-09_22:45:05.227523) 22:45:05.983540 run osmo-nitb_10.42.42.2(pid=25582): stderr: | (launched: 2022-12-09_22:45:05.271450) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25582): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25582) [trial-2365↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25582)] 22:45:06.394095 tst osmo-nitb_10.42.42.2(pid=25582): stdout: | (launched: 2022-12-09_22:45:05.227523) 22:45:06.514718 tst osmo-nitb_10.42.42.2(pid=25582): stderr: | (launched: 2022-12-09_22:45:05.271450) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:45:06.656441 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=25582): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25582) [trial-2365↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25582)] [trial-2365↪nitb_sms:nanobts↪mo_mt_sms.py:11] 22:45:06.665103 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 22:45:06.671623 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25581): Terminating (SIGTERM) 22:45:06.880652 --- ParallelTerminationStrategy: PID 25581 died... 22:45:06.901086 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25581): Terminated: ok {rc=0} 22:45:06.987356 bus /sierra_3: Setting Powered False 22:45:08.087892 bus /sierra_3: Setting Powered False 22:45:09.206144 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 sms:nanobts+band-1900 --------------------------------------------------------------------- 22:45:10.386376 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:10.391432 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 22:45:10.415596 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 22:45:10.441835 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 22:45:10.494805 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 22:45:10.518582 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 22:45:10.544675 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 22:45:11.095494 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 22:45:11.101056 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:11.112307 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:45:11.153984 tst mo_mt_sms.py: using LAC 24180 22:45:11.278332 tst mo_mt_sms.py: using RAC 210 22:45:11.401140 tst mo_mt_sms.py: using CellId 24180 22:45:11.524002 tst mo_mt_sms.py: using BVCI 24181 22:45:11.638075 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:11.649092 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:11.659990 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:11.671164 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:11.682297 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:11.693346 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 22:45:11.814350 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 22:45:11.931882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:12.423371 run create_hlr_db(pid=25586): Launched 22:45:12.552367 bus /sierra_2: Setting Powered False 22:45:13.615691 run create_hlr_db(pid=25586): Terminated: ok {rc=0} 22:45:14.057169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25588): Launched 22:45:14.374267 run osmo-hlr_10.42.42.2(pid=25589): Launched 22:45:14.494585 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:15.036890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25591): Launched 22:45:15.354638 run osmo-stp_10.42.42.5(pid=25592): Launched 22:45:15.474992 run osmo-msc_10.42.42.6: Starting osmo-msc 22:45:16.059741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25594): Launched 22:45:16.381670 run osmo-msc_10.42.42.6(pid=25595): Launched 22:45:16.671298 run osmo-stp_10.42.42.5(pid=25592): ERR: Terminated: ERROR {rc=1} [trial-2365↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25592)] 22:45:16.973265 run osmo-stp_10.42.42.5(pid=25592): stdout: | (launched: 2022-12-09_22:45:15.297163) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:17.221837 run osmo-stp_10.42.42.5(pid=25592): stderr: | 20221209224515486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224515486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224515487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224515487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224515490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224515490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224515490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:17.356330 run osmo-stp_10.42.42.5(pid=25592): stdout: | (launched: 2022-12-09_22:45:15.297163) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:17.483608 run osmo-stp_10.42.42.5(pid=25592): stderr: | 20221209224515486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224515486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224515487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224515487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224515490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224515490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224515490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:17.635126 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=25592): Process ended prematurely: osmo-stp_10.42.42.5(pid=25592) [trial-2365↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25592)] [trial-2365↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 22:45:17.644168 tst mo_mt_sms.py:16: Test FAILED (6.5 sec) 22:45:17.672041 run osmo-hlr_10.42.42.2(pid=25589): ERR: Terminated: ERROR {rc=237} [trial-2365↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25589)] 22:45:17.722917 run osmo-hlr_10.42.42.2(pid=25589): stdout: | (launched: 2022-12-09_22:45:14.316883) 22:45:17.775625 run osmo-hlr_10.42.42.2(pid=25589): stderr: | 20221209224514514 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224514514 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224514514 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224514514 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224514514 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224514514 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224514529 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224514539 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224514539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224514539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:45:17.848500 run osmo-msc_10.42.42.6(pid=25595): ERR: Terminated: ERROR {rc=2} [trial-2365↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25595)] 22:45:17.898863 run osmo-msc_10.42.42.6(pid=25595): stdout: | (launched: 2022-12-09_22:45:16.315530) 22:45:17.950692 run osmo-msc_10.42.42.6(pid=25595): stderr: | 20221209224516882 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224516883 DLGLOBAL DEBUG validating counter group 0x7fddbd15cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224516884 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224516884 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224516886 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224516887 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224516897 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224516900 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224516900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224516900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:45:18.003082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25588): Terminating (SIGTERM) 22:45:18.045276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25591): Terminating (SIGTERM) 22:45:18.087630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25594): Terminating (SIGTERM) 22:45:18.130455 --- ParallelTerminationStrategy: PID 25588 died... 22:45:18.150785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25588): Terminated: ok {rc=0} 22:45:18.197868 --- ParallelTerminationStrategy: PID 25591 died... 22:45:18.217700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25591): Terminated: ok {rc=0} 22:45:18.264555 --- ParallelTerminationStrategy: PID 25594 died... 22:45:18.284505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25594): Terminated: ok {rc=0} 22:45:18.374344 bus /sierra_3: Setting Powered False 22:45:19.471923 bus /sierra_3: Setting Powered False 22:45:20.587163 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 22:45:21.813923 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:21.819137 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 22:45:21.843731 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 22:45:21.850990 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 22:45:21.887726 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 22:45:21.911046 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 22:45:21.917886 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 22:45:22.438218 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2365 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 22:45:22.443693 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 22:45:22.455043 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:45:22.494022 tst assert_extension.py: using LAC 24181 22:45:22.619638 tst assert_extension.py: using RAC 211 22:45:22.742557 tst assert_extension.py: using CellId 24181 22:45:22.866805 tst assert_extension.py: using BVCI 24182 22:45:22.980829 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 22:45:23.095148 tst assert_extension.py:10: start nitb and bts... 22:45:23.296313 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:45:23.903088 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25600): Launched 22:45:24.200881 run osmo-nitb_10.42.42.2(pid=25601): Launched 22:45:24.366563 run osmo-nitb_10.42.42.2(pid=25601): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25601)] 22:45:24.500134 run osmo-nitb_10.42.42.2(pid=25601): stdout: | (launched: 2022-12-09_22:45:24.146819) 22:45:24.635322 run osmo-nitb_10.42.42.2(pid=25601): stderr: | (launched: 2022-12-09_22:45:24.190961) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:45:24.770864 run osmo-nitb_10.42.42.2(pid=25601): stdout: | (launched: 2022-12-09_22:45:24.146819) 22:45:24.900166 run osmo-nitb_10.42.42.2(pid=25601): stderr: | (launched: 2022-12-09_22:45:24.190961) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25601): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25601) [trial-2365↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25601)] 22:45:25.313640 tst osmo-nitb_10.42.42.2(pid=25601): stdout: | (launched: 2022-12-09_22:45:24.146819) 22:45:25.434747 tst osmo-nitb_10.42.42.2(pid=25601): stderr: | (launched: 2022-12-09_22:45:24.190961) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:45:25.577437 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=25601): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25601) [trial-2365↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25601)] [trial-2365↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 22:45:25.585795 tst assert_extension.py:12: Test FAILED (3.1 sec) 22:45:25.592291 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25600): Terminating (SIGTERM) 22:45:25.801777 --- ParallelTerminationStrategy: PID 25600 died... 22:45:25.822856 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25600): Terminated: ok {rc=0} 22:45:25.907452 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 ussd:nanobts+band-1900 --------------------------------------------------------------------- 22:45:27.078263 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:27.084116 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 22:45:27.108337 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 22:45:27.136154 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 22:45:27.170289 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 22:45:27.194808 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 22:45:27.222207 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 22:45:27.753873 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2365 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 22:45:27.759400 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:27.770742 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:45:27.814228 tst assert_extension.py: using LAC 24182 22:45:27.937923 tst assert_extension.py: using RAC 212 22:45:28.061018 tst assert_extension.py: using CellId 24182 22:45:28.184468 tst assert_extension.py: using BVCI 24183 22:45:28.299138 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:28.310277 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:28.321272 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:28.332731 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:28.344294 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:28.355669 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 22:45:28.475429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:28.965840 run create_hlr_db(pid=25605): Launched 22:45:29.094935 bus /sierra_2: Setting Powered False 22:45:30.158450 run create_hlr_db(pid=25605): Terminated: ok {rc=0} 22:45:30.584792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25607): Launched 22:45:30.891966 run osmo-hlr_10.42.42.2(pid=25608): Launched 22:45:31.054643 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:31.786378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25610): Launched 22:45:32.096130 run osmo-stp_10.42.42.5(pid=25611): Launched 22:45:32.359730 run osmo-msc_10.42.42.6: Starting osmo-msc 22:45:32.897927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25613): Launched 22:45:33.195058 run osmo-msc_10.42.42.6(pid=25614): Launched 22:45:33.361993 run osmo-stp_10.42.42.5(pid=25611): ERR: Terminated: ERROR {rc=1} [trial-2365↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25611)] 22:45:33.487923 run osmo-stp_10.42.42.5(pid=25611): stdout: | (launched: 2022-12-09_22:45:32.034282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:33.614456 run osmo-stp_10.42.42.5(pid=25611): stderr: | 20221209224532324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224532324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224532324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224532325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224532325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224532325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224532325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:33.738745 run osmo-stp_10.42.42.5(pid=25611): stdout: | (launched: 2022-12-09_22:45:32.034282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:33.857602 run osmo-stp_10.42.42.5(pid=25611): stderr: | 20221209224532324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224532324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224532324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224532325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224532325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224532325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224532325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:33.999381 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=25611): Process ended prematurely: osmo-stp_10.42.42.5(pid=25611) [trial-2365↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25611)] [trial-2365↪ussd:nanobts+band-1900↪assert_extension.py:17] 22:45:34.007873 tst assert_extension.py:17: Test FAILED (6.2 sec) 22:45:34.034356 run osmo-hlr_10.42.42.2(pid=25608): ERR: Terminated: ERROR {rc=237} [trial-2365↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25608)] 22:45:34.082781 run osmo-hlr_10.42.42.2(pid=25608): stdout: | (launched: 2022-12-09_22:45:30.830923) 22:45:34.132292 run osmo-hlr_10.42.42.2(pid=25608): stderr: | 20221209224531222 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224531222 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224531222 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224531222 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224531222 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224531222 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224531238 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224531255 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224531255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224531255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:45:34.201323 run osmo-msc_10.42.42.6(pid=25614): ERR: Terminated: ERROR {rc=2} [trial-2365↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25614)] 22:45:34.249369 run osmo-msc_10.42.42.6(pid=25614): stdout: | (launched: 2022-12-09_22:45:33.140639) 22:45:34.298883 run osmo-msc_10.42.42.6(pid=25614): stderr: | 20221209224533410 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224533410 DLGLOBAL DEBUG validating counter group 0x7f1261754c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224533411 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224533411 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224533411 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224533411 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224533413 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224533413 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224533413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224533414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:45:34.348722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25607): Terminating (SIGTERM) 22:45:34.388753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25610): Terminating (SIGTERM) 22:45:34.429171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25613): Terminating (SIGTERM) 22:45:34.470266 --- ParallelTerminationStrategy: PID 25607 died... 22:45:34.489462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25607): Terminated: ok {rc=0} 22:45:34.534346 --- ParallelTerminationStrategy: PID 25610 died... 22:45:34.552828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25610): Terminated: ok {rc=0} 22:45:34.597791 --- ParallelTerminationStrategy: PID 25613 died... 22:45:34.616551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25613): Terminated: ok {rc=0} 22:45:34.704002 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:45:35.909917 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:35.917841 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:45:35.942303 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:45:35.969536 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:45:36.022734 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:45:36.047466 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:45:36.074421 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:45:36.631150 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:45:36.683129 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:36.694833 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:45:36.754245 tst mo_mt_call.py: using LAC 24183 22:45:36.878765 tst mo_mt_call.py: using RAC 213 22:45:37.002296 tst mo_mt_call.py: using CellId 24183 22:45:37.127800 tst mo_mt_call.py: using BVCI 24184 22:45:37.245531 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:37.257119 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:37.268476 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:37.280104 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:37.291616 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:37.303095 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:45:37.420361 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:45:37.540626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:38.010760 run create_hlr_db(pid=25619): Launched 22:45:38.128214 bus /sierra_2: Setting Powered False 22:45:39.189102 run create_hlr_db(pid=25619): Terminated: ok {rc=0} 22:45:39.611121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25621): Launched 22:45:39.913787 run osmo-hlr_10.42.42.2(pid=25622): Launched 22:45:40.030373 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:40.566350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25624): Launched 22:45:40.867874 run osmo-stp_10.42.42.5(pid=25625): Launched 22:45:40.983733 run osmo-msc_10.42.42.6: Starting osmo-msc 22:45:41.529709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25627): Launched 22:45:41.832238 run osmo-msc_10.42.42.6(pid=25628): Launched 22:45:42.002187 run osmo-stp_10.42.42.5(pid=25625): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25625)] 22:45:42.130178 run osmo-stp_10.42.42.5(pid=25625): stdout: | (launched: 2022-12-09_22:45:40.812767) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:42.258769 run osmo-stp_10.42.42.5(pid=25625): stderr: | 20221209224540983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224540983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224540983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224540984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224540984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224540984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224540984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:42.384648 run osmo-stp_10.42.42.5(pid=25625): stdout: | (launched: 2022-12-09_22:45:40.812767) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:42.504157 run osmo-stp_10.42.42.5(pid=25625): stderr: | 20221209224540983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224540983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224540983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224540984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224540984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224540984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224540984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:42.647610 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25625): Process ended prematurely: osmo-stp_10.42.42.5(pid=25625) [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25625)] [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:45:42.656586 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:45:42.683182 run osmo-hlr_10.42.42.2(pid=25622): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25622)] 22:45:42.731294 run osmo-hlr_10.42.42.2(pid=25622): stdout: | (launched: 2022-12-09_22:45:39.858444) 22:45:42.780806 run osmo-hlr_10.42.42.2(pid=25622): stderr: | 20221209224540034 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224540034 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224540034 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224540035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224540035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224540035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224540046 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224540055 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224540055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224540055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:45:42.849764 run osmo-msc_10.42.42.6(pid=25628): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25628)] 22:45:42.897726 run osmo-msc_10.42.42.6(pid=25628): stdout: | (launched: 2022-12-09_22:45:41.777083) 22:45:42.947090 run osmo-msc_10.42.42.6(pid=25628): stderr: | 20221209224542050 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224542050 DLGLOBAL DEBUG validating counter group 0x7f6c5db68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224542050 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224542050 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224542051 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224542051 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224542052 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224542053 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224542053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224542053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:45:42.996841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25621): Terminating (SIGTERM) 22:45:43.036214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25624): Terminating (SIGTERM) 22:45:43.075557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25627): Terminating (SIGTERM) 22:45:43.115377 --- ParallelTerminationStrategy: PID 25621 died... 22:45:43.134477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25621): Terminated: ok {rc=0} 22:45:43.178753 --- ParallelTerminationStrategy: PID 25624 died... 22:45:43.197768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25624): Terminated: ok {rc=0} 22:45:43.241943 --- ParallelTerminationStrategy: PID 25627 died... 22:45:43.260345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25627): Terminated: ok {rc=0} 22:45:43.344443 bus /sierra_3: Setting Powered False 22:45:44.439837 bus /sierra_3: Setting Powered False 22:45:45.553398 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:45:46.720645 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:46.734098 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:45:46.794650 tst mo_mt_call_osmux.py: using LAC 24184 22:45:46.919371 tst mo_mt_call_osmux.py: using RAC 214 22:45:47.067522 tst mo_mt_call_osmux.py: using CellId 24184 22:45:47.188181 tst mo_mt_call_osmux.py: using BVCI 24185 22:45:47.300107 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:47.312633 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:47.324304 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:47.336183 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:47.347696 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:47.359115 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:45:47.479570 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:45:47.597520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:48.067627 run create_hlr_db(pid=25630): Launched 22:45:48.183977 bus /sierra_2: Setting Powered False 22:45:49.245189 run create_hlr_db(pid=25630): Terminated: ok {rc=0} 22:45:49.687627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25632): Launched 22:45:50.011734 run osmo-hlr_10.42.42.2(pid=25633): Launched 22:45:50.136309 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:50.691121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25635): Launched 22:45:51.014217 run osmo-stp_10.42.42.5(pid=25636): Launched 22:45:51.138679 run osmo-msc_10.42.42.6: Starting osmo-msc 22:45:51.722515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25638): Launched 22:45:52.045211 run osmo-msc_10.42.42.6(pid=25639): Launched 22:45:52.225706 run osmo-stp_10.42.42.5(pid=25636): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25636)] 22:45:52.361669 run osmo-stp_10.42.42.5(pid=25636): stdout: | (launched: 2022-12-09_22:45:50.955795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:52.498792 run osmo-stp_10.42.42.5(pid=25636): stderr: | 20221209224551148 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224551148 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224551149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224551149 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224551150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224551150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224551150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:52.634131 run osmo-stp_10.42.42.5(pid=25636): stdout: | (launched: 2022-12-09_22:45:50.955795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:52.762167 run osmo-stp_10.42.42.5(pid=25636): stderr: | 20221209224551148 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224551148 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224551149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224551149 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224551150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224551150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224551150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:52.915364 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25636): Process ended prematurely: osmo-stp_10.42.42.5(pid=25636) [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25636)] [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:45:52.925077 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:45:52.952858 run osmo-hlr_10.42.42.2(pid=25633): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25633)] 22:45:53.002998 run osmo-hlr_10.42.42.2(pid=25633): stdout: | (launched: 2022-12-09_22:45:49.952881) 22:45:53.054668 run osmo-hlr_10.42.42.2(pid=25633): stderr: | 20221209224550152 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224550152 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224550153 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224550153 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224550153 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224550153 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224550181 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224550192 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224550192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224550192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:45:53.127178 run osmo-msc_10.42.42.6(pid=25639): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25639)] 22:45:53.177439 run osmo-msc_10.42.42.6(pid=25639): stdout: | (launched: 2022-12-09_22:45:51.986473) 22:45:53.228914 run osmo-msc_10.42.42.6(pid=25639): stderr: | 20221209224552309 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224552309 DLGLOBAL DEBUG validating counter group 0x7f761879cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224552309 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224552309 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224552309 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224552310 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224552311 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224552312 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224552312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224552312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:45:53.280715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25632): Terminating (SIGTERM) 22:45:53.322331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25635): Terminating (SIGTERM) 22:45:53.364428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25638): Terminating (SIGTERM) 22:45:53.406281 --- ParallelTerminationStrategy: PID 25632 died... 22:45:53.426261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25632): Terminated: ok {rc=0} 22:45:53.472461 --- ParallelTerminationStrategy: PID 25635 died... 22:45:53.492245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25635): Terminated: ok {rc=0} 22:45:53.538370 --- ParallelTerminationStrategy: PID 25638 died... 22:45:53.557864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25638): Terminated: ok {rc=0} 22:45:53.646711 bus /sierra_3: Setting Powered False 22:45:54.746076 bus /sierra_3: Setting Powered False 22:45:55.861880 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:45:57.171437 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:57.180423 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:45:57.204606 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:45:57.231555 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:45:57.284536 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:45:57.308658 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:45:57.335543 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:45:57.890041 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:45:57.943100 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:57.954652 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:45:58.013523 tst mo_mt_call.py: using LAC 24185 22:45:58.137977 tst mo_mt_call.py: using RAC 215 22:45:58.256396 tst mo_mt_call.py: using CellId 24185 22:45:58.382404 tst mo_mt_call.py: using BVCI 24186 22:45:58.499412 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:58.510984 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:58.522487 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:58.533947 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:58.545736 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:58.557066 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:45:58.673359 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:45:58.794513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:59.294084 run create_hlr_db(pid=25644): Launched 22:45:59.425675 bus /sierra_2: Setting Powered False 22:46:00.490215 run create_hlr_db(pid=25644): Terminated: ok {rc=0} 22:46:00.936879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25646): Launched 22:46:01.350524 run osmo-hlr_10.42.42.2(pid=25647): Launched 22:46:01.585276 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:02.312807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25649): Launched 22:46:02.617352 run osmo-stp_10.42.42.5(pid=25650): Launched 22:46:02.734333 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:03.282027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25652): Launched 22:46:03.585744 run osmo-msc_10.42.42.6(pid=25653): Launched 22:46:03.758502 run osmo-stp_10.42.42.5(pid=25650): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25650)] 22:46:03.887899 run osmo-stp_10.42.42.5(pid=25650): stdout: | (launched: 2022-12-09_22:46:02.561731) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:04.017599 run osmo-stp_10.42.42.5(pid=25650): stderr: | 20221209224602731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224602731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224602731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224602732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224602732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224602732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224602732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:04.145490 run osmo-stp_10.42.42.5(pid=25650): stdout: | (launched: 2022-12-09_22:46:02.561731) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:04.266816 run osmo-stp_10.42.42.5(pid=25650): stderr: | 20221209224602731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224602731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224602731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224602732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224602732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224602732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224602732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:04.412226 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25650): Process ended prematurely: osmo-stp_10.42.42.5(pid=25650) [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25650)] [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:46:04.421161 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 22:46:04.447711 run osmo-hlr_10.42.42.2(pid=25647): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25647)] 22:46:04.495590 run osmo-hlr_10.42.42.2(pid=25647): stdout: | (launched: 2022-12-09_22:46:01.288404) 22:46:04.544767 run osmo-hlr_10.42.42.2(pid=25647): stderr: | 20221209224601634 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224601634 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224601634 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224601634 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224601634 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224601634 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224601655 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224601669 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224601669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224601669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:04.613690 run osmo-msc_10.42.42.6(pid=25653): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25653)] 22:46:04.661249 run osmo-msc_10.42.42.6(pid=25653): stdout: | (launched: 2022-12-09_22:46:03.530026) 22:46:04.710627 run osmo-msc_10.42.42.6(pid=25653): stderr: | 20221209224603801 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224603802 DLGLOBAL DEBUG validating counter group 0x7f720a3a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224603802 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224603802 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224603802 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224603802 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224603804 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224603804 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224603804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224603804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:04.760298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25646): Terminating (SIGTERM) 22:46:04.799581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25649): Terminating (SIGTERM) 22:46:04.839770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25652): Terminating (SIGTERM) 22:46:04.879778 --- ParallelTerminationStrategy: PID 25646 died... 22:46:04.898850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25646): Terminated: ok {rc=0} 22:46:04.942993 --- ParallelTerminationStrategy: PID 25649 died... 22:46:04.961505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25649): Terminated: ok {rc=0} 22:46:05.005594 --- ParallelTerminationStrategy: PID 25652 died... 22:46:05.024044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25652): Terminated: ok {rc=0} 22:46:05.109837 bus /sierra_3: Setting Powered False 22:46:06.208520 bus /sierra_3: Setting Powered False 22:46:07.323942 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:46:08.469982 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:08.481797 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:46:08.542852 tst mo_mt_call_osmux.py: using LAC 24186 22:46:08.666404 tst mo_mt_call_osmux.py: using RAC 216 22:46:08.784806 tst mo_mt_call_osmux.py: using CellId 24186 22:46:08.901645 tst mo_mt_call_osmux.py: using BVCI 24187 22:46:09.019590 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:09.031419 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:09.043056 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:09.054802 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:09.066568 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:09.078157 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:46:09.193460 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:46:09.309496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:09.779751 run create_hlr_db(pid=25655): Launched 22:46:09.894937 bus /sierra_2: Setting Powered False 22:46:10.955121 run create_hlr_db(pid=25655): Terminated: ok {rc=0} 22:46:11.391740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25657): Launched 22:46:11.711051 run osmo-hlr_10.42.42.2(pid=25658): Launched 22:46:11.832783 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:12.380220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25660): Launched 22:46:12.697686 run osmo-stp_10.42.42.5(pid=25661): Launched 22:46:12.818840 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:13.393568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25663): Launched 22:46:13.715607 run osmo-msc_10.42.42.6(pid=25664): Launched 22:46:13.893722 run osmo-stp_10.42.42.5(pid=25661): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25661)] 22:46:14.027723 run osmo-stp_10.42.42.5(pid=25661): stdout: | (launched: 2022-12-09_22:46:12.640411) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:14.163988 run osmo-stp_10.42.42.5(pid=25661): stderr: | 20221209224612834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224612834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224612834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224612834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224612835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224612835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224612835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:14.298523 run osmo-stp_10.42.42.5(pid=25661): stdout: | (launched: 2022-12-09_22:46:12.640411) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:14.425664 run osmo-stp_10.42.42.5(pid=25661): stderr: | 20221209224612834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224612834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224612834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224612834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224612835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224612835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224612835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:14.577741 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25661): Process ended prematurely: osmo-stp_10.42.42.5(pid=25661) [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25661)] [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:46:14.587168 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:46:14.614654 run osmo-hlr_10.42.42.2(pid=25658): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25658)] 22:46:14.664327 run osmo-hlr_10.42.42.2(pid=25658): stdout: | (launched: 2022-12-09_22:46:11.653171) 22:46:14.715818 run osmo-hlr_10.42.42.2(pid=25658): stderr: | 20221209224611851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224611851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224611851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224611851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224611851 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224611851 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224611863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224611872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224611872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224611872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:14.787696 run osmo-msc_10.42.42.6(pid=25664): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25664)] 22:46:14.837521 run osmo-msc_10.42.42.6(pid=25664): stdout: | (launched: 2022-12-09_22:46:13.657231) 22:46:14.889033 run osmo-msc_10.42.42.6(pid=25664): stderr: | 20221209224613980 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224613980 DLGLOBAL DEBUG validating counter group 0x7fa4d2d7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224613980 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224613980 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224613980 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224613981 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224613982 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224613983 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224613983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224613983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:14.940699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25657): Terminating (SIGTERM) 22:46:14.982165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25660): Terminating (SIGTERM) 22:46:15.023556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25663): Terminating (SIGTERM) 22:46:15.065264 --- ParallelTerminationStrategy: PID 25657 died... 22:46:15.084554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25657): Terminated: ok {rc=0} 22:46:15.130968 --- ParallelTerminationStrategy: PID 25660 died... 22:46:15.150443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25660): Terminated: ok {rc=0} 22:46:15.196162 --- ParallelTerminationStrategy: PID 25663 died... 22:46:15.215722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25663): Terminated: ok {rc=0} 22:46:15.303721 bus /sierra_3: Setting Powered False 22:46:16.411573 bus /sierra_3: Setting Powered False 22:46:17.537776 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:46:18.778762 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:46:18.786544 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:46:18.810906 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:46:18.838205 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:46:18.891547 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:46:18.916130 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:46:18.943063 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:46:19.498757 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:46:19.549747 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:19.561478 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:46:19.620850 tst mo_mt_call.py: using LAC 24187 22:46:19.746253 tst mo_mt_call.py: using RAC 217 22:46:19.869860 tst mo_mt_call.py: using CellId 24187 22:46:19.996032 tst mo_mt_call.py: using BVCI 24188 22:46:20.112389 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:20.124025 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:20.135397 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:20.146797 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:20.158872 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:20.170228 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:46:20.288031 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:46:20.406574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:20.900875 run create_hlr_db(pid=25670): Launched 22:46:21.031466 bus /sierra_2: Setting Powered False 22:46:22.095126 run create_hlr_db(pid=25670): Terminated: ok {rc=0} 22:46:22.523301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25672): Launched 22:46:22.823045 run osmo-hlr_10.42.42.2(pid=25673): Launched 22:46:22.937488 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:23.467831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25675): Launched 22:46:23.767230 run osmo-stp_10.42.42.5(pid=25676): Launched 22:46:23.882072 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:24.420525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25678): Launched 22:46:24.719574 run osmo-msc_10.42.42.6(pid=25679): Launched 22:46:24.887861 run osmo-stp_10.42.42.5(pid=25676): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25676)] 22:46:25.015157 run osmo-stp_10.42.42.5(pid=25676): stdout: | (launched: 2022-12-09_22:46:23.712580) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:25.142909 run osmo-stp_10.42.42.5(pid=25676): stderr: | 20221209224623881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224623881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224623881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224623882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224623882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224623882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224623882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:25.268135 run osmo-stp_10.42.42.5(pid=25676): stdout: | (launched: 2022-12-09_22:46:23.712580) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:25.387154 run osmo-stp_10.42.42.5(pid=25676): stderr: | 20221209224623881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224623881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224623881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224623882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224623882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224623882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224623882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:25.529816 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25676): Process ended prematurely: osmo-stp_10.42.42.5(pid=25676) [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25676)] [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:46:25.538984 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:46:25.565606 run osmo-hlr_10.42.42.2(pid=25673): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25673)] 22:46:25.613499 run osmo-hlr_10.42.42.2(pid=25673): stdout: | (launched: 2022-12-09_22:46:22.768784) 22:46:25.662779 run osmo-hlr_10.42.42.2(pid=25673): stderr: | 20221209224622945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224622945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224622945 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224622945 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224622945 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224622945 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224622958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224622967 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224622967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224622967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:25.731529 run osmo-msc_10.42.42.6(pid=25679): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25679)] 22:46:25.779708 run osmo-msc_10.42.42.6(pid=25679): stdout: | (launched: 2022-12-09_22:46:24.664813) 22:46:25.828942 run osmo-msc_10.42.42.6(pid=25679): stderr: | 20221209224624937 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224624938 DLGLOBAL DEBUG validating counter group 0x7f2502ba0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224624938 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224624938 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224624938 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224624938 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224624940 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224624941 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224624941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224624941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:25.878634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25672): Terminating (SIGTERM) 22:46:25.917714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25675): Terminating (SIGTERM) 22:46:25.957517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25678): Terminating (SIGTERM) 22:46:25.997305 --- ParallelTerminationStrategy: PID 25672 died... 22:46:26.016791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25672): Terminated: ok {rc=0} 22:46:26.061132 --- ParallelTerminationStrategy: PID 25675 died... 22:46:26.079631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25675): Terminated: ok {rc=0} 22:46:26.123879 --- ParallelTerminationStrategy: PID 25678 died... 22:46:26.142454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25678): Terminated: ok {rc=0} 22:46:26.228113 bus /sierra_3: Setting Powered False 22:46:27.326341 bus /sierra_3: Setting Powered False 22:46:28.443144 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:46:29.585770 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:29.597713 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:46:29.662059 tst mo_mt_call_osmux.py: using LAC 24188 22:46:29.778721 tst mo_mt_call_osmux.py: using RAC 218 22:46:29.894679 tst mo_mt_call_osmux.py: using CellId 24188 22:46:30.011110 tst mo_mt_call_osmux.py: using BVCI 24189 22:46:30.120889 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:30.131976 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:30.142848 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:30.154090 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:30.165067 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:30.176367 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:46:30.295258 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:46:30.416545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:30.934716 run create_hlr_db(pid=25681): Launched 22:46:31.091287 bus /sierra_2: Setting Powered False 22:46:32.151153 run create_hlr_db(pid=25681): Terminated: ok {rc=0} 22:46:32.591307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25683): Launched 22:46:32.909666 run osmo-hlr_10.42.42.2(pid=25684): Launched 22:46:33.030500 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:33.578398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25686): Launched 22:46:33.896708 run osmo-stp_10.42.42.5(pid=25687): Launched 22:46:34.017624 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:34.597920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25689): Launched 22:46:34.916547 run osmo-msc_10.42.42.6(pid=25690): Launched 22:46:35.094422 run osmo-stp_10.42.42.5(pid=25687): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25687)] 22:46:35.229315 run osmo-stp_10.42.42.5(pid=25687): stdout: | (launched: 2022-12-09_22:46:33.839121) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:35.364659 run osmo-stp_10.42.42.5(pid=25687): stderr: | 20221209224634030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224634031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224634031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224634031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224634034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224634034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224634034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:35.499103 run osmo-stp_10.42.42.5(pid=25687): stdout: | (launched: 2022-12-09_22:46:33.839121) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:35.625856 run osmo-stp_10.42.42.5(pid=25687): stderr: | 20221209224634030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224634031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224634031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224634031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224634034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224634034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224634034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:35.777591 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25687): Process ended prematurely: osmo-stp_10.42.42.5(pid=25687) [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25687)] [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:46:35.787111 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:46:35.814631 run osmo-hlr_10.42.42.2(pid=25684): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25684)] 22:46:35.864880 run osmo-hlr_10.42.42.2(pid=25684): stdout: | (launched: 2022-12-09_22:46:32.852134) 22:46:35.916428 run osmo-hlr_10.42.42.2(pid=25684): stderr: | 20221209224633050 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224633050 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224633050 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224633050 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224633050 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224633050 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224633064 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224633072 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224633072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224633072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:35.988160 run osmo-msc_10.42.42.6(pid=25690): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25690)] 22:46:36.037876 run osmo-msc_10.42.42.6(pid=25690): stdout: | (launched: 2022-12-09_22:46:34.859104) 22:46:36.089231 run osmo-msc_10.42.42.6(pid=25690): stderr: | 20221209224635181 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224635181 DLGLOBAL DEBUG validating counter group 0x7fcd57911c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224635181 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224635181 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224635181 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224635181 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224635183 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224635184 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224635184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224635184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:36.141419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25683): Terminating (SIGTERM) 22:46:36.183121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25686): Terminating (SIGTERM) 22:46:36.224687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25689): Terminating (SIGTERM) 22:46:36.266600 --- ParallelTerminationStrategy: PID 25683 died... 22:46:36.286559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25683): Terminated: ok {rc=0} 22:46:36.332454 --- ParallelTerminationStrategy: PID 25686 died... 22:46:36.351937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25686): Terminated: ok {rc=0} 22:46:36.397738 --- ParallelTerminationStrategy: PID 25689 died... 22:46:36.417206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25689): Terminated: ok {rc=0} 22:46:36.504057 bus /sierra_3: Setting Powered False 22:46:37.604552 bus /sierra_3: Setting Powered False 22:46:38.719640 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:46:39.960588 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:46:39.967737 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:46:39.991316 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:46:40.017445 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:46:40.069788 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:46:40.093965 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:46:40.121789 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:46:40.669434 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:46:40.717599 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:40.728638 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:46:40.786428 tst mo_mt_call.py: using LAC 24189 22:46:40.903823 tst mo_mt_call.py: using RAC 219 22:46:41.019338 tst mo_mt_call.py: using CellId 24189 22:46:41.134910 tst mo_mt_call.py: using BVCI 24190 22:46:41.242769 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:41.253851 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:41.264687 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:41.275915 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:41.287554 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:41.298569 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:46:41.413927 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:46:41.533987 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:42.027415 run create_hlr_db(pid=25695): Launched 22:46:42.157501 bus /sierra_2: Setting Powered False 22:46:43.221052 run create_hlr_db(pid=25695): Terminated: ok {rc=0} 22:46:43.646810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25697): Launched 22:46:43.946836 run osmo-hlr_10.42.42.2(pid=25698): Launched 22:46:44.061457 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:44.591437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25700): Launched 22:46:44.888652 run osmo-stp_10.42.42.5(pid=25701): Launched 22:46:45.002381 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:45.540439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25703): Launched 22:46:45.859008 run osmo-msc_10.42.42.6(pid=25704): Launched 22:46:46.109637 run osmo-stp_10.42.42.5(pid=25701): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25701)] 22:46:46.590401 run osmo-stp_10.42.42.5(pid=25701): stdout: | (launched: 2022-12-09_22:46:44.834728) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:46.768436 run osmo-stp_10.42.42.5(pid=25701): stderr: | 20221209224645004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224645004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224645004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224645005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224645005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224645005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224645005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:46.907490 run osmo-stp_10.42.42.5(pid=25701): stdout: | (launched: 2022-12-09_22:46:44.834728) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:47.036768 run osmo-stp_10.42.42.5(pid=25701): stderr: | 20221209224645004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224645004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224645004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224645005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224645005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224645005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224645005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:47.193269 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25701): Process ended prematurely: osmo-stp_10.42.42.5(pid=25701) [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25701)] [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:46:47.203309 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 22:46:47.232307 run osmo-hlr_10.42.42.2(pid=25698): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25698)] 22:46:47.284532 run osmo-hlr_10.42.42.2(pid=25698): stdout: | (launched: 2022-12-09_22:46:43.892330) 22:46:47.337572 run osmo-hlr_10.42.42.2(pid=25698): stderr: | 20221209224644065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224644065 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224644065 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224644065 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224644066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224644066 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224644078 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224644087 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224644087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224644087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:47.410786 run osmo-msc_10.42.42.6(pid=25704): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25704)] 22:46:47.460801 run osmo-msc_10.42.42.6(pid=25704): stdout: | (launched: 2022-12-09_22:46:45.783784) 22:46:47.512546 run osmo-msc_10.42.42.6(pid=25704): stderr: | 20221209224646303 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224646304 DLGLOBAL DEBUG validating counter group 0x7f6666bc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224646304 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224646304 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224646304 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224646305 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224646310 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224646311 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224646311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224646312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:47.564809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25697): Terminating (SIGTERM) 22:46:47.606501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25700): Terminating (SIGTERM) 22:46:47.648121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25703): Terminating (SIGTERM) 22:46:47.690687 --- ParallelTerminationStrategy: PID 25697 died... 22:46:47.710675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25697): Terminated: ok {rc=0} 22:46:47.757109 --- ParallelTerminationStrategy: PID 25700 died... 22:46:47.776613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25700): Terminated: ok {rc=0} 22:46:47.822735 --- ParallelTerminationStrategy: PID 25703 died... 22:46:47.842312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25703): Terminated: ok {rc=0} 22:46:47.930772 bus /sierra_3: Setting Powered False 22:46:49.026842 bus /sierra_3: Setting Powered False 22:46:50.140000 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:46:51.287445 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:51.299551 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:46:51.361234 tst mo_mt_call_osmux.py: using LAC 24190 22:46:51.488243 tst mo_mt_call_osmux.py: using RAC 220 22:46:51.615610 tst mo_mt_call_osmux.py: using CellId 24190 22:46:51.739866 tst mo_mt_call_osmux.py: using BVCI 24191 22:46:51.855579 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:51.867114 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:51.878490 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:51.889852 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:51.901268 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:51.912475 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:46:52.028101 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:46:52.145399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:52.609527 run create_hlr_db(pid=25706): Launched 22:46:52.741264 bus /sierra_2: Setting Powered False 22:46:53.801322 run create_hlr_db(pid=25706): Terminated: ok {rc=0} 22:46:54.245348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25708): Launched 22:46:54.563618 run osmo-hlr_10.42.42.2(pid=25709): Launched 22:46:54.685475 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:55.234276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25711): Launched 22:46:55.552658 run osmo-stp_10.42.42.5(pid=25712): Launched 22:46:55.674260 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:56.247737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25714): Launched 22:46:56.566882 run osmo-msc_10.42.42.6(pid=25715): Launched 22:46:56.744513 run osmo-stp_10.42.42.5(pid=25712): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25712)] 22:46:56.879051 run osmo-stp_10.42.42.5(pid=25712): stdout: | (launched: 2022-12-09_22:46:55.494879) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:57.013789 run osmo-stp_10.42.42.5(pid=25712): stderr: | 20221209224655688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224655689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224655689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224655689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224655690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224655690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224655690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:57.148273 run osmo-stp_10.42.42.5(pid=25712): stdout: | (launched: 2022-12-09_22:46:55.494879) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:57.275228 run osmo-stp_10.42.42.5(pid=25712): stderr: | 20221209224655688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224655689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224655689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224655689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224655690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224655690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224655690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:57.427257 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25712): Process ended prematurely: osmo-stp_10.42.42.5(pid=25712) [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25712)] [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:46:57.436785 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:46:57.464573 run osmo-hlr_10.42.42.2(pid=25709): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25709)] 22:46:57.514852 run osmo-hlr_10.42.42.2(pid=25709): stdout: | (launched: 2022-12-09_22:46:54.506341) 22:46:57.566608 run osmo-hlr_10.42.42.2(pid=25709): stderr: | 20221209224654704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224654704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224654704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224654704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224654704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224654704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224654716 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224654726 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224654726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224654726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:57.638695 run osmo-msc_10.42.42.6(pid=25715): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25715)] 22:46:57.688485 run osmo-msc_10.42.42.6(pid=25715): stdout: | (launched: 2022-12-09_22:46:56.508913) 22:46:57.739914 run osmo-msc_10.42.42.6(pid=25715): stderr: | 20221209224656834 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224656834 DLGLOBAL DEBUG validating counter group 0x7f46abe9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224656834 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224656834 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224656834 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224656834 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224656836 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224656836 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224656836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224656837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:57.791641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25708): Terminating (SIGTERM) 22:46:57.833106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25711): Terminating (SIGTERM) 22:46:57.874676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25714): Terminating (SIGTERM) 22:46:57.916605 --- ParallelTerminationStrategy: PID 25708 died... 22:46:57.936729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25708): Terminated: ok {rc=0} 22:46:57.983046 --- ParallelTerminationStrategy: PID 25711 died... 22:46:58.002698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25711): Terminated: ok {rc=0} 22:46:58.048667 --- ParallelTerminationStrategy: PID 25714 died... 22:46:58.068174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25714): Terminated: ok {rc=0} 22:46:58.155165 bus /sierra_3: Setting Powered False 22:46:59.252601 bus /sierra_3: Setting Powered False 22:47:00.364034 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:47:01.604507 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:47:01.617515 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:47:01.650869 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:47:01.687430 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:47:01.750954 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:47:01.779132 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:47:01.808914 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:47:02.356639 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:47:02.408529 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:02.420314 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:47:02.483974 tst mo_mt_call.py: using LAC 24191 22:47:02.631571 tst mo_mt_call.py: using RAC 221 22:47:02.757240 tst mo_mt_call.py: using CellId 24191 22:47:02.881416 tst mo_mt_call.py: using BVCI 24192 22:47:02.993106 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:03.004240 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:03.015352 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:03.027091 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:03.038651 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:03.050092 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:47:03.165112 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:47:03.283625 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:03.776210 run create_hlr_db(pid=25720): Launched 22:47:03.905739 bus /sierra_2: Setting Powered False 22:47:04.969710 run create_hlr_db(pid=25720): Terminated: ok {rc=0} 22:47:05.395524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25722): Launched 22:47:05.693821 run osmo-hlr_10.42.42.2(pid=25723): Launched 22:47:05.806961 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:06.349359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25725): Launched 22:47:06.668212 run osmo-stp_10.42.42.5(pid=25726): Launched 22:47:06.791281 run osmo-msc_10.42.42.6: Starting osmo-msc 22:47:07.368691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25728): Launched 22:47:07.689052 run osmo-msc_10.42.42.6(pid=25729): Launched 22:47:07.868105 run osmo-stp_10.42.42.5(pid=25726): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25726)] 22:47:08.001646 run osmo-stp_10.42.42.5(pid=25726): stdout: | (launched: 2022-12-09_22:47:06.610125) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:08.137949 run osmo-stp_10.42.42.5(pid=25726): stderr: | 20221209224706801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224706802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224706802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224706802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224706803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224706803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224706803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:08.272237 run osmo-stp_10.42.42.5(pid=25726): stdout: | (launched: 2022-12-09_22:47:06.610125) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:08.399384 run osmo-stp_10.42.42.5(pid=25726): stderr: | 20221209224706801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224706802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224706802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224706802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224706803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224706803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224706803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:08.551056 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25726): Process ended prematurely: osmo-stp_10.42.42.5(pid=25726) [trial-2365↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25726)] [trial-2365↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:47:08.560462 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:47:08.588151 run osmo-hlr_10.42.42.2(pid=25723): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25723)] 22:47:08.638083 run osmo-hlr_10.42.42.2(pid=25723): stdout: | (launched: 2022-12-09_22:47:05.639876) 22:47:08.689861 run osmo-hlr_10.42.42.2(pid=25723): stderr: | 20221209224705818 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224705818 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224705818 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224705818 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224705819 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224705819 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224705832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224705842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224705842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224705842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:08.761985 run osmo-msc_10.42.42.6(pid=25729): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25729)] 22:47:08.811784 run osmo-msc_10.42.42.6(pid=25729): stdout: | (launched: 2022-12-09_22:47:07.630922) 22:47:08.863155 run osmo-msc_10.42.42.6(pid=25729): stderr: | 20221209224707953 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224707953 DLGLOBAL DEBUG validating counter group 0x7f72c183ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224707953 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224707953 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224707954 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224707954 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224707955 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224707956 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224707956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224707956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:47:08.914839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25722): Terminating (SIGTERM) 22:47:08.956392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25725): Terminating (SIGTERM) 22:47:08.998136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25728): Terminating (SIGTERM) 22:47:09.040122 --- ParallelTerminationStrategy: PID 25722 died... 22:47:09.060251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25722): Terminated: ok {rc=0} 22:47:09.107364 --- ParallelTerminationStrategy: PID 25725 died... 22:47:09.126938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25725): Terminated: ok {rc=0} 22:47:09.173520 --- ParallelTerminationStrategy: PID 25728 died... 22:47:09.193405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25728): Terminated: ok {rc=0} 22:47:09.281556 bus /sierra_3: Setting Powered False 22:47:10.381409 bus /sierra_3: Setting Powered False 22:47:11.497812 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:47:12.648517 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:12.660661 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:47:12.721933 tst mo_mt_call_osmux.py: using LAC 24192 22:47:12.847375 tst mo_mt_call_osmux.py: using RAC 222 22:47:12.972143 tst mo_mt_call_osmux.py: using CellId 24192 22:47:13.101564 tst mo_mt_call_osmux.py: using BVCI 24193 22:47:13.219028 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:13.230598 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:13.242136 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:13.253510 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:13.265075 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:13.276268 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:47:13.395987 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:47:13.517614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:14.011175 run create_hlr_db(pid=25731): Launched 22:47:14.141551 bus /sierra_2: Setting Powered False 22:47:15.205102 run create_hlr_db(pid=25731): Terminated: ok {rc=0} 22:47:15.649132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25733): Launched 22:47:15.999534 run osmo-hlr_10.42.42.2(pid=25734): Launched 22:47:16.228517 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:16.861727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25736): Launched 22:47:17.193813 run osmo-stp_10.42.42.5(pid=25737): Launched 22:47:17.355576 run osmo-msc_10.42.42.6: Starting osmo-msc 22:47:17.897296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25739): Launched 22:47:18.197908 run osmo-msc_10.42.42.6(pid=25740): Launched 22:47:18.365916 run osmo-stp_10.42.42.5(pid=25737): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25737)] 22:47:18.492398 run osmo-stp_10.42.42.5(pid=25737): stdout: | (launched: 2022-12-09_22:47:17.131769) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:18.620013 run osmo-stp_10.42.42.5(pid=25737): stderr: | 20221209224717355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224717355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224717355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224717356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224717356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224717356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224717356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:18.745164 run osmo-stp_10.42.42.5(pid=25737): stdout: | (launched: 2022-12-09_22:47:17.131769) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:18.864099 run osmo-stp_10.42.42.5(pid=25737): stderr: | 20221209224717355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224717355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224717355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224717356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224717356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224717356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224717356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:19.006364 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25737): Process ended prematurely: osmo-stp_10.42.42.5(pid=25737) [trial-2365↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25737)] [trial-2365↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:47:19.015111 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:47:19.041942 run osmo-hlr_10.42.42.2(pid=25734): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25734)] 22:47:19.089926 run osmo-hlr_10.42.42.2(pid=25734): stdout: | (launched: 2022-12-09_22:47:15.934020) 22:47:19.139378 run osmo-hlr_10.42.42.2(pid=25734): stderr: | 20221209224716126 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224716126 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224716126 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224716126 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224716126 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224716126 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224716142 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224716155 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224716155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224716155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:19.208193 run osmo-msc_10.42.42.6(pid=25740): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25740)] 22:47:19.255669 run osmo-msc_10.42.42.6(pid=25740): stdout: | (launched: 2022-12-09_22:47:18.143088) 22:47:19.305107 run osmo-msc_10.42.42.6(pid=25740): stderr: | 20221209224718412 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224718412 DLGLOBAL DEBUG validating counter group 0x7f79614ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224718413 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224718413 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224718413 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224718413 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224718415 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224718415 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224718415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224718415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:47:19.355137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25733): Terminating (SIGTERM) 22:47:19.394615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25736): Terminating (SIGTERM) 22:47:19.434871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25739): Terminating (SIGTERM) 22:47:19.475035 --- ParallelTerminationStrategy: PID 25733 died... 22:47:19.494223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25733): Terminated: ok {rc=0} 22:47:19.538802 --- ParallelTerminationStrategy: PID 25736 died... 22:47:19.557426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25736): Terminated: ok {rc=0} 22:47:19.601728 --- ParallelTerminationStrategy: PID 25739 died... 22:47:19.620377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25739): Terminated: ok {rc=0} 22:47:19.706522 bus /sierra_3: Setting Powered False 22:47:20.804912 bus /sierra_3: Setting Powered False 22:47:21.920253 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 emergency:nanobts+band-1900 --------------------------------------------------------------------- 22:47:23.155139 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:47:23.160192 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 22:47:23.184661 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 22:47:23.213051 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 22:47:23.296403 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 22:47:23.319934 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 22:47:23.346607 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 22:47:23.930014 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2365 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 22:47:23.935205 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:23.945977 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:47:23.986161 tst emergency_mo_mt_call.py: using LAC 24193 22:47:24.103519 tst emergency_mo_mt_call.py: using RAC 223 22:47:24.229464 tst emergency_mo_mt_call.py: using CellId 24193 22:47:24.352009 tst emergency_mo_mt_call.py: using BVCI 24194 22:47:24.466532 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:24.477816 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:24.488753 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:24.499850 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:24.510820 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:24.521700 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:24.635976 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:24.753197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:25.239032 run create_hlr_db(pid=25745): Launched 22:47:25.365866 bus /sierra_2: Setting Powered False 22:47:26.428692 run create_hlr_db(pid=25745): Terminated: ok {rc=0} 22:47:26.848587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25747): Launched 22:47:27.142218 run osmo-hlr_10.42.42.2(pid=25748): Launched 22:47:27.256214 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:27.772641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25750): Launched 22:47:28.066439 run osmo-stp_10.42.42.5(pid=25751): Launched 22:47:28.189662 tst emergency_mo_mt_call.py: using MSISDN 7411 22:47:28.348738 run osmo-msc_10.42.42.6: Starting osmo-msc 22:47:28.875819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25753): Launched 22:47:29.170197 run osmo-msc_10.42.42.6(pid=25754): Launched 22:47:29.334732 run osmo-stp_10.42.42.5(pid=25751): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25751)] 22:47:29.459600 run osmo-stp_10.42.42.5(pid=25751): stdout: | (launched: 2022-12-09_22:47:28.013103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:29.584657 run osmo-stp_10.42.42.5(pid=25751): stderr: | 20221209224728180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224728180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224728181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224728181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224728183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224728184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224728184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:29.707246 run osmo-stp_10.42.42.5(pid=25751): stdout: | (launched: 2022-12-09_22:47:28.013103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:29.824231 run osmo-stp_10.42.42.5(pid=25751): stderr: | 20221209224728180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224728180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224728181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224728181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224728183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224728184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224728184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:29.964374 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25751): Process ended prematurely: osmo-stp_10.42.42.5(pid=25751) [trial-2365↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25751)] [trial-2365↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 22:47:29.972814 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 22:47:29.999134 run osmo-hlr_10.42.42.2(pid=25748): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25748)] 22:47:30.047164 run osmo-hlr_10.42.42.2(pid=25748): stdout: | (launched: 2022-12-09_22:47:27.088782) 22:47:30.096617 run osmo-hlr_10.42.42.2(pid=25748): stderr: | 20221209224727260 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224727260 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224727261 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224727261 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224727261 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224727261 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224727273 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224727281 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224727281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224727281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:30.165421 run osmo-msc_10.42.42.6(pid=25754): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25754)] 22:47:30.213439 run osmo-msc_10.42.42.6(pid=25754): stdout: | (launched: 2022-12-09_22:47:29.116417) 22:47:30.263130 run osmo-msc_10.42.42.6(pid=25754): stderr: | 20221209224729387 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224729387 DLGLOBAL DEBUG validating counter group 0x7fae261b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224729387 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224729387 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224729387 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224729388 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224729390 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224729390 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224729390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224729390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:47:30.312682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25747): Terminating (SIGTERM) 22:47:30.352521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25750): Terminating (SIGTERM) 22:47:30.392238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25753): Terminating (SIGTERM) 22:47:30.432178 --- ParallelTerminationStrategy: PID 25747 died... 22:47:30.451425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25747): Terminated: ok {rc=0} 22:47:30.495388 --- ParallelTerminationStrategy: PID 25750 died... 22:47:30.514088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25750): Terminated: ok {rc=0} 22:47:30.558680 --- ParallelTerminationStrategy: PID 25753 died... 22:47:30.577705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25753): Terminated: ok {rc=0} 22:47:30.661202 bus /sierra_3: Setting Powered False 22:47:31.758670 bus /sierra_3: Setting Powered False 22:47:32.874268 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 22:47:33.961094 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:33.972429 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:47:34.012716 tst emergency_preemptive_call.py: using LAC 24194 22:47:34.127082 tst emergency_preemptive_call.py: using RAC 224 22:47:34.241795 tst emergency_preemptive_call.py: using CellId 24194 22:47:34.357231 tst emergency_preemptive_call.py: using BVCI 24195 22:47:34.464562 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:34.475376 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:34.485982 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:34.497367 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:34.508706 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:34.519980 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:34.634247 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:34.752429 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:34.866248 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:34.984152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:35.472197 run create_hlr_db(pid=25757): Launched 22:47:35.601772 bus /sierra_2: Setting Powered False 22:47:36.664187 run create_hlr_db(pid=25757): Terminated: ok {rc=0} 22:47:37.084103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25760): Launched 22:47:37.378022 run osmo-hlr_10.42.42.2(pid=25761): Launched 22:47:37.489499 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:38.009082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25763): Launched 22:47:38.323836 run osmo-stp_10.42.42.5(pid=25764): Launched 22:47:38.452770 tst emergency_preemptive_call.py: using MSISDN 7412 22:47:38.612904 run osmo-msc_10.42.42.6: Starting osmo-msc 22:47:39.173867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25766): Launched 22:47:39.487976 run osmo-msc_10.42.42.6(pid=25767): Launched 22:47:39.662612 run osmo-stp_10.42.42.5(pid=25764): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25764)] 22:47:39.795226 run osmo-stp_10.42.42.5(pid=25764): stdout: | (launched: 2022-12-09_22:47:38.266751) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:39.927919 run osmo-stp_10.42.42.5(pid=25764): stderr: | 20221209224738456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224738457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224738457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224738457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224738460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224738460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224738460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:40.061838 run osmo-stp_10.42.42.5(pid=25764): stdout: | (launched: 2022-12-09_22:47:38.266751) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:40.187039 run osmo-stp_10.42.42.5(pid=25764): stderr: | 20221209224738456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224738457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224738457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224738457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224738460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224738460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224738460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:40.336909 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25764): Process ended prematurely: osmo-stp_10.42.42.5(pid=25764) [trial-2365↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25764)] [trial-2365↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 22:47:40.345952 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 22:47:40.373565 run osmo-hlr_10.42.42.2(pid=25761): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25761)] 22:47:40.423633 run osmo-hlr_10.42.42.2(pid=25761): stdout: | (launched: 2022-12-09_22:47:37.324456) 22:47:40.475437 run osmo-hlr_10.42.42.2(pid=25761): stderr: | 20221209224737499 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224737499 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224737499 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224737499 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224737499 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224737499 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224737511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224737520 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224737520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224737520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:40.547743 run osmo-msc_10.42.42.6(pid=25767): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25767)] 22:47:40.597733 run osmo-msc_10.42.42.6(pid=25767): stdout: | (launched: 2022-12-09_22:47:39.430947) 22:47:40.649224 run osmo-msc_10.42.42.6(pid=25767): stderr: | 20221209224739753 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209224739753 DLGLOBAL DEBUG validating counter group 0x7fd69d72cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209224739753 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209224739753 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209224739754 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209224739754 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209224739756 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209224739756 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209224739756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209224739756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:47:40.700931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25760): Terminating (SIGTERM) 22:47:40.742591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25763): Terminating (SIGTERM) 22:47:40.784453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25766): Terminating (SIGTERM) 22:47:40.826432 --- ParallelTerminationStrategy: PID 25760 died... 22:47:40.846523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25760): Terminated: ok {rc=0} 22:47:40.892561 --- ParallelTerminationStrategy: PID 25763 died... 22:47:40.912112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25763): Terminated: ok {rc=0} 22:47:40.957834 --- ParallelTerminationStrategy: PID 25766 died... 22:47:40.977307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25766): Terminated: ok {rc=0} 22:47:41.065151 bus /sierra_9: Setting Powered False 22:47:42.162544 bus /sierra_9: Setting Powered False 22:47:43.278694 bus /sierra_8: Setting Powered False 22:47:44.376620 bus /sierra_8: Setting Powered False 22:47:45.490972 bus /sierra_3: Setting Powered False 22:47:46.586753 bus /sierra_3: Setting Powered False 22:47:47.700576 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:nanobts+band-1900 --------------------------------------------------------------------- 22:47:48.972291 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:47:48.978335 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 22:47:49.002695 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 22:47:49.041562 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 22:47:49.130376 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 22:47:49.155137 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 22:47:49.193830 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 22:47:49.785530 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 22:47:49.837432 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:49.848347 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:47:49.886958 tst cs_paging_gprs_active.py: using LAC 24195 22:47:50.017083 tst cs_paging_gprs_active.py: using RAC 225 22:47:50.136335 tst cs_paging_gprs_active.py: using CellId 24195 22:47:50.255223 tst cs_paging_gprs_active.py: using BVCI 24196 22:47:50.365806 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:50.376550 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:50.387221 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:50.398713 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:50.410460 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:50.421803 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:50.433485 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:50.444607 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:50.456175 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:50.577999 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:50.695073 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:47:50.898033 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:47:51.199667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25772): Launched 22:47:51.462400 run iperf3-srv_10.42.42.10(pid=25773): Launched 22:47:51.576286 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:47:51.777737 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:47:52.079449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25774): Launched 22:47:52.340743 run iperf3-srv_10.42.42.10(pid=25775): Launched 22:47:52.454432 tst cs_paging_gprs_active.py:38: start network... 22:47:52.655226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:53.118112 run create_hlr_db(pid=25776): Launched 22:47:53.241128 bus /sierra_2: Setting Powered False 22:47:54.301400 run create_hlr_db(pid=25776): Terminated: ok {rc=0} 22:47:54.718590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25778): Launched 22:47:55.018196 run osmo-hlr_10.42.42.2(pid=25779): Launched 22:47:55.132290 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:55.650352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25781): Launched 22:47:55.950984 run osmo-stp_10.42.42.5(pid=25782): Launched 22:47:56.065387 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:47:56.583752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25784): Launched 22:47:56.700452 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:47:56.953414 run patchelf(pid=25785): Launched 22:47:57.122900 run osmo-stp_10.42.42.5(pid=25782): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25782)] 22:47:57.251580 run osmo-stp_10.42.42.5(pid=25782): stdout: | (launched: 2022-12-09_22:47:55.896493) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:57.381751 run osmo-stp_10.42.42.5(pid=25782): stderr: | 20221209224756065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224756065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224756065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224756065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224756066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224756066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224756066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:57.511918 run osmo-stp_10.42.42.5(pid=25782): stdout: | (launched: 2022-12-09_22:47:55.896493) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:57.636530 run osmo-stp_10.42.42.5(pid=25782): stderr: | 20221209224756065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224756065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224756065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224756065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224756066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224756066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224756066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:57.783915 run patchelf(pid=25785): Terminating (SIGINT) 22:47:57.956196 run patchelf(pid=25785): Terminated: ok {rc=0} 22:47:58.080750 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25782): Process ended prematurely: osmo-stp_10.42.42.5(pid=25782) [trial-2365↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25782)] [trial-2365↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 22:47:58.090352 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 22:47:58.117604 run osmo-hlr_10.42.42.2(pid=25779): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25779)] 22:47:58.165251 run osmo-hlr_10.42.42.2(pid=25779): stdout: | (launched: 2022-12-09_22:47:54.963650) 22:47:58.214330 run osmo-hlr_10.42.42.2(pid=25779): stderr: | 20221209224755137 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224755137 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224755137 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224755137 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224755137 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224755137 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224755150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224755159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224755159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224755159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:58.263778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25772): Terminating (SIGTERM) 22:47:58.302987 run iperf3-srv_10.42.42.10(pid=25773): Terminating (SIGTERM) 22:47:58.342347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25774): Terminating (SIGTERM) 22:47:58.382156 run iperf3-srv_10.42.42.10(pid=25775): Terminating (SIGTERM) 22:47:58.421684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25778): Terminating (SIGTERM) 22:47:58.461149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25781): Terminating (SIGTERM) 22:47:58.500471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25784): Terminating (SIGTERM) 22:47:58.540428 --- ParallelTerminationStrategy: PID 25772 died... 22:47:58.559559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25772): Terminated: ok {rc=0} 22:47:58.603581 --- ParallelTerminationStrategy: PID 25773 died... 22:47:58.621916 run iperf3-srv_10.42.42.10(pid=25773): Terminated {rc=256} 22:47:58.665746 --- ParallelTerminationStrategy: PID 25774 died... 22:47:58.684219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25774): Terminated: ok {rc=0} 22:47:58.728114 --- ParallelTerminationStrategy: PID 25775 died... 22:47:58.746476 run iperf3-srv_10.42.42.10(pid=25775): Terminated {rc=256} 22:47:58.790611 --- ParallelTerminationStrategy: PID 25778 died... 22:47:58.808912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25778): Terminated: ok {rc=0} 22:47:58.853289 --- ParallelTerminationStrategy: PID 25781 died... 22:47:58.871662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25781): Terminated: ok {rc=0} 22:47:58.915681 --- ParallelTerminationStrategy: PID 25784 died... 22:47:58.934242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25784): Terminated: ok {rc=0} 22:47:59.019830 bus /gobi_0: Setting Powered False 22:48:00.117986 bus /gobi_0: Setting Powered False 22:48:01.228488 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 22:48:02.378828 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:02.390386 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:48:02.434144 tst iperf3.py: using LAC 24196 22:48:02.559494 tst iperf3.py: using RAC 226 22:48:02.682416 tst iperf3.py: using CellId 24196 22:48:02.804689 tst iperf3.py: using BVCI 24197 22:48:02.920390 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:02.931616 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:02.942777 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:02.953829 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:02.964689 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:02.975642 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:02.986938 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:02.997933 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:03.009035 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:03.129494 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:48:03.330093 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:03.630442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25786): Launched 22:48:03.890872 run iperf3-srv_10.42.42.10(pid=25787): Launched 22:48:04.003690 tst iperf3.py:8: start network... 22:48:04.204722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:04.668618 run create_hlr_db(pid=25788): Launched 22:48:04.793168 bus /gobi_6: Setting Powered False 22:48:05.853660 run create_hlr_db(pid=25788): Terminated: ok {rc=0} 22:48:06.292362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25790): Launched 22:48:06.612477 run osmo-hlr_10.42.42.2(pid=25791): Launched 22:48:06.734991 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:07.290629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25793): Launched 22:48:07.608805 run osmo-stp_10.42.42.5(pid=25794): Launched 22:48:07.730966 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:08.284809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25796): Launched 22:48:08.407341 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:08.678525 run patchelf(pid=25797): Launched 22:48:08.857226 run osmo-stp_10.42.42.5(pid=25794): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25794)] 22:48:08.993237 run osmo-stp_10.42.42.5(pid=25794): stdout: | (launched: 2022-12-09_22:48:07.550963) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:09.130297 run osmo-stp_10.42.42.5(pid=25794): stderr: | 20221209224807742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224807742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224807742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224807743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224807743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224807743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224807743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:09.268268 run osmo-stp_10.42.42.5(pid=25794): stdout: | (launched: 2022-12-09_22:48:07.550963) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:09.399261 run osmo-stp_10.42.42.5(pid=25794): stderr: | 20221209224807742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224807742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224807742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224807743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224807743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224807743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224807743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:09.554451 run patchelf(pid=25797): Terminating (SIGINT) 22:48:09.735405 run patchelf(pid=25797): Terminated: ok {rc=0} 22:48:09.865590 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25794): Process ended prematurely: osmo-stp_10.42.42.5(pid=25794) [trial-2365↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25794)] [trial-2365↪gprs:nanobts+band-1900↪iperf3.py:8] 22:48:09.875643 tst iperf3.py:8: Test FAILED (7.5 sec) 22:48:09.903913 run osmo-hlr_10.42.42.2(pid=25791): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25791)] 22:48:09.953740 run osmo-hlr_10.42.42.2(pid=25791): stdout: | (launched: 2022-12-09_22:48:06.554594) 22:48:10.005269 run osmo-hlr_10.42.42.2(pid=25791): stderr: | 20221209224806753 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224806753 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224806753 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224806753 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224806753 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224806753 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224806765 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224806773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224806773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224806773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:10.057113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25786): Terminating (SIGTERM) 22:48:10.098900 run iperf3-srv_10.42.42.10(pid=25787): Terminating (SIGTERM) 22:48:10.140564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25790): Terminating (SIGTERM) 22:48:10.182810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25793): Terminating (SIGTERM) 22:48:10.224666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25796): Terminating (SIGTERM) 22:48:10.267309 --- ParallelTerminationStrategy: PID 25786 died... 22:48:10.287251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25786): Terminated: ok {rc=0} 22:48:10.333533 --- ParallelTerminationStrategy: PID 25787 died... 22:48:10.352707 run iperf3-srv_10.42.42.10(pid=25787): Terminated {rc=256} 22:48:10.398831 --- ParallelTerminationStrategy: PID 25790 died... 22:48:10.418424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25790): Terminated: ok {rc=0} 22:48:10.464529 --- ParallelTerminationStrategy: PID 25793 died... 22:48:10.484142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25793): Terminated: ok {rc=0} 22:48:10.530335 --- ParallelTerminationStrategy: PID 25796 died... 22:48:10.549825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25796): Terminated: ok {rc=0} 22:48:10.637284 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 22:48:11.787821 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:11.799473 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:48:11.837513 tst iperf3m4.py: using LAC 24197 22:48:11.963008 tst iperf3m4.py: using RAC 227 22:48:12.093388 tst iperf3m4.py: using CellId 24197 22:48:12.218324 tst iperf3m4.py: using BVCI 24198 22:48:12.333783 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:12.344727 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:12.355683 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:12.366525 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:12.377363 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:12.388089 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:12.399000 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:12.409699 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:12.420590 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:12.537135 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:12.658501 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:12.774375 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:12.894209 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:48:13.112088 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:13.434917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25798): Launched 22:48:13.713059 run iperf3-srv_10.42.42.10(pid=25799): Launched 22:48:13.833437 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:48:14.048139 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:14.369637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25800): Launched 22:48:14.648021 run iperf3-srv_10.42.42.10(pid=25801): Launched 22:48:14.768242 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:48:14.983329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:15.304192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25802): Launched 22:48:15.581524 run iperf3-srv_10.42.42.10(pid=25803): Launched 22:48:15.702253 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:48:15.940664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:16.270265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25804): Launched 22:48:16.568423 run iperf3-srv_10.42.42.10(pid=25805): Launched 22:48:16.696760 tst iperf3m4.py:8: start network... 22:48:16.916379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:17.414003 run create_hlr_db(pid=25806): Launched 22:48:17.535959 bus /gobi_6: Setting Powered False 22:48:18.599518 run create_hlr_db(pid=25806): Terminated: ok {rc=0} 22:48:19.044234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25808): Launched 22:48:19.365552 run osmo-hlr_10.42.42.2(pid=25809): Launched 22:48:19.489181 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:20.042047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25811): Launched 22:48:20.361703 run osmo-stp_10.42.42.5(pid=25812): Launched 22:48:20.484508 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:21.039734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25814): Launched 22:48:21.162648 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:21.432561 run patchelf(pid=25815): Launched 22:48:21.612425 run osmo-stp_10.42.42.5(pid=25812): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25812)] 22:48:21.748638 run osmo-stp_10.42.42.5(pid=25812): stdout: | (launched: 2022-12-09_22:48:20.303831) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:21.885978 run osmo-stp_10.42.42.5(pid=25812): stderr: | 20221209224820494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224820494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224820494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224820495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224820495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224820495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224820495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:22.023339 run osmo-stp_10.42.42.5(pid=25812): stdout: | (launched: 2022-12-09_22:48:20.303831) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:22.154461 run osmo-stp_10.42.42.5(pid=25812): stderr: | 20221209224820494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224820494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224820494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224820495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224820495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224820495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224820495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:22.309947 run patchelf(pid=25815): Terminating (SIGINT) 22:48:22.491438 run patchelf(pid=25815): Terminated: ok {rc=0} 22:48:22.621517 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25812): Process ended prematurely: osmo-stp_10.42.42.5(pid=25812) [trial-2365↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25812)] [trial-2365↪gprs:nanobts+band-1900↪iperf3m4.py:8] 22:48:22.631521 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:48:22.660124 run osmo-hlr_10.42.42.2(pid=25809): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25809)] 22:48:22.710215 run osmo-hlr_10.42.42.2(pid=25809): stdout: | (launched: 2022-12-09_22:48:19.307605) 22:48:22.761466 run osmo-hlr_10.42.42.2(pid=25809): stderr: | 20221209224819504 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224819504 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224819504 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224819504 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224819504 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224819504 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224819517 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224819526 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224819526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224819526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:22.813212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25798): Terminating (SIGTERM) 22:48:22.854642 run iperf3-srv_10.42.42.10(pid=25799): Terminating (SIGTERM) 22:48:22.896187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25800): Terminating (SIGTERM) 22:48:22.937819 run iperf3-srv_10.42.42.10(pid=25801): Terminating (SIGTERM) 22:48:22.979401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25802): Terminating (SIGTERM) 22:48:23.021192 run iperf3-srv_10.42.42.10(pid=25803): Terminating (SIGTERM) 22:48:23.062672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25804): Terminating (SIGTERM) 22:48:23.104371 run iperf3-srv_10.42.42.10(pid=25805): Terminating (SIGTERM) 22:48:23.145865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25808): Terminating (SIGTERM) 22:48:23.187812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25811): Terminating (SIGTERM) 22:48:23.229565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25814): Terminating (SIGTERM) 22:48:23.271392 --- ParallelTerminationStrategy: PID 25798 died... 22:48:23.291582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25798): Terminated: ok {rc=0} 22:48:23.337979 --- ParallelTerminationStrategy: PID 25799 died... 22:48:23.357706 run iperf3-srv_10.42.42.10(pid=25799): Terminated {rc=256} 22:48:23.404257 --- ParallelTerminationStrategy: PID 25800 died... 22:48:23.423953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25800): Terminated: ok {rc=0} 22:48:23.470546 --- ParallelTerminationStrategy: PID 25801 died... 22:48:23.490261 run iperf3-srv_10.42.42.10(pid=25801): Terminated {rc=256} 22:48:23.536183 --- ParallelTerminationStrategy: PID 25802 died... 22:48:23.555972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25802): Terminated: ok {rc=0} 22:48:23.602002 --- ParallelTerminationStrategy: PID 25803 died... 22:48:23.621686 run iperf3-srv_10.42.42.10(pid=25803): Terminated {rc=256} 22:48:23.667410 --- ParallelTerminationStrategy: PID 25804 died... 22:48:23.687039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25804): Terminated: ok {rc=0} 22:48:23.733092 --- ParallelTerminationStrategy: PID 25805 died... 22:48:23.752708 run iperf3-srv_10.42.42.10(pid=25805): Terminated {rc=256} 22:48:23.798531 --- ParallelTerminationStrategy: PID 25808 died... 22:48:23.818236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25808): Terminated: ok {rc=0} 22:48:23.864304 --- ParallelTerminationStrategy: PID 25811 died... 22:48:23.883939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25811): Terminated: ok {rc=0} 22:48:23.929917 --- ParallelTerminationStrategy: PID 25814 died... 22:48:23.949562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25814): Terminated: ok {rc=0} 22:48:24.036869 bus /gobi_4: Setting Powered False 22:48:25.135895 bus /gobi_4: Setting Powered False 22:48:26.251066 bus /gobi_1: Setting Powered False 22:48:27.348997 bus /gobi_1: Setting Powered False 22:48:28.464329 bus /gobi_0: Setting Powered False 22:48:29.562423 bus /gobi_0: Setting Powered False 22:48:30.678190 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 22:48:31.800581 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:31.818519 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:48:31.871979 tst ping.py: using LAC 24198 22:48:31.994872 tst ping.py: using RAC 228 22:48:32.117529 tst ping.py: using CellId 24198 22:48:32.250366 tst ping.py: using BVCI 24199 22:48:32.358739 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:32.369561 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:32.380149 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:32.391289 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:32.401824 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:32.413758 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:32.424809 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:32.435823 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:32.550963 tst ping.py:19: start network... 22:48:32.748912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:33.200853 run create_hlr_db(pid=25816): Launched 22:48:33.314243 bus /gobi_6: Setting Powered False 22:48:34.373146 run create_hlr_db(pid=25816): Terminated: ok {rc=0} 22:48:34.802965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25818): Launched 22:48:35.115932 run osmo-hlr_10.42.42.2(pid=25819): Launched 22:48:35.236086 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:35.783579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25821): Launched 22:48:36.098442 run osmo-stp_10.42.42.5(pid=25822): Launched 22:48:36.218382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:36.760266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25824): Launched 22:48:36.881828 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:37.148765 run patchelf(pid=25825): Launched 22:48:37.324513 run osmo-stp_10.42.42.5(pid=25822): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25822)] 22:48:37.458093 run osmo-stp_10.42.42.5(pid=25822): stdout: | (launched: 2022-12-09_22:48:36.041018) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:37.593569 run osmo-stp_10.42.42.5(pid=25822): stderr: | 20221209224836233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224836233 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224836233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224836234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224836234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224836234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224836234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:37.728471 run osmo-stp_10.42.42.5(pid=25822): stdout: | (launched: 2022-12-09_22:48:36.041018) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:37.857528 run osmo-stp_10.42.42.5(pid=25822): stderr: | 20221209224836233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224836233 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224836233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224836234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224836234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224836234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224836234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:38.009823 run patchelf(pid=25825): Terminating (SIGINT) 22:48:38.188193 run patchelf(pid=25825): Terminated: ok {rc=0} 22:48:38.316271 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25822): Process ended prematurely: osmo-stp_10.42.42.5(pid=25822) [trial-2365↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25822)] [trial-2365↪gprs:nanobts+band-1900↪ping.py:22] 22:48:38.325801 tst ping.py:22: Test FAILED (6.5 sec) 22:48:38.353636 run osmo-hlr_10.42.42.2(pid=25819): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25819)] 22:48:38.403344 run osmo-hlr_10.42.42.2(pid=25819): stdout: | (launched: 2022-12-09_22:48:35.059027) 22:48:38.454568 run osmo-hlr_10.42.42.2(pid=25819): stderr: | 20221209224835254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224835255 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224835255 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224835255 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224835255 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224835255 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224835268 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224835277 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224835278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224835278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:38.506145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25818): Terminating (SIGTERM) 22:48:38.547768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25821): Terminating (SIGTERM) 22:48:38.589565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25824): Terminating (SIGTERM) 22:48:38.631453 --- ParallelTerminationStrategy: PID 25818 died... 22:48:38.651361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25818): Terminated: ok {rc=0} 22:48:38.697528 --- ParallelTerminationStrategy: PID 25821 died... 22:48:38.716814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25821): Terminated: ok {rc=0} 22:48:38.762943 --- ParallelTerminationStrategy: PID 25824 died... 22:48:38.782560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25824): Terminated: ok {rc=0} 22:48:38.870046 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 22:48:39.957585 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:39.969517 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:48:40.010535 tst ping_idle_ping.py: using LAC 24199 22:48:40.131563 tst ping_idle_ping.py: using RAC 229 22:48:40.246843 tst ping_idle_ping.py: using CellId 24199 22:48:40.361847 tst ping_idle_ping.py: using BVCI 24200 22:48:40.470889 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:40.481715 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:40.492176 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:40.503173 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:40.513950 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:40.524682 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:40.535641 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:40.546580 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:40.661922 tst ping_idle_ping.py:24: start network... 22:48:40.861403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:41.321523 run create_hlr_db(pid=25826): Launched 22:48:41.435913 bus /gobi_6: Setting Powered False 22:48:42.495014 run create_hlr_db(pid=25826): Terminated: ok {rc=0} 22:48:42.929631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25828): Launched 22:48:43.247554 run osmo-hlr_10.42.42.2(pid=25829): Launched 22:48:43.368023 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:43.908342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25831): Launched 22:48:44.223409 run osmo-stp_10.42.42.5(pid=25832): Launched 22:48:44.344582 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:44.888868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25834): Launched 22:48:45.009231 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:45.275584 run patchelf(pid=25835): Launched 22:48:45.451214 run osmo-stp_10.42.42.5(pid=25832): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25832)] 22:48:45.585176 run osmo-stp_10.42.42.5(pid=25832): stdout: | (launched: 2022-12-09_22:48:44.165941) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:45.720403 run osmo-stp_10.42.42.5(pid=25832): stderr: | 20221209224844357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224844358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224844358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224844358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224844359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224844359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224844359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:45.860017 run osmo-stp_10.42.42.5(pid=25832): stdout: | (launched: 2022-12-09_22:48:44.165941) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:46.011255 run osmo-stp_10.42.42.5(pid=25832): stderr: | 20221209224844357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224844358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224844358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224844358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224844359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224844359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224844359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:46.170112 run patchelf(pid=25835): Terminating (SIGINT) 22:48:46.348563 run patchelf(pid=25835): Terminated: ok {rc=0} 22:48:46.477241 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25832): Process ended prematurely: osmo-stp_10.42.42.5(pid=25832) [trial-2365↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25832)] [trial-2365↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 22:48:46.487099 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:48:46.516354 run osmo-hlr_10.42.42.2(pid=25829): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25829)] 22:48:46.569563 run osmo-hlr_10.42.42.2(pid=25829): stdout: | (launched: 2022-12-09_22:48:43.189979) 22:48:46.621701 run osmo-hlr_10.42.42.2(pid=25829): stderr: | 20221209224843386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224843386 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224843386 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224843386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224843387 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224843387 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224843399 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224843407 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224843408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224843408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:46.675617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25828): Terminating (SIGTERM) 22:48:46.718548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25831): Terminating (SIGTERM) 22:48:46.764525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25834): Terminating (SIGTERM) 22:48:46.809453 --- ParallelTerminationStrategy: PID 25828 died... 22:48:46.829638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25828): Terminated: ok {rc=0} 22:48:46.879810 --- ParallelTerminationStrategy: PID 25831 died... 22:48:46.899618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25831): Terminated: ok {rc=0} 22:48:46.949072 --- ParallelTerminationStrategy: PID 25834 died... 22:48:46.969165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25834): Terminated: ok {rc=0} 22:48:47.061919 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 22:48:48.362186 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:48:48.368553 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:48:48.394194 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:48:48.433199 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:48:48.519294 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:48:48.542426 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:48:48.581506 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:48:49.174820 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:48:49.223855 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:49.234679 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:48:49.276094 tst cs_paging_gprs_active.py: using LAC 24200 22:48:49.395243 tst cs_paging_gprs_active.py: using RAC 230 22:48:49.514169 tst cs_paging_gprs_active.py: using CellId 24200 22:48:49.634182 tst cs_paging_gprs_active.py: using BVCI 24201 22:48:49.743009 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:49.753925 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:49.764505 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:49.775080 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:49.786970 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:49.798487 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:49.810139 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:49.821481 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:49.832831 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:48:49.951604 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:48:50.072748 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:48:50.289475 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:50.609911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25839): Launched 22:48:50.887920 run iperf3-srv_10.42.42.10(pid=25840): Launched 22:48:51.008694 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:48:51.223875 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:51.544466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25841): Launched 22:48:51.823371 run iperf3-srv_10.42.42.10(pid=25842): Launched 22:48:51.943618 tst cs_paging_gprs_active.py:38: start network... 22:48:52.159304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:52.654377 run create_hlr_db(pid=25843): Launched 22:48:52.785108 bus /gobi_6: Setting Powered False 22:48:53.848214 run create_hlr_db(pid=25843): Terminated: ok {rc=0} 22:48:54.276366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25845): Launched 22:48:54.576765 run osmo-hlr_10.42.42.2(pid=25846): Launched 22:48:54.692880 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:55.223380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25848): Launched 22:48:55.522947 run osmo-stp_10.42.42.5(pid=25849): Launched 22:48:55.637081 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:56.153678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25851): Launched 22:48:56.270273 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:56.526177 run patchelf(pid=25852): Launched 22:48:56.694462 run osmo-stp_10.42.42.5(pid=25849): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25849)] 22:48:56.822013 run osmo-stp_10.42.42.5(pid=25849): stdout: | (launched: 2022-12-09_22:48:55.468588) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:56.951094 run osmo-stp_10.42.42.5(pid=25849): stderr: | 20221209224855637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224855637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224855637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224855638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224855640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224855640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224855640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:57.080272 run osmo-stp_10.42.42.5(pid=25849): stdout: | (launched: 2022-12-09_22:48:55.468588) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:57.203708 run osmo-stp_10.42.42.5(pid=25849): stderr: | 20221209224855637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224855637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224855637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224855638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224855640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224855640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224855640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:57.349513 run patchelf(pid=25852): Terminating (SIGINT) 22:48:57.519330 run patchelf(pid=25852): Terminated: ok {rc=0} 22:48:57.641754 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25849): Process ended prematurely: osmo-stp_10.42.42.5(pid=25849) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25849)] [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:48:57.651138 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 22:48:57.678723 run osmo-hlr_10.42.42.2(pid=25846): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25846)] 22:48:57.726155 run osmo-hlr_10.42.42.2(pid=25846): stdout: | (launched: 2022-12-09_22:48:54.522452) 22:48:57.774781 run osmo-hlr_10.42.42.2(pid=25846): stderr: | 20221209224854696 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224854696 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224854696 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224854696 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224854696 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224854696 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224854709 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224854717 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224854717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224854717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:57.824771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25839): Terminating (SIGTERM) 22:48:57.864384 run iperf3-srv_10.42.42.10(pid=25840): Terminating (SIGTERM) 22:48:57.903359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25841): Terminating (SIGTERM) 22:48:57.943034 run iperf3-srv_10.42.42.10(pid=25842): Terminating (SIGTERM) 22:48:57.982066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25845): Terminating (SIGTERM) 22:48:58.021834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25848): Terminating (SIGTERM) 22:48:58.060834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25851): Terminating (SIGTERM) 22:48:58.101056 --- ParallelTerminationStrategy: PID 25839 died... 22:48:58.119973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25839): Terminated: ok {rc=0} 22:48:58.164231 --- ParallelTerminationStrategy: PID 25840 died... 22:48:58.182613 run iperf3-srv_10.42.42.10(pid=25840): Terminated {rc=256} 22:48:58.227596 --- ParallelTerminationStrategy: PID 25841 died... 22:48:58.246004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25841): Terminated: ok {rc=0} 22:48:58.289715 --- ParallelTerminationStrategy: PID 25842 died... 22:48:58.308047 run iperf3-srv_10.42.42.10(pid=25842): Terminated {rc=256} 22:48:58.352380 --- ParallelTerminationStrategy: PID 25845 died... 22:48:58.370835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25845): Terminated: ok {rc=0} 22:48:58.414746 --- ParallelTerminationStrategy: PID 25848 died... 22:48:58.433170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25848): Terminated: ok {rc=0} 22:48:58.477636 --- ParallelTerminationStrategy: PID 25851 died... 22:48:58.496128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25851): Terminated: ok {rc=0} 22:48:58.579174 bus /gobi_0: Setting Powered False 22:48:59.674763 bus /gobi_0: Setting Powered False 22:49:00.786878 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:49:01.937422 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:01.949774 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:49:01.998746 tst iperf3.py: using LAC 24201 22:49:02.126477 tst iperf3.py: using RAC 231 22:49:02.258031 tst iperf3.py: using CellId 24201 22:49:02.376640 tst iperf3.py: using BVCI 24202 22:49:02.485391 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:02.496144 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:02.506885 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:02.518191 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:02.529783 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:02.540895 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:02.552376 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:02.563710 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:02.574476 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:02.691909 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:49:02.893881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:03.195611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25855): Launched 22:49:03.456942 run iperf3-srv_10.42.42.10(pid=25856): Launched 22:49:03.570282 tst iperf3.py:8: start network... 22:49:03.771173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:04.234723 run create_hlr_db(pid=25857): Launched 22:49:04.349209 bus /gobi_6: Setting Powered False 22:49:05.409128 run create_hlr_db(pid=25857): Terminated: ok {rc=0} 22:49:05.846159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25859): Launched 22:49:06.166792 run osmo-hlr_10.42.42.2(pid=25860): Launched 22:49:06.289657 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:06.840313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25862): Launched 22:49:07.160576 run osmo-stp_10.42.42.5(pid=25863): Launched 22:49:07.283082 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:07.833539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25865): Launched 22:49:07.957245 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:08.229651 run patchelf(pid=25866): Launched 22:49:08.409739 run osmo-stp_10.42.42.5(pid=25863): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25863)] 22:49:08.547537 run osmo-stp_10.42.42.5(pid=25863): stdout: | (launched: 2022-12-09_22:49:07.102470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:08.686169 run osmo-stp_10.42.42.5(pid=25863): stderr: | 20221209224907294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224907294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224907294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224907294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224907295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224907295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224907295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:08.824911 run osmo-stp_10.42.42.5(pid=25863): stdout: | (launched: 2022-12-09_22:49:07.102470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:08.956835 run osmo-stp_10.42.42.5(pid=25863): stderr: | 20221209224907294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224907294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224907294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224907294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224907295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224907295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224907295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:09.114171 run patchelf(pid=25866): Terminating (SIGINT) 22:49:09.297473 run patchelf(pid=25866): Terminated: ok {rc=0} 22:49:09.429186 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25863): Process ended prematurely: osmo-stp_10.42.42.5(pid=25863) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25863)] [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 22:49:09.439262 tst iperf3.py:8: Test FAILED (7.5 sec) 22:49:09.467898 run osmo-hlr_10.42.42.2(pid=25860): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25860)] 22:49:09.517621 run osmo-hlr_10.42.42.2(pid=25860): stdout: | (launched: 2022-12-09_22:49:06.109039) 22:49:09.569050 run osmo-hlr_10.42.42.2(pid=25860): stderr: | 20221209224906307 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224906307 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224906307 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224906307 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224906307 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224906307 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224906318 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224906326 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224906326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224906326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:09.620930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25855): Terminating (SIGTERM) 22:49:09.662372 run iperf3-srv_10.42.42.10(pid=25856): Terminating (SIGTERM) 22:49:09.703942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25859): Terminating (SIGTERM) 22:49:09.745606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25862): Terminating (SIGTERM) 22:49:09.787056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25865): Terminating (SIGTERM) 22:49:09.828936 --- ParallelTerminationStrategy: PID 25855 died... 22:49:09.848878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25855): Terminated: ok {rc=0} 22:49:09.895267 --- ParallelTerminationStrategy: PID 25856 died... 22:49:09.914912 run iperf3-srv_10.42.42.10(pid=25856): Terminated {rc=256} 22:49:09.960618 --- ParallelTerminationStrategy: PID 25859 died... 22:49:09.980124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25859): Terminated: ok {rc=0} 22:49:10.025830 --- ParallelTerminationStrategy: PID 25862 died... 22:49:10.045366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25862): Terminated: ok {rc=0} 22:49:10.090946 --- ParallelTerminationStrategy: PID 25865 died... 22:49:10.110449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25865): Terminated: ok {rc=0} 22:49:10.197975 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:49:11.347442 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:11.359460 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:49:11.400140 tst iperf3m4.py: using LAC 24202 22:49:11.519972 tst iperf3m4.py: using RAC 232 22:49:11.638448 tst iperf3m4.py: using CellId 24202 22:49:11.755407 tst iperf3m4.py: using BVCI 24203 22:49:11.863664 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:11.874643 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:11.897262 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:11.920788 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:11.932139 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:11.943125 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:11.953954 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:11.964879 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:11.976130 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:12.092856 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:12.212542 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:12.332412 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:12.451190 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:49:12.652791 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:12.954678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25867): Launched 22:49:13.217214 run iperf3-srv_10.42.42.10(pid=25868): Launched 22:49:13.330523 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:49:13.531812 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:13.833820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25869): Launched 22:49:14.097309 run iperf3-srv_10.42.42.10(pid=25870): Launched 22:49:14.210704 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:49:14.412119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:14.713457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25871): Launched 22:49:14.977103 run iperf3-srv_10.42.42.10(pid=25872): Launched 22:49:15.090396 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:49:15.291143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:15.592230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25873): Launched 22:49:15.883955 run iperf3-srv_10.42.42.10(pid=25874): Launched 22:49:16.019269 tst iperf3m4.py:8: start network... 22:49:16.271106 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:16.788753 run create_hlr_db(pid=25875): Launched 22:49:16.954849 bus /gobi_6: Setting Powered False 22:49:18.018530 run create_hlr_db(pid=25875): Terminated: ok {rc=0} 22:49:18.466991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25877): Launched 22:49:18.788384 run osmo-hlr_10.42.42.2(pid=25878): Launched 22:49:18.910949 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:19.464106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25880): Launched 22:49:19.784592 run osmo-stp_10.42.42.5(pid=25881): Launched 22:49:19.906501 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:20.458135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25883): Launched 22:49:20.581253 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:20.851953 run patchelf(pid=25884): Launched 22:49:21.030754 run osmo-stp_10.42.42.5(pid=25881): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25881)] 22:49:21.167735 run osmo-stp_10.42.42.5(pid=25881): stdout: | (launched: 2022-12-09_22:49:19.726722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:21.306130 run osmo-stp_10.42.42.5(pid=25881): stderr: | 20221209224919919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224919920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224919920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224919920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224919921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224919921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224919921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:21.443880 run osmo-stp_10.42.42.5(pid=25881): stdout: | (launched: 2022-12-09_22:49:19.726722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:21.575311 run osmo-stp_10.42.42.5(pid=25881): stderr: | 20221209224919919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224919920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224919920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224919920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224919921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224919921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224919921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:21.730633 run patchelf(pid=25884): Terminating (SIGINT) 22:49:21.912350 run patchelf(pid=25884): Terminated: ok {rc=0} 22:49:22.042771 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25881): Process ended prematurely: osmo-stp_10.42.42.5(pid=25881) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25881)] [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 22:49:22.052776 tst iperf3m4.py:8: Test FAILED (10.7 sec) 22:49:22.081416 run osmo-hlr_10.42.42.2(pid=25878): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25878)] 22:49:22.130759 run osmo-hlr_10.42.42.2(pid=25878): stdout: | (launched: 2022-12-09_22:49:18.730298) 22:49:22.182047 run osmo-hlr_10.42.42.2(pid=25878): stderr: | 20221209224918930 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224918930 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224918930 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224918930 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224918930 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224918930 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224918943 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224918951 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224918952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224918952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:22.234161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25867): Terminating (SIGTERM) 22:49:22.275541 run iperf3-srv_10.42.42.10(pid=25868): Terminating (SIGTERM) 22:49:22.318408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25869): Terminating (SIGTERM) 22:49:22.361137 run iperf3-srv_10.42.42.10(pid=25870): Terminating (SIGTERM) 22:49:22.401298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25871): Terminating (SIGTERM) 22:49:22.442195 run iperf3-srv_10.42.42.10(pid=25872): Terminating (SIGTERM) 22:49:22.482307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25873): Terminating (SIGTERM) 22:49:22.522463 run iperf3-srv_10.42.42.10(pid=25874): Terminating (SIGTERM) 22:49:22.562394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25877): Terminating (SIGTERM) 22:49:22.602823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25880): Terminating (SIGTERM) 22:49:22.642971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25883): Terminating (SIGTERM) 22:49:22.683452 --- ParallelTerminationStrategy: PID 25867 died... 22:49:22.702500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25867): Terminated: ok {rc=0} 22:49:22.747858 --- ParallelTerminationStrategy: PID 25868 died... 22:49:22.766409 run iperf3-srv_10.42.42.10(pid=25868): Terminated {rc=256} 22:49:22.811365 --- ParallelTerminationStrategy: PID 25869 died... 22:49:22.829968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25869): Terminated: ok {rc=0} 22:49:22.875311 --- ParallelTerminationStrategy: PID 25870 died... 22:49:22.893848 run iperf3-srv_10.42.42.10(pid=25870): Terminated {rc=256} 22:49:22.938890 --- ParallelTerminationStrategy: PID 25871 died... 22:49:22.957505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25871): Terminated: ok {rc=0} 22:49:23.002945 --- ParallelTerminationStrategy: PID 25872 died... 22:49:23.021548 run iperf3-srv_10.42.42.10(pid=25872): Terminated {rc=256} 22:49:23.066520 --- ParallelTerminationStrategy: PID 25873 died... 22:49:23.084935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25873): Terminated: ok {rc=0} 22:49:23.129641 --- ParallelTerminationStrategy: PID 25874 died... 22:49:23.148929 run iperf3-srv_10.42.42.10(pid=25874): Terminated {rc=256} 22:49:23.194147 --- ParallelTerminationStrategy: PID 25877 died... 22:49:23.212543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25877): Terminated: ok {rc=0} 22:49:23.257895 --- ParallelTerminationStrategy: PID 25880 died... 22:49:23.276498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25880): Terminated: ok {rc=0} 22:49:23.321548 --- ParallelTerminationStrategy: PID 25883 died... 22:49:23.340096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25883): Terminated: ok {rc=0} 22:49:23.427484 bus /gobi_4: Setting Powered False 22:49:24.527103 bus /gobi_4: Setting Powered False 22:49:25.643249 bus /gobi_1: Setting Powered False 22:49:26.742711 bus /gobi_1: Setting Powered False 22:49:27.857778 bus /gobi_0: Setting Powered False 22:49:28.955549 bus /gobi_0: Setting Powered False 22:49:30.072407 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 22:49:31.173870 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:31.186290 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:49:31.231405 tst ping.py: using LAC 24203 22:49:31.350909 tst ping.py: using RAC 233 22:49:31.510219 tst ping.py: using CellId 24203 22:49:31.673270 tst ping.py: using BVCI 24204 22:49:31.790258 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:31.802068 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:31.813820 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:31.825716 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:31.837378 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:31.849202 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:31.861306 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:31.872910 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:31.994089 tst ping.py:19: start network... 22:49:32.209779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:32.695599 run create_hlr_db(pid=25886): Launched 22:49:32.823559 bus /gobi_6: Setting Powered False 22:49:33.885930 run create_hlr_db(pid=25886): Terminated: ok {rc=0} 22:49:34.325087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25888): Launched 22:49:34.637598 run osmo-hlr_10.42.42.2(pid=25889): Launched 22:49:34.758118 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:35.304683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25891): Launched 22:49:35.618263 run osmo-stp_10.42.42.5(pid=25892): Launched 22:49:35.737939 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:36.280103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25894): Launched 22:49:36.400622 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:36.665378 run patchelf(pid=25895): Launched 22:49:36.840804 run osmo-stp_10.42.42.5(pid=25892): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25892)] 22:49:36.975028 run osmo-stp_10.42.42.5(pid=25892): stdout: | (launched: 2022-12-09_22:49:35.561517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:37.110860 run osmo-stp_10.42.42.5(pid=25892): stderr: | 20221209224935752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224935752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224935752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224935753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224935753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224935753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224935753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:37.247274 run osmo-stp_10.42.42.5(pid=25892): stdout: | (launched: 2022-12-09_22:49:35.561517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:37.377211 run osmo-stp_10.42.42.5(pid=25892): stderr: | 20221209224935752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224935752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224935752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224935753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224935753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224935753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224935753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:37.530674 run patchelf(pid=25895): Terminating (SIGINT) 22:49:37.709878 run patchelf(pid=25895): Terminated: ok {rc=0} 22:49:37.838509 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25892): Process ended prematurely: osmo-stp_10.42.42.5(pid=25892) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25892)] [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 22:49:37.847949 tst ping.py:22: Test FAILED (6.7 sec) 22:49:37.875989 run osmo-hlr_10.42.42.2(pid=25889): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25889)] 22:49:37.925937 run osmo-hlr_10.42.42.2(pid=25889): stdout: | (launched: 2022-12-09_22:49:34.581123) 22:49:37.977603 run osmo-hlr_10.42.42.2(pid=25889): stderr: | 20221209224934780 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224934780 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224934780 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224934780 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224934780 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224934781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224934796 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224934806 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224934806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224934806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:38.029495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25888): Terminating (SIGTERM) 22:49:38.071296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25891): Terminating (SIGTERM) 22:49:38.113276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25894): Terminating (SIGTERM) 22:49:38.155493 --- ParallelTerminationStrategy: PID 25888 died... 22:49:38.175609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25888): Terminated: ok {rc=0} 22:49:38.222406 --- ParallelTerminationStrategy: PID 25891 died... 22:49:38.242312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25891): Terminated: ok {rc=0} 22:49:38.288698 --- ParallelTerminationStrategy: PID 25894 died... 22:49:38.308405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25894): Terminated: ok {rc=0} 22:49:38.396936 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:49:39.485857 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:39.498253 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:49:39.541123 tst ping_idle_ping.py: using LAC 24204 22:49:39.665443 tst ping_idle_ping.py: using RAC 234 22:49:39.787928 tst ping_idle_ping.py: using CellId 24204 22:49:39.910721 tst ping_idle_ping.py: using BVCI 24205 22:49:40.025512 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:40.036933 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:40.048209 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:40.059363 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:40.070611 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:40.081899 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:40.093378 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:40.104436 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:40.220922 tst ping_idle_ping.py:24: start network... 22:49:40.419580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:40.882695 run create_hlr_db(pid=25896): Launched 22:49:40.996857 bus /gobi_6: Setting Powered False 22:49:42.056587 run create_hlr_db(pid=25896): Terminated: ok {rc=0} 22:49:42.470962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25898): Launched 22:49:42.766326 run osmo-hlr_10.42.42.2(pid=25899): Launched 22:49:42.879708 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:43.403218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25901): Launched 22:49:43.699115 run osmo-stp_10.42.42.5(pid=25902): Launched 22:49:43.813233 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:44.322481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25904): Launched 22:49:44.436129 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:44.684874 run patchelf(pid=25905): Launched 22:49:44.849656 run osmo-stp_10.42.42.5(pid=25902): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25902)] 22:49:44.975020 run osmo-stp_10.42.42.5(pid=25902): stdout: | (launched: 2022-12-09_22:49:43.645257) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:45.102089 run osmo-stp_10.42.42.5(pid=25902): stderr: | 20221209224943815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224943815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224943815 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224943816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224943816 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224943816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224943816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:45.229305 run osmo-stp_10.42.42.5(pid=25902): stdout: | (launched: 2022-12-09_22:49:43.645257) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:45.350580 run osmo-stp_10.42.42.5(pid=25902): stderr: | 20221209224943815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224943815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224943815 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224943816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224943816 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224943816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224943816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:45.494099 run patchelf(pid=25905): Terminating (SIGINT) 22:49:45.661626 run patchelf(pid=25905): Terminated: ok {rc=0} 22:49:45.782027 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25902): Process ended prematurely: osmo-stp_10.42.42.5(pid=25902) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25902)] [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 22:49:45.790742 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 22:49:45.818373 run osmo-hlr_10.42.42.2(pid=25899): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25899)] 22:49:45.893103 run osmo-hlr_10.42.42.2(pid=25899): stdout: | (launched: 2022-12-09_22:49:42.712864) 22:49:45.948354 run osmo-hlr_10.42.42.2(pid=25899): stderr: | 20221209224942887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224942887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224942887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224942887 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224942888 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224942888 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224942899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224942910 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224942911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224942911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:46.000624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25898): Terminating (SIGTERM) 22:49:46.045132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25901): Terminating (SIGTERM) 22:49:46.089148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25904): Terminating (SIGTERM) 22:49:46.132571 --- ParallelTerminationStrategy: PID 25898 died... 22:49:46.152515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25898): Terminated: ok {rc=0} 22:49:46.201540 --- ParallelTerminationStrategy: PID 25901 died... 22:49:46.221232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25901): Terminated: ok {rc=0} 22:49:46.268751 --- ParallelTerminationStrategy: PID 25904 died... 22:49:46.288358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25904): Terminated: ok {rc=0} 22:49:46.375228 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:49:47.671209 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:49:47.679603 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:49:47.704747 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:49:47.742690 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:49:47.828304 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:49:47.851673 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:49:47.889773 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:49:48.485245 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:49:48.534040 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:48.545176 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:49:48.604544 tst cs_paging_gprs_active.py: using LAC 24205 22:49:48.723308 tst cs_paging_gprs_active.py: using RAC 235 22:49:48.840690 tst cs_paging_gprs_active.py: using CellId 24205 22:49:48.958352 tst cs_paging_gprs_active.py: using BVCI 24206 22:49:49.069156 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:49.080136 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:49.090866 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:49.101943 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:49.113080 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:49.124274 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:49.135229 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:49.146135 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:49.157561 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:49:49.273241 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:49:49.389029 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:49:49.589561 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:49.889664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25910): Launched 22:49:50.150169 run iperf3-srv_10.42.42.10(pid=25911): Launched 22:49:50.262793 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:49:50.462498 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:50.761993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25912): Launched 22:49:51.022819 run iperf3-srv_10.42.42.10(pid=25913): Launched 22:49:51.135301 tst cs_paging_gprs_active.py:38: start network... 22:49:51.335430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:51.799336 run create_hlr_db(pid=25914): Launched 22:49:51.913929 bus /gobi_6: Setting Powered False 22:49:52.974350 run create_hlr_db(pid=25914): Terminated: ok {rc=0} 22:49:53.413498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25916): Launched 22:49:53.737419 run osmo-hlr_10.42.42.2(pid=25917): Launched 22:49:53.861155 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:54.417190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25919): Launched 22:49:54.737431 run osmo-stp_10.42.42.5(pid=25920): Launched 22:49:54.861136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:55.417177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25922): Launched 22:49:55.540842 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:55.811205 run patchelf(pid=25923): Launched 22:49:55.990561 run osmo-stp_10.42.42.5(pid=25920): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25920)] 22:49:56.126535 run osmo-stp_10.42.42.5(pid=25920): stdout: | (launched: 2022-12-09_22:49:54.679786) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:56.264400 run osmo-stp_10.42.42.5(pid=25920): stderr: | 20221209224954870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224954871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224954871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224954871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224954872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224954872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224954872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:56.401868 run osmo-stp_10.42.42.5(pid=25920): stdout: | (launched: 2022-12-09_22:49:54.679786) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:56.533569 run osmo-stp_10.42.42.5(pid=25920): stderr: | 20221209224954870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209224954871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209224954871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209224954871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209224954872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209224954872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209224954872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:56.689483 run patchelf(pid=25923): Terminating (SIGINT) 22:49:56.869467 run patchelf(pid=25923): Terminated: ok {rc=0} 22:49:56.999064 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25920): Process ended prematurely: osmo-stp_10.42.42.5(pid=25920) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25920)] [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:49:57.008942 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 22:49:57.037504 run osmo-hlr_10.42.42.2(pid=25917): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25917)] 22:49:57.087247 run osmo-hlr_10.42.42.2(pid=25917): stdout: | (launched: 2022-12-09_22:49:53.679081) 22:49:57.138762 run osmo-hlr_10.42.42.2(pid=25917): stderr: | 20221209224953879 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209224953879 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209224953879 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209224953879 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209224953879 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209224953879 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209224953891 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209224953899 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209224953900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209224953900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:57.190867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25910): Terminating (SIGTERM) 22:49:57.233192 run iperf3-srv_10.42.42.10(pid=25911): Terminating (SIGTERM) 22:49:57.275241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25912): Terminating (SIGTERM) 22:49:57.317267 run iperf3-srv_10.42.42.10(pid=25913): Terminating (SIGTERM) 22:49:57.358865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25916): Terminating (SIGTERM) 22:49:57.400819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25919): Terminating (SIGTERM) 22:49:57.443124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25922): Terminating (SIGTERM) 22:49:57.485124 --- ParallelTerminationStrategy: PID 25910 died... 22:49:57.505183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25910): Terminated: ok {rc=0} 22:49:57.551685 --- ParallelTerminationStrategy: PID 25911 died... 22:49:57.571388 run iperf3-srv_10.42.42.10(pid=25911): Terminated {rc=256} 22:49:57.617395 --- ParallelTerminationStrategy: PID 25912 died... 22:49:57.637065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25912): Terminated: ok {rc=0} 22:49:57.683027 --- ParallelTerminationStrategy: PID 25913 died... 22:49:57.702527 run iperf3-srv_10.42.42.10(pid=25913): Terminated {rc=256} 22:49:57.748570 --- ParallelTerminationStrategy: PID 25916 died... 22:49:57.768190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25916): Terminated: ok {rc=0} 22:49:57.814095 --- ParallelTerminationStrategy: PID 25919 died... 22:49:57.833843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25919): Terminated: ok {rc=0} 22:49:57.879818 --- ParallelTerminationStrategy: PID 25922 died... 22:49:57.899453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25922): Terminated: ok {rc=0} 22:49:57.986697 bus /gobi_0: Setting Powered False 22:49:59.087134 bus /gobi_0: Setting Powered False 22:50:00.201503 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:50:01.347108 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:01.359608 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:50:01.423806 tst iperf3.py: using LAC 24206 22:50:01.563223 tst iperf3.py: using RAC 236 22:50:01.695018 tst iperf3.py: using CellId 24206 22:50:01.848757 tst iperf3.py: using BVCI 24207 22:50:02.052002 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:02.073101 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:02.088814 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:02.102945 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:02.116179 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:02.143465 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:02.157219 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:02.171287 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:02.190791 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:02.376008 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:50:02.592604 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:50:02.894789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25935): Launched 22:50:03.156299 run iperf3-srv_10.42.42.10(pid=25936): Launched 22:50:03.269683 tst iperf3.py:8: start network... 22:50:03.470767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:03.932848 run create_hlr_db(pid=25937): Launched 22:50:04.046960 bus /gobi_6: Setting Powered False 22:50:05.106667 run create_hlr_db(pid=25937): Terminated: ok {rc=0} 22:50:05.523812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25939): Launched 22:50:05.822664 run osmo-hlr_10.42.42.2(pid=25940): Launched 22:50:05.936408 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:06.451261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25942): Launched 22:50:06.751390 run osmo-stp_10.42.42.5(pid=25943): Launched 22:50:06.866518 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:07.384800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25945): Launched 22:50:07.500412 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:07.752849 run patchelf(pid=25946): Launched 22:50:07.920623 run osmo-stp_10.42.42.5(pid=25943): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25943)] 22:50:08.048612 run osmo-stp_10.42.42.5(pid=25943): stdout: | (launched: 2022-12-09_22:50:06.696680) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:08.177573 run osmo-stp_10.42.42.5(pid=25943): stderr: | 20221209225006868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225006868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225006869 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225006869 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225006870 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225006870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225006870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:08.306465 run osmo-stp_10.42.42.5(pid=25943): stdout: | (launched: 2022-12-09_22:50:06.696680) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:08.429377 run osmo-stp_10.42.42.5(pid=25943): stderr: | 20221209225006868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225006868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225006869 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225006869 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225006870 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225006870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225006870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:08.575180 run patchelf(pid=25946): Terminating (SIGINT) 22:50:08.745900 run patchelf(pid=25946): Terminated: ok {rc=0} 22:50:08.868501 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25943): Process ended prematurely: osmo-stp_10.42.42.5(pid=25943) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25943)] [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 22:50:08.878060 tst iperf3.py:8: Test FAILED (7.6 sec) 22:50:08.905571 run osmo-hlr_10.42.42.2(pid=25940): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25940)] 22:50:08.953213 run osmo-hlr_10.42.42.2(pid=25940): stdout: | (launched: 2022-12-09_22:50:05.767996) 22:50:09.002533 run osmo-hlr_10.42.42.2(pid=25940): stderr: | 20221209225005946 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225005946 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225005946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225005946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225005946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225005946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225005958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225005967 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225005967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225005967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:09.052211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25935): Terminating (SIGTERM) 22:50:09.092042 run iperf3-srv_10.42.42.10(pid=25936): Terminating (SIGTERM) 22:50:09.131505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25939): Terminating (SIGTERM) 22:50:09.171519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25942): Terminating (SIGTERM) 22:50:09.211019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25945): Terminating (SIGTERM) 22:50:09.250920 --- ParallelTerminationStrategy: PID 25935 died... 22:50:09.270062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25935): Terminated: ok {rc=0} 22:50:09.315018 --- ParallelTerminationStrategy: PID 25936 died... 22:50:09.333857 run iperf3-srv_10.42.42.10(pid=25936): Terminated {rc=256} 22:50:09.378567 --- ParallelTerminationStrategy: PID 25939 died... 22:50:09.397350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25939): Terminated: ok {rc=0} 22:50:09.441643 --- ParallelTerminationStrategy: PID 25942 died... 22:50:09.460340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25942): Terminated: ok {rc=0} 22:50:09.504706 --- ParallelTerminationStrategy: PID 25945 died... 22:50:09.523722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25945): Terminated: ok {rc=0} 22:50:09.610658 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:50:10.758616 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:10.770190 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:50:10.830110 tst iperf3m4.py: using LAC 24207 22:50:10.947981 tst iperf3m4.py: using RAC 237 22:50:11.074445 tst iperf3m4.py: using CellId 24207 22:50:11.200137 tst iperf3m4.py: using BVCI 24208 22:50:11.318289 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:11.329844 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:11.341143 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:11.353380 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:11.365278 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:11.377200 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:11.389321 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:11.401205 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:11.413268 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:11.533371 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:11.653695 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:11.773826 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:11.890491 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:50:12.106610 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:50:12.446171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25950): Launched 22:50:12.789691 run iperf3-srv_10.42.42.10(pid=25979): Launched 22:50:12.916529 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:50:13.133564 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:50:13.470527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26122): Launched 22:50:13.750704 run iperf3-srv_10.42.42.10(pid=26145): Launched 22:50:13.881127 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:50:14.088361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:50:14.407859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26297): Launched 22:50:14.674028 run iperf3-srv_10.42.42.10(pid=26303): Launched 22:50:14.787681 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:50:14.988305 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:50:15.290593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26304): Launched 22:50:15.551815 run iperf3-srv_10.42.42.10(pid=26305): Launched 22:50:15.665170 tst iperf3m4.py:8: start network... 22:50:15.869520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:16.351738 run create_hlr_db(pid=26306): Launched 22:50:16.506651 bus /gobi_6: Setting Powered False 22:50:17.566274 run create_hlr_db(pid=26306): Terminated: ok {rc=0} 22:50:18.004037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26308): Launched 22:50:18.323972 run osmo-hlr_10.42.42.2(pid=26309): Launched 22:50:18.446075 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:18.995742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26311): Launched 22:50:19.315141 run osmo-stp_10.42.42.5(pid=26312): Launched 22:50:19.436391 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:19.986402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26314): Launched 22:50:20.108928 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:20.380096 run patchelf(pid=26315): Launched 22:50:20.558485 run osmo-stp_10.42.42.5(pid=26312): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26312)] 22:50:20.694125 run osmo-stp_10.42.42.5(pid=26312): stdout: | (launched: 2022-12-09_22:50:19.256640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:20.830828 run osmo-stp_10.42.42.5(pid=26312): stderr: | 20221209225019448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225019448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225019448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225019449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225019449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225019449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225019449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:20.967475 run osmo-stp_10.42.42.5(pid=26312): stdout: | (launched: 2022-12-09_22:50:19.256640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:21.097736 run osmo-stp_10.42.42.5(pid=26312): stderr: | 20221209225019448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225019448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225019448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225019449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225019449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225019449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225019449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:21.252705 run patchelf(pid=26315): Terminating (SIGINT) 22:50:21.433503 run patchelf(pid=26315): Terminated: ok {rc=0} 22:50:21.563554 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26312): Process ended prematurely: osmo-stp_10.42.42.5(pid=26312) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26312)] [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:50:21.573736 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:50:21.602425 run osmo-hlr_10.42.42.2(pid=26309): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26309)] 22:50:21.652724 run osmo-hlr_10.42.42.2(pid=26309): stdout: | (launched: 2022-12-09_22:50:18.265715) 22:50:21.704164 run osmo-hlr_10.42.42.2(pid=26309): stderr: | 20221209225018465 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225018465 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225018465 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225018465 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225018465 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225018465 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225018477 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225018485 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225018486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225018486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:21.756042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25950): Terminating (SIGTERM) 22:50:21.797940 run iperf3-srv_10.42.42.10(pid=25979): Terminating (SIGTERM) 22:50:21.839741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26122): Terminating (SIGTERM) 22:50:21.881790 run iperf3-srv_10.42.42.10(pid=26145): Terminating (SIGTERM) 22:50:21.923794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26297): Terminating (SIGTERM) 22:50:21.965638 run iperf3-srv_10.42.42.10(pid=26303): Terminating (SIGTERM) 22:50:22.007560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26304): Terminating (SIGTERM) 22:50:22.049606 run iperf3-srv_10.42.42.10(pid=26305): Terminating (SIGTERM) 22:50:22.091516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26308): Terminating (SIGTERM) 22:50:22.134021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26311): Terminating (SIGTERM) 22:50:22.175903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26314): Terminating (SIGTERM) 22:50:22.218104 --- ParallelTerminationStrategy: PID 25950 died... 22:50:22.238597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25950): Terminated: ok {rc=0} 22:50:22.285005 --- ParallelTerminationStrategy: PID 25979 died... 22:50:22.304520 run iperf3-srv_10.42.42.10(pid=25979): Terminated {rc=256} 22:50:22.350607 --- ParallelTerminationStrategy: PID 26122 died... 22:50:22.370112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26122): Terminated: ok {rc=0} 22:50:22.416090 --- ParallelTerminationStrategy: PID 26145 died... 22:50:22.435795 run iperf3-srv_10.42.42.10(pid=26145): Terminated {rc=256} 22:50:22.481806 --- ParallelTerminationStrategy: PID 26297 died... 22:50:22.501399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26297): Terminated: ok {rc=0} 22:50:22.547368 --- ParallelTerminationStrategy: PID 26303 died... 22:50:22.566986 run iperf3-srv_10.42.42.10(pid=26303): Terminated {rc=256} 22:50:22.612876 --- ParallelTerminationStrategy: PID 26304 died... 22:50:22.632836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26304): Terminated: ok {rc=0} 22:50:22.679560 --- ParallelTerminationStrategy: PID 26305 died... 22:50:22.699196 run iperf3-srv_10.42.42.10(pid=26305): Terminated {rc=256} 22:50:22.745483 --- ParallelTerminationStrategy: PID 26308 died... 22:50:22.765561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26308): Terminated: ok {rc=0} 22:50:22.811766 --- ParallelTerminationStrategy: PID 26311 died... 22:50:22.831573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26311): Terminated: ok {rc=0} 22:50:22.877600 --- ParallelTerminationStrategy: PID 26314 died... 22:50:22.897501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26314): Terminated: ok {rc=0} 22:50:22.986234 bus /gobi_4: Setting Powered False 22:50:24.085743 bus /gobi_4: Setting Powered False 22:50:25.203251 bus /gobi_1: Setting Powered False 22:50:26.302181 bus /gobi_1: Setting Powered False 22:50:27.418733 bus /gobi_0: Setting Powered False 22:50:28.521547 bus /gobi_0: Setting Powered False 22:50:29.643862 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:50:30.747822 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:30.759477 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:50:30.822564 tst ping.py: using LAC 24208 22:50:30.951154 tst ping.py: using RAC 238 22:50:31.067085 tst ping.py: using CellId 24208 22:50:31.228209 tst ping.py: using BVCI 24209 22:50:31.346433 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:31.358595 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:31.370539 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:31.382747 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:31.396443 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:31.409657 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:31.423672 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:31.435832 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:31.581999 tst ping.py:19: start network... 22:50:31.789462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:32.259395 run create_hlr_db(pid=26492): Launched 22:50:32.379762 bus /gobi_6: Setting Powered False 22:50:33.439096 run create_hlr_db(pid=26492): Terminated: ok {rc=0} 22:50:33.851279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26494): Launched 22:50:34.145003 run osmo-hlr_10.42.42.2(pid=26495): Launched 22:50:34.256378 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:34.785019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26497): Launched 22:50:35.079917 run osmo-stp_10.42.42.5(pid=26498): Launched 22:50:35.192529 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:35.699414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26500): Launched 22:50:35.812823 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:36.060605 run patchelf(pid=26501): Launched 22:50:36.224689 run osmo-stp_10.42.42.5(pid=26498): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26498)] 22:50:36.349582 run osmo-stp_10.42.42.5(pid=26498): stdout: | (launched: 2022-12-09_22:50:35.026163) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:36.475738 run osmo-stp_10.42.42.5(pid=26498): stderr: | 20221209225035198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225035198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225035198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225035199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225035199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225035199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225035199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:36.601927 run osmo-stp_10.42.42.5(pid=26498): stdout: | (launched: 2022-12-09_22:50:35.026163) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:36.722223 run osmo-stp_10.42.42.5(pid=26498): stderr: | 20221209225035198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225035198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225035198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225035199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225035199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225035199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225035199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:36.864689 run patchelf(pid=26501): Terminating (SIGINT) 22:50:37.031001 run patchelf(pid=26501): Terminated: ok {rc=0} 22:50:37.151102 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26498): Process ended prematurely: osmo-stp_10.42.42.5(pid=26498) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26498)] [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 22:50:37.159869 tst ping.py:22: Test FAILED (6.4 sec) 22:50:37.186909 run osmo-hlr_10.42.42.2(pid=26495): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26495)] 22:50:37.234789 run osmo-hlr_10.42.42.2(pid=26495): stdout: | (launched: 2022-12-09_22:50:34.091160) 22:50:37.284325 run osmo-hlr_10.42.42.2(pid=26495): stderr: | 20221209225034269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225034269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225034269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225034269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225034269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225034269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225034281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225034290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225034290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225034290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:37.333992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26494): Terminating (SIGTERM) 22:50:37.373573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26497): Terminating (SIGTERM) 22:50:37.413554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26500): Terminating (SIGTERM) 22:50:37.453760 --- ParallelTerminationStrategy: PID 26494 died... 22:50:37.472816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26494): Terminated: ok {rc=0} 22:50:37.517825 --- ParallelTerminationStrategy: PID 26497 died... 22:50:37.536233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26497): Terminated: ok {rc=0} 22:50:37.580617 --- ParallelTerminationStrategy: PID 26500 died... 22:50:37.599288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26500): Terminated: ok {rc=0} 22:50:37.685248 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:50:38.772604 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:38.784165 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:50:38.845969 tst ping_idle_ping.py: using LAC 24209 22:50:38.963400 tst ping_idle_ping.py: using RAC 239 22:50:39.080817 tst ping_idle_ping.py: using CellId 24209 22:50:39.196282 tst ping_idle_ping.py: using BVCI 24210 22:50:39.304636 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:39.315552 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:39.326365 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:39.337041 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:39.348797 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:39.359567 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:39.371693 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:39.383004 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:39.498074 tst ping_idle_ping.py:24: start network... 22:50:39.711610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:40.201096 run create_hlr_db(pid=26502): Launched 22:50:40.330535 bus /gobi_6: Setting Powered False 22:50:41.393722 run create_hlr_db(pid=26502): Terminated: ok {rc=0} 22:50:41.833318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26504): Launched 22:50:42.148697 run osmo-hlr_10.42.42.2(pid=26505): Launched 22:50:42.263887 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:42.778316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26507): Launched 22:50:43.072790 run osmo-stp_10.42.42.5(pid=26508): Launched 22:50:43.184758 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:43.690818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26510): Launched 22:50:43.804353 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:44.052837 run patchelf(pid=26511): Launched 22:50:44.217476 run osmo-stp_10.42.42.5(pid=26508): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26508)] 22:50:44.342909 run osmo-stp_10.42.42.5(pid=26508): stdout: | (launched: 2022-12-09_22:50:43.019203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:44.470257 run osmo-stp_10.42.42.5(pid=26508): stderr: | 20221209225043189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225043189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225043189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225043190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225043190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225043190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225043190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:44.597184 run osmo-stp_10.42.42.5(pid=26508): stdout: | (launched: 2022-12-09_22:50:43.019203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:44.717594 run osmo-stp_10.42.42.5(pid=26508): stderr: | 20221209225043189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225043189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225043189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225043190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225043190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225043190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225043190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:44.860902 run patchelf(pid=26511): Terminating (SIGINT) 22:50:45.028203 run patchelf(pid=26511): Terminated: ok {rc=0} 22:50:45.148058 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26508): Process ended prematurely: osmo-stp_10.42.42.5(pid=26508) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26508)] [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:50:45.156813 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:50:45.183847 run osmo-hlr_10.42.42.2(pid=26505): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26505)] 22:50:45.232069 run osmo-hlr_10.42.42.2(pid=26505): stdout: | (launched: 2022-12-09_22:50:42.091604) 22:50:45.281409 run osmo-hlr_10.42.42.2(pid=26505): stderr: | 20221209225042267 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225042268 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225042268 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225042268 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225042268 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225042268 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225042280 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225042290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225042290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225042290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:45.330924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26504): Terminating (SIGTERM) 22:50:45.370757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26507): Terminating (SIGTERM) 22:50:45.410670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26510): Terminating (SIGTERM) 22:50:45.450777 --- ParallelTerminationStrategy: PID 26504 died... 22:50:45.469894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26504): Terminated: ok {rc=0} 22:50:45.514277 --- ParallelTerminationStrategy: PID 26507 died... 22:50:45.532826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26507): Terminated: ok {rc=0} 22:50:45.577156 --- ParallelTerminationStrategy: PID 26510 died... 22:50:45.595719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26510): Terminated: ok {rc=0} 22:50:45.681064 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 22:50:46.972190 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:50:46.980065 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:50:47.007819 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:50:47.044179 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:50:47.098009 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:50:47.123328 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:50:47.158756 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:50:47.717544 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2365 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:50:47.723368 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:47.735237 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:50:47.803609 tst switch_tch_pdch.py: using LAC 24210 22:50:47.926823 tst switch_tch_pdch.py: using RAC 240 22:50:48.053798 tst switch_tch_pdch.py: using CellId 24210 22:50:48.176089 tst switch_tch_pdch.py: using BVCI 24211 22:50:48.285612 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:48.297078 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:48.308347 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:48.319735 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:48.332316 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:48.344706 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:48.357175 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:48.369117 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:50:48.489419 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:50:48.609223 tst switch_tch_pdch.py:51: start network... 22:50:48.820357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:49.303821 run create_hlr_db(pid=26515): Launched 22:50:49.432204 bus /gobi_6: Setting Powered False 22:50:50.495833 run create_hlr_db(pid=26515): Terminated: ok {rc=0} 22:50:50.933689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26517): Launched 22:50:51.247081 run osmo-hlr_10.42.42.2(pid=26518): Launched 22:50:51.367281 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:51.910110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26520): Launched 22:50:52.222521 run osmo-stp_10.42.42.5(pid=26521): Launched 22:50:52.342514 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:52.880787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26523): Launched 22:50:53.000582 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:53.264885 run patchelf(pid=26524): Launched 22:50:53.439611 run osmo-stp_10.42.42.5(pid=26521): ERR: Terminated: ERROR {rc=1} [trial-2365↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26521)] 22:50:53.572798 run osmo-stp_10.42.42.5(pid=26521): stdout: | (launched: 2022-12-09_22:50:52.165832) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:53.707543 run osmo-stp_10.42.42.5(pid=26521): stderr: | 20221209225052356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225052356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225052356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225052357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225052357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225052357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225052357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:53.842394 run osmo-stp_10.42.42.5(pid=26521): stdout: | (launched: 2022-12-09_22:50:52.165832) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:53.971607 run osmo-stp_10.42.42.5(pid=26521): stderr: | 20221209225052356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225052356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225052356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225052357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225052357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225052357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225052357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:54.123891 run patchelf(pid=26524): Terminating (SIGINT) 22:50:54.301518 run patchelf(pid=26524): Terminated: ok {rc=0} 22:50:54.428572 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26521): Process ended prematurely: osmo-stp_10.42.42.5(pid=26521) [trial-2365↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26521)] [trial-2365↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:50:54.438011 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 22:50:54.465717 run osmo-hlr_10.42.42.2(pid=26518): ERR: Terminated: ERROR {rc=237} [trial-2365↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26518)] 22:50:54.515364 run osmo-hlr_10.42.42.2(pid=26518): stdout: | (launched: 2022-12-09_22:50:51.190280) 22:50:54.566547 run osmo-hlr_10.42.42.2(pid=26518): stderr: | 20221209225051388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225051388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225051388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225051388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225051388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225051388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225051401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225051410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225051410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225051410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:54.618316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26517): Terminating (SIGTERM) 22:50:54.659755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26520): Terminating (SIGTERM) 22:50:54.701288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26523): Terminating (SIGTERM) 22:50:54.742937 --- ParallelTerminationStrategy: PID 26517 died... 22:50:54.762999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26517): Terminated: ok {rc=0} 22:50:54.809128 --- ParallelTerminationStrategy: PID 26520 died... 22:50:54.828616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26520): Terminated: ok {rc=0} 22:50:54.874381 --- ParallelTerminationStrategy: PID 26523 died... 22:50:54.893910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26523): Terminated: ok {rc=0} 22:50:54.980414 bus /gobi_0: Setting Powered False 22:50:56.079517 bus /gobi_0: Setting Powered False 22:50:57.195991 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 sms:nanobts+band-900 --------------------------------------------------------------------- 22:50:58.441379 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:50:58.446553 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 22:50:58.479148 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 22:50:58.506046 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 22:50:58.556557 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 22:50:58.589096 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 22:50:58.615867 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 22:50:59.166686 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 22:50:59.171870 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:59.182902 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 22:50:59.229390 tst mo_mt_sms.py: using LAC 24211 22:50:59.351253 tst mo_mt_sms.py: using RAC 241 22:50:59.477227 tst mo_mt_sms.py: using CellId 24211 22:50:59.599627 tst mo_mt_sms.py: using BVCI 24212 22:50:59.712693 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:59.723679 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:59.734598 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:59.745496 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:59.756296 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:59.767089 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 22:50:59.880489 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 22:50:59.994715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:00.451135 run create_hlr_db(pid=26528): Launched 22:51:00.564266 bus /gobi_6: Setting Powered False 22:51:01.623486 run create_hlr_db(pid=26528): Terminated: ok {rc=0} 22:51:02.055439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26530): Launched 22:51:02.391892 run osmo-hlr_10.42.42.2(pid=26531): Launched 22:51:02.510865 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:03.050308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26533): Launched 22:51:03.378291 run osmo-stp_10.42.42.5(pid=26534): Launched 22:51:03.496814 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:04.061758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26536): Launched 22:51:04.377663 run osmo-msc_10.42.42.6(pid=26537): Launched 22:51:04.554233 run osmo-stp_10.42.42.5(pid=26534): ERR: Terminated: ERROR {rc=1} [trial-2365↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26534)] 22:51:04.687546 run osmo-stp_10.42.42.5(pid=26534): stdout: | (launched: 2022-12-09_22:51:03.321879) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:04.822011 run osmo-stp_10.42.42.5(pid=26534): stderr: | 20221209225103512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225103512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225103513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225103513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225103514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225103514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225103514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:04.955292 run osmo-stp_10.42.42.5(pid=26534): stdout: | (launched: 2022-12-09_22:51:03.321879) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:05.080902 run osmo-stp_10.42.42.5(pid=26534): stderr: | 20221209225103512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225103512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225103513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225103513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225103514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225103514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225103514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:05.231625 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26534): Process ended prematurely: osmo-stp_10.42.42.5(pid=26534) [trial-2365↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26534)] [trial-2365↪sms:nanobts+band-900↪mo_mt_sms.py:16] 22:51:05.240384 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 22:51:05.267760 run osmo-hlr_10.42.42.2(pid=26531): ERR: Terminated: ERROR {rc=237} [trial-2365↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26531)] 22:51:05.318085 run osmo-hlr_10.42.42.2(pid=26531): stdout: | (launched: 2022-12-09_22:51:02.335210) 22:51:05.369752 run osmo-hlr_10.42.42.2(pid=26531): stderr: | 20221209225102531 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225102531 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225102531 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225102531 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225102531 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225102531 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225102546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225102554 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225102555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225102555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:05.441783 run osmo-msc_10.42.42.6(pid=26537): ERR: Terminated: ERROR {rc=2} [trial-2365↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26537)] 22:51:05.491383 run osmo-msc_10.42.42.6(pid=26537): stdout: | (launched: 2022-12-09_22:51:04.320047) 22:51:05.542809 run osmo-msc_10.42.42.6(pid=26537): stderr: | 20221209225104640 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225104641 DLGLOBAL DEBUG validating counter group 0x7f00abd85c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225104641 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225104641 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225104641 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225104641 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225104643 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225104643 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225104643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225104644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:05.594953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26530): Terminating (SIGTERM) 22:51:05.636393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26533): Terminating (SIGTERM) 22:51:05.678118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26536): Terminating (SIGTERM) 22:51:05.719921 --- ParallelTerminationStrategy: PID 26530 died... 22:51:05.739472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26530): Terminated: ok {rc=0} 22:51:05.785624 --- ParallelTerminationStrategy: PID 26533 died... 22:51:05.805265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26533): Terminated: ok {rc=0} 22:51:05.851020 --- ParallelTerminationStrategy: PID 26536 died... 22:51:05.870495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26536): Terminated: ok {rc=0} 22:51:05.957801 bus /sierra_3: Setting Powered False 22:51:07.056583 bus /sierra_3: Setting Powered False 22:51:08.172434 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 22:51:09.406387 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:51:09.411411 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 22:51:09.444141 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 22:51:09.451000 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 22:51:09.487595 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 22:51:09.519427 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 22:51:09.526184 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 22:51:10.046702 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2365 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 22:51:10.052000 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 22:51:10.063283 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 22:51:10.110429 tst assert_extension.py: using LAC 24212 22:51:10.234575 tst assert_extension.py: using RAC 242 22:51:10.356164 tst assert_extension.py: using CellId 24212 22:51:10.473997 tst assert_extension.py: using BVCI 24213 22:51:10.580934 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 22:51:10.697715 tst assert_extension.py:10: start nitb and bts... 22:51:10.909337 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:51:11.549655 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26544): Launched 22:51:11.865405 run osmo-nitb_10.42.42.2(pid=26545): Launched 22:51:12.040809 run osmo-nitb_10.42.42.2(pid=26545): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26545)] 22:51:12.182895 run osmo-nitb_10.42.42.2(pid=26545): stdout: | (launched: 2022-12-09_22:51:11.808368) 22:51:12.327096 run osmo-nitb_10.42.42.2(pid=26545): stderr: | (launched: 2022-12-09_22:51:11.855471) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:51:12.470884 run osmo-nitb_10.42.42.2(pid=26545): stdout: | (launched: 2022-12-09_22:51:11.808368) 22:51:12.608455 run osmo-nitb_10.42.42.2(pid=26545): stderr: | (launched: 2022-12-09_22:51:11.855471) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26545): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26545) [trial-2365↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26545)] 22:51:12.984924 tst osmo-nitb_10.42.42.2(pid=26545): stdout: | (launched: 2022-12-09_22:51:11.808368) 22:51:13.112642 tst osmo-nitb_10.42.42.2(pid=26545): stderr: | (launched: 2022-12-09_22:51:11.855471) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:51:13.263722 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=26545): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26545) [trial-2365↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26545)] [trial-2365↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 22:51:13.272601 tst assert_extension.py:12: Test FAILED (3.2 sec) 22:51:13.279550 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26544): Terminating (SIGTERM) 22:51:13.491746 --- ParallelTerminationStrategy: PID 26544 died... 22:51:13.513182 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26544): Terminated: ok {rc=0} 22:51:13.601378 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 ussd:nanobts+band-900 --------------------------------------------------------------------- 22:51:14.776714 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:51:14.782586 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 22:51:14.816682 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 22:51:14.843723 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 22:51:14.879408 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 22:51:14.912806 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 22:51:14.940395 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 22:51:15.470580 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2365 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 22:51:15.475652 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:15.486627 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 22:51:15.534741 tst assert_extension.py: using LAC 24213 22:51:15.659703 tst assert_extension.py: using RAC 243 22:51:15.782344 tst assert_extension.py: using CellId 24213 22:51:15.923318 tst assert_extension.py: using BVCI 24214 22:51:16.036566 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:16.048426 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:16.060031 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:16.072558 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:16.084752 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:16.097043 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 22:51:16.217773 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:16.719342 run create_hlr_db(pid=26549): Launched 22:51:16.878038 bus /sierra_2: Setting Powered False 22:51:17.940113 run create_hlr_db(pid=26549): Terminated: ok {rc=0} 22:51:18.364363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26551): Launched 22:51:18.661076 run osmo-hlr_10.42.42.2(pid=26552): Launched 22:51:18.775494 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:19.283595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26554): Launched 22:51:19.576811 run osmo-stp_10.42.42.5(pid=26555): Launched 22:51:19.689551 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:20.219208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26557): Launched 22:51:20.512610 run osmo-msc_10.42.42.6(pid=26558): Launched 22:51:20.677712 run osmo-stp_10.42.42.5(pid=26555): ERR: Terminated: ERROR {rc=1} [trial-2365↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26555)] 22:51:20.801734 run osmo-stp_10.42.42.5(pid=26555): stdout: | (launched: 2022-12-09_22:51:19.523368) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:20.926495 run osmo-stp_10.42.42.5(pid=26555): stderr: | 20221209225119691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225119691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225119691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225119692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225119694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225119694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225119694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:21.049327 run osmo-stp_10.42.42.5(pid=26555): stdout: | (launched: 2022-12-09_22:51:19.523368) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:21.166181 run osmo-stp_10.42.42.5(pid=26555): stderr: | 20221209225119691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225119691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225119691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225119692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225119694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225119694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225119694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:21.306152 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=26555): Process ended prematurely: osmo-stp_10.42.42.5(pid=26555) [trial-2365↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26555)] [trial-2365↪ussd:nanobts+band-900↪assert_extension.py:17] 22:51:21.314289 tst assert_extension.py:17: Test FAILED (5.8 sec) 22:51:21.340522 run osmo-hlr_10.42.42.2(pid=26552): ERR: Terminated: ERROR {rc=237} [trial-2365↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26552)] 22:51:21.388562 run osmo-hlr_10.42.42.2(pid=26552): stdout: | (launched: 2022-12-09_22:51:18.607492) 22:51:21.438091 run osmo-hlr_10.42.42.2(pid=26552): stderr: | 20221209225118783 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225118783 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225118783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225118783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225118783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225118783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225118798 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225118808 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225118808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225118808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:21.506923 run osmo-msc_10.42.42.6(pid=26558): ERR: Terminated: ERROR {rc=2} [trial-2365↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26558)] 22:51:21.554606 run osmo-msc_10.42.42.6(pid=26558): stdout: | (launched: 2022-12-09_22:51:20.459349) 22:51:21.603825 run osmo-msc_10.42.42.6(pid=26558): stderr: | 20221209225120731 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225120731 DLGLOBAL DEBUG validating counter group 0x7f63298aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225120731 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225120731 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225120732 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225120732 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225120733 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225120734 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225120734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225120734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:21.653631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26551): Terminating (SIGTERM) 22:51:21.693050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26554): Terminating (SIGTERM) 22:51:21.733114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26557): Terminating (SIGTERM) 22:51:21.773157 --- ParallelTerminationStrategy: PID 26551 died... 22:51:21.791885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26551): Terminated: ok {rc=0} 22:51:21.836803 --- ParallelTerminationStrategy: PID 26554 died... 22:51:21.855861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26554): Terminated: ok {rc=0} 22:51:21.900318 --- ParallelTerminationStrategy: PID 26557 died... 22:51:21.919425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26557): Terminated: ok {rc=0} 22:51:22.006771 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:51:23.214712 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:51:23.222277 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:51:23.254892 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:51:23.280893 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:51:23.334876 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:51:23.369463 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:51:23.396218 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:51:23.941665 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:51:23.992656 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:24.003709 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:51:24.070167 tst mo_mt_call.py: using LAC 24214 22:51:24.187792 tst mo_mt_call.py: using RAC 244 22:51:24.306507 tst mo_mt_call.py: using CellId 24214 22:51:24.425285 tst mo_mt_call.py: using BVCI 24215 22:51:24.533899 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:24.544901 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:24.556265 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:24.567865 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:24.579700 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:24.590528 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:51:24.710811 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:51:24.828014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:25.291496 run create_hlr_db(pid=26563): Launched 22:51:25.406196 bus /sierra_2: Setting Powered False 22:51:26.466349 run create_hlr_db(pid=26563): Terminated: ok {rc=0} 22:51:26.903132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26565): Launched 22:51:27.222583 run osmo-hlr_10.42.42.2(pid=26566): Launched 22:51:27.345480 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:27.899890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26568): Launched 22:51:28.220334 run osmo-stp_10.42.42.5(pid=26569): Launched 22:51:28.342782 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:28.918507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26571): Launched 22:51:29.237316 run osmo-msc_10.42.42.6(pid=26572): Launched 22:51:29.416423 run osmo-stp_10.42.42.5(pid=26569): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26569)] 22:51:29.551167 run osmo-stp_10.42.42.5(pid=26569): stdout: | (launched: 2022-12-09_22:51:28.162231) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:29.686590 run osmo-stp_10.42.42.5(pid=26569): stderr: | 20221209225128354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225128354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225128354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225128355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225128355 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225128355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225128355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:29.821597 run osmo-stp_10.42.42.5(pid=26569): stdout: | (launched: 2022-12-09_22:51:28.162231) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:29.948677 run osmo-stp_10.42.42.5(pid=26569): stderr: | 20221209225128354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225128354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225128354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225128355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225128355 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225128355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225128355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:30.100550 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26569): Process ended prematurely: osmo-stp_10.42.42.5(pid=26569) [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26569)] [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:51:30.110085 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:51:30.137944 run osmo-hlr_10.42.42.2(pid=26566): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26566)] 22:51:30.188505 run osmo-hlr_10.42.42.2(pid=26566): stdout: | (launched: 2022-12-09_22:51:27.165005) 22:51:30.240842 run osmo-hlr_10.42.42.2(pid=26566): stderr: | 20221209225127361 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225127361 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225127361 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225127361 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225127361 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225127361 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225127374 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225127382 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225127382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225127382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:30.313913 run osmo-msc_10.42.42.6(pid=26572): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26572)] 22:51:30.363817 run osmo-msc_10.42.42.6(pid=26572): stdout: | (launched: 2022-12-09_22:51:29.179650) 22:51:30.415385 run osmo-msc_10.42.42.6(pid=26572): stderr: | 20221209225129499 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225129500 DLGLOBAL DEBUG validating counter group 0x7fd3847f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225129500 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225129500 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225129500 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225129500 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225129502 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225129502 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225129502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225129502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:30.467365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26565): Terminating (SIGTERM) 22:51:30.508837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26568): Terminating (SIGTERM) 22:51:30.550494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26571): Terminating (SIGTERM) 22:51:30.592441 --- ParallelTerminationStrategy: PID 26565 died... 22:51:30.612520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26565): Terminated: ok {rc=0} 22:51:30.658608 --- ParallelTerminationStrategy: PID 26568 died... 22:51:30.678120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26568): Terminated: ok {rc=0} 22:51:30.724069 --- ParallelTerminationStrategy: PID 26571 died... 22:51:30.743566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26571): Terminated: ok {rc=0} 22:51:30.835761 bus /sierra_3: Setting Powered False 22:51:31.953344 bus /sierra_3: Setting Powered False 22:51:33.076626 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:51:34.225556 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:34.237799 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:51:34.306895 tst mo_mt_call_osmux.py: using LAC 24215 22:51:34.425618 tst mo_mt_call_osmux.py: using RAC 245 22:51:34.542975 tst mo_mt_call_osmux.py: using CellId 24215 22:51:34.661856 tst mo_mt_call_osmux.py: using BVCI 24216 22:51:34.771283 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:34.782358 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:34.793247 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:34.804262 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:34.815376 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:34.826993 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:51:34.946185 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:51:35.063020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:35.527077 run create_hlr_db(pid=26574): Launched 22:51:35.640496 bus /sierra_2: Setting Powered False 22:51:36.700405 run create_hlr_db(pid=26574): Terminated: ok {rc=0} 22:51:37.136590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26576): Launched 22:51:37.456354 run osmo-hlr_10.42.42.2(pid=26577): Launched 22:51:37.580700 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:38.134706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26579): Launched 22:51:38.456769 run osmo-stp_10.42.42.5(pid=26580): Launched 22:51:38.580080 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:39.159087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26582): Launched 22:51:39.480213 run osmo-msc_10.42.42.6(pid=26583): Launched 22:51:39.659981 run osmo-stp_10.42.42.5(pid=26580): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26580)] 22:51:39.795569 run osmo-stp_10.42.42.5(pid=26580): stdout: | (launched: 2022-12-09_22:51:38.398896) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:39.931639 run osmo-stp_10.42.42.5(pid=26580): stderr: | 20221209225138590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225138591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225138591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225138591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225138594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225138594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225138594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:40.067711 run osmo-stp_10.42.42.5(pid=26580): stdout: | (launched: 2022-12-09_22:51:38.398896) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:40.195076 run osmo-stp_10.42.42.5(pid=26580): stderr: | 20221209225138590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225138591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225138591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225138591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225138594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225138594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225138594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:40.349217 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26580): Process ended prematurely: osmo-stp_10.42.42.5(pid=26580) [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26580)] [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:51:40.358642 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:51:40.386466 run osmo-hlr_10.42.42.2(pid=26577): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26577)] 22:51:40.436633 run osmo-hlr_10.42.42.2(pid=26577): stdout: | (launched: 2022-12-09_22:51:37.398456) 22:51:40.488179 run osmo-hlr_10.42.42.2(pid=26577): stderr: | 20221209225137598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225137598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225137599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225137599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225137599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225137599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225137611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225137619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225137620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225137620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:40.560472 run osmo-msc_10.42.42.6(pid=26583): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26583)] 22:51:40.610304 run osmo-msc_10.42.42.6(pid=26583): stdout: | (launched: 2022-12-09_22:51:39.422125) 22:51:40.661868 run osmo-msc_10.42.42.6(pid=26583): stderr: | 20221209225139744 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225139745 DLGLOBAL DEBUG validating counter group 0x7f200c095c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225139745 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225139745 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225139746 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225139746 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225139748 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225139748 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225139748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225139749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:40.713643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26576): Terminating (SIGTERM) 22:51:40.755204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26579): Terminating (SIGTERM) 22:51:40.796857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26582): Terminating (SIGTERM) 22:51:40.839180 --- ParallelTerminationStrategy: PID 26576 died... 22:51:40.859177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26576): Terminated: ok {rc=0} 22:51:40.905359 --- ParallelTerminationStrategy: PID 26579 died... 22:51:40.924632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26579): Terminated: ok {rc=0} 22:51:40.970800 --- ParallelTerminationStrategy: PID 26582 died... 22:51:40.990398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26582): Terminated: ok {rc=0} 22:51:41.078377 bus /sierra_3: Setting Powered False 22:51:42.178397 bus /sierra_3: Setting Powered False 22:51:43.295334 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:51:44.540222 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:51:44.547404 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:51:44.580074 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:51:44.606111 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:51:44.656837 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:51:44.689334 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:51:44.716236 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:51:45.270662 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:51:45.321924 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:45.333562 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:51:45.399663 tst mo_mt_call.py: using LAC 24216 22:51:45.523664 tst mo_mt_call.py: using RAC 246 22:51:45.646650 tst mo_mt_call.py: using CellId 24216 22:51:45.769386 tst mo_mt_call.py: using BVCI 24217 22:51:45.899115 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:45.912523 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:45.927189 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:45.943334 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:45.955544 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:45.967253 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:51:46.094911 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:51:46.216436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:46.754667 run create_hlr_db(pid=26588): Launched 22:51:46.910320 bus /sierra_2: Setting Powered False 22:51:47.970436 run create_hlr_db(pid=26588): Terminated: ok {rc=0} 22:51:48.408579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26590): Launched 22:51:48.726947 run osmo-hlr_10.42.42.2(pid=26591): Launched 22:51:48.848336 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:49.401548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26593): Launched 22:51:49.724038 run osmo-stp_10.42.42.5(pid=26594): Launched 22:51:49.845550 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:50.422394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26596): Launched 22:51:50.740654 run osmo-msc_10.42.42.6(pid=26597): Launched 22:51:50.918599 run osmo-stp_10.42.42.5(pid=26594): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26594)] 22:51:51.052938 run osmo-stp_10.42.42.5(pid=26594): stdout: | (launched: 2022-12-09_22:51:49.665477) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:51.187809 run osmo-stp_10.42.42.5(pid=26594): stderr: | 20221209225149860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225149860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225149861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225149861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225149861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225149862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225149862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:51.323176 run osmo-stp_10.42.42.5(pid=26594): stdout: | (launched: 2022-12-09_22:51:49.665477) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:51.449901 run osmo-stp_10.42.42.5(pid=26594): stderr: | 20221209225149860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225149860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225149861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225149861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225149861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225149862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225149862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:51.601695 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26594): Process ended prematurely: osmo-stp_10.42.42.5(pid=26594) [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26594)] [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:51:51.611310 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:51:51.639145 run osmo-hlr_10.42.42.2(pid=26591): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26591)] 22:51:51.689780 run osmo-hlr_10.42.42.2(pid=26591): stdout: | (launched: 2022-12-09_22:51:48.669156) 22:51:51.741690 run osmo-hlr_10.42.42.2(pid=26591): stderr: | 20221209225148867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225148867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225148867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225148867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225148867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225148867 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225148879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225148888 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225148888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225148888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:51.813830 run osmo-msc_10.42.42.6(pid=26597): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26597)] 22:51:51.863807 run osmo-msc_10.42.42.6(pid=26597): stdout: | (launched: 2022-12-09_22:51:50.682941) 22:51:51.915438 run osmo-msc_10.42.42.6(pid=26597): stderr: | 20221209225151008 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225151008 DLGLOBAL DEBUG validating counter group 0x7f5f9c95ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225151008 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225151008 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225151009 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225151009 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225151011 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225151011 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225151011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225151011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:51.967292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26590): Terminating (SIGTERM) 22:51:52.008743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26593): Terminating (SIGTERM) 22:51:52.050380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26596): Terminating (SIGTERM) 22:51:52.092485 --- ParallelTerminationStrategy: PID 26590 died... 22:51:52.112267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26590): Terminated: ok {rc=0} 22:51:52.158778 --- ParallelTerminationStrategy: PID 26593 died... 22:51:52.178519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26593): Terminated: ok {rc=0} 22:51:52.224604 --- ParallelTerminationStrategy: PID 26596 died... 22:51:52.244331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26596): Terminated: ok {rc=0} 22:51:52.332882 bus /sierra_3: Setting Powered False 22:51:53.432462 bus /sierra_3: Setting Powered False 22:51:54.550800 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:51:55.695631 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:55.707237 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:51:55.773797 tst mo_mt_call_osmux.py: using LAC 24217 22:51:55.893608 tst mo_mt_call_osmux.py: using RAC 247 22:51:56.020887 tst mo_mt_call_osmux.py: using CellId 24217 22:51:56.148021 tst mo_mt_call_osmux.py: using BVCI 24218 22:51:56.264407 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:56.276474 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:56.287875 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:56.299738 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:56.311707 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:56.323601 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:51:56.442334 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:51:56.560160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:57.057287 run create_hlr_db(pid=26599): Launched 22:51:57.188038 bus /sierra_2: Setting Powered False 22:51:58.251237 run create_hlr_db(pid=26599): Terminated: ok {rc=0} 22:51:58.681344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26601): Launched 22:51:58.982674 run osmo-hlr_10.42.42.2(pid=26602): Launched 22:51:59.097201 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:59.627182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26604): Launched 22:51:59.925677 run osmo-stp_10.42.42.5(pid=26605): Launched 22:52:00.039418 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:00.581784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26607): Launched 22:52:00.905727 run osmo-msc_10.42.42.6(pid=26608): Launched 22:52:01.339407 run osmo-stp_10.42.42.5(pid=26605): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26605)] 22:52:01.548448 run osmo-stp_10.42.42.5(pid=26605): stdout: | (launched: 2022-12-09_22:51:59.871490) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:01.687947 run osmo-stp_10.42.42.5(pid=26605): stderr: | 20221209225200043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225200043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225200043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225200044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225200044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225200044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225200044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:01.826862 run osmo-stp_10.42.42.5(pid=26605): stdout: | (launched: 2022-12-09_22:51:59.871490) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:01.960343 run osmo-stp_10.42.42.5(pid=26605): stderr: | 20221209225200043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225200043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225200043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225200044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225200044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225200044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225200044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:02.118782 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26605): Process ended prematurely: osmo-stp_10.42.42.5(pid=26605) [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26605)] [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:52:02.128914 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:52:02.159291 run osmo-hlr_10.42.42.2(pid=26602): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26602)] 22:52:02.210613 run osmo-hlr_10.42.42.2(pid=26602): stdout: | (launched: 2022-12-09_22:51:58.927919) 22:52:02.264326 run osmo-hlr_10.42.42.2(pid=26602): stderr: | 20221209225159104 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225159104 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225159104 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225159104 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225159104 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225159104 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225159116 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225159125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225159125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225159125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:02.337540 run osmo-msc_10.42.42.6(pid=26608): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26608)] 22:52:02.388082 run osmo-msc_10.42.42.6(pid=26608): stdout: | (launched: 2022-12-09_22:52:00.830522) 22:52:02.440553 run osmo-msc_10.42.42.6(pid=26608): stderr: | 20221209225201270 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225201270 DLGLOBAL DEBUG validating counter group 0x7fbdccb93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225201270 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225201270 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225201270 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225201271 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225201272 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225201273 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225201273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225201273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:02.492657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26601): Terminating (SIGTERM) 22:52:02.534798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26604): Terminating (SIGTERM) 22:52:02.576884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26607): Terminating (SIGTERM) 22:52:02.619368 --- ParallelTerminationStrategy: PID 26601 died... 22:52:02.639644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26601): Terminated: ok {rc=0} 22:52:02.686254 --- ParallelTerminationStrategy: PID 26604 died... 22:52:02.706064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26604): Terminated: ok {rc=0} 22:52:02.752450 --- ParallelTerminationStrategy: PID 26607 died... 22:52:02.772195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26607): Terminated: ok {rc=0} 22:52:02.860388 bus /sierra_3: Setting Powered False 22:52:03.958472 bus /sierra_3: Setting Powered False 22:52:05.073843 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:52:06.325700 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:52:06.334109 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:52:06.366681 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:52:06.393579 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:52:06.446687 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:52:06.479974 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:52:06.506177 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:52:07.063072 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:52:07.116505 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:07.128054 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:52:07.194347 tst mo_mt_call.py: using LAC 24218 22:52:07.319089 tst mo_mt_call.py: using RAC 248 22:52:07.442840 tst mo_mt_call.py: using CellId 24218 22:52:07.566910 tst mo_mt_call.py: using BVCI 24219 22:52:07.682452 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:07.694018 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:07.705406 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:07.716740 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:07.728208 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:07.739575 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:52:07.854657 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:52:07.972936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:08.438509 run create_hlr_db(pid=26614): Launched 22:52:08.553903 bus /sierra_2: Setting Powered False 22:52:09.613883 run create_hlr_db(pid=26614): Terminated: ok {rc=0} 22:52:10.051617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26616): Launched 22:52:10.372430 run osmo-hlr_10.42.42.2(pid=26617): Launched 22:52:10.494717 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:11.044129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26619): Launched 22:52:11.363156 run osmo-stp_10.42.42.5(pid=26620): Launched 22:52:11.485123 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:12.061177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26622): Launched 22:52:12.380561 run osmo-msc_10.42.42.6(pid=26623): Launched 22:52:12.559748 run osmo-stp_10.42.42.5(pid=26620): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26620)] 22:52:12.694065 run osmo-stp_10.42.42.5(pid=26620): stdout: | (launched: 2022-12-09_22:52:11.305362) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:12.829512 run osmo-stp_10.42.42.5(pid=26620): stderr: | 20221209225211495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225211495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225211496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225211496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225211498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225211498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225211498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:12.963922 run osmo-stp_10.42.42.5(pid=26620): stdout: | (launched: 2022-12-09_22:52:11.305362) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:13.090813 run osmo-stp_10.42.42.5(pid=26620): stderr: | 20221209225211495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225211495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225211496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225211496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225211498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225211498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225211498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:13.242871 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26620): Process ended prematurely: osmo-stp_10.42.42.5(pid=26620) [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26620)] [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:52:13.252098 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:52:13.279907 run osmo-hlr_10.42.42.2(pid=26617): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26617)] 22:52:13.330245 run osmo-hlr_10.42.42.2(pid=26617): stdout: | (launched: 2022-12-09_22:52:10.314533) 22:52:13.382064 run osmo-hlr_10.42.42.2(pid=26617): stderr: | 20221209225210515 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225210515 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225210515 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225210515 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225210515 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225210515 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225210532 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225210542 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225210542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225210542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:13.454413 run osmo-msc_10.42.42.6(pid=26623): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26623)] 22:52:13.504225 run osmo-msc_10.42.42.6(pid=26623): stdout: | (launched: 2022-12-09_22:52:12.322391) 22:52:13.555805 run osmo-msc_10.42.42.6(pid=26623): stderr: | 20221209225212644 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225212644 DLGLOBAL DEBUG validating counter group 0x7f1647176c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225212644 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225212644 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225212645 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225212645 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225212647 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225212647 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225212647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225212647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:13.607587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26616): Terminating (SIGTERM) 22:52:13.648827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26619): Terminating (SIGTERM) 22:52:13.690248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26622): Terminating (SIGTERM) 22:52:13.731917 --- ParallelTerminationStrategy: PID 26616 died... 22:52:13.751415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26616): Terminated: ok {rc=0} 22:52:13.797380 --- ParallelTerminationStrategy: PID 26619 died... 22:52:13.816545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26619): Terminated: ok {rc=0} 22:52:13.862404 --- ParallelTerminationStrategy: PID 26622 died... 22:52:13.881926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26622): Terminated: ok {rc=0} 22:52:13.968456 bus /sierra_3: Setting Powered False 22:52:15.067135 bus /sierra_3: Setting Powered False 22:52:16.182926 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:52:17.334276 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:17.346415 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:52:17.420176 tst mo_mt_call_osmux.py: using LAC 24219 22:52:17.546154 tst mo_mt_call_osmux.py: using RAC 249 22:52:17.663786 tst mo_mt_call_osmux.py: using CellId 24219 22:52:17.780218 tst mo_mt_call_osmux.py: using BVCI 24220 22:52:17.889120 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:17.900326 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:17.911176 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:17.922633 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:17.933988 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:17.945195 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:52:18.061628 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:52:18.184931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:18.650559 run create_hlr_db(pid=26625): Launched 22:52:18.765743 bus /sierra_2: Setting Powered False 22:52:19.826719 run create_hlr_db(pid=26625): Terminated: ok {rc=0} 22:52:20.247210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26627): Launched 22:52:20.549195 run osmo-hlr_10.42.42.2(pid=26628): Launched 22:52:20.675320 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:21.227706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26630): Launched 22:52:21.548362 run osmo-stp_10.42.42.5(pid=26631): Launched 22:52:21.670301 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:22.246990 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26633): Launched 22:52:22.566745 run osmo-msc_10.42.42.6(pid=26634): Launched 22:52:22.745540 run osmo-stp_10.42.42.5(pid=26631): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26631)] 22:52:22.880004 run osmo-stp_10.42.42.5(pid=26631): stdout: | (launched: 2022-12-09_22:52:21.490389) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:23.015463 run osmo-stp_10.42.42.5(pid=26631): stderr: | 20221209225221681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225221682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225221682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225221682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225221684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225221685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225221685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:23.150368 run osmo-stp_10.42.42.5(pid=26631): stdout: | (launched: 2022-12-09_22:52:21.490389) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:23.277354 run osmo-stp_10.42.42.5(pid=26631): stderr: | 20221209225221681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225221682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225221682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225221682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225221684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225221685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225221685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:23.430025 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26631): Process ended prematurely: osmo-stp_10.42.42.5(pid=26631) [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26631)] [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:52:23.439523 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:52:23.467075 run osmo-hlr_10.42.42.2(pid=26628): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26628)] 22:52:23.517072 run osmo-hlr_10.42.42.2(pid=26628): stdout: | (launched: 2022-12-09_22:52:20.493684) 22:52:23.568611 run osmo-hlr_10.42.42.2(pid=26628): stderr: | 20221209225220687 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225220687 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225220687 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225220687 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225220688 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225220688 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225220700 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225220709 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225220709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225220709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:23.641340 run osmo-msc_10.42.42.6(pid=26634): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26634)] 22:52:23.691318 run osmo-msc_10.42.42.6(pid=26634): stdout: | (launched: 2022-12-09_22:52:22.508826) 22:52:23.742757 run osmo-msc_10.42.42.6(pid=26634): stderr: | 20221209225222832 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225222832 DLGLOBAL DEBUG validating counter group 0x7f1b6b720c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225222832 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225222832 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225222833 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225222833 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225222835 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225222835 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225222835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225222835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:23.794499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26627): Terminating (SIGTERM) 22:52:23.836016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26630): Terminating (SIGTERM) 22:52:23.877764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26633): Terminating (SIGTERM) 22:52:23.919755 --- ParallelTerminationStrategy: PID 26627 died... 22:52:23.939320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26627): Terminated: ok {rc=0} 22:52:23.985604 --- ParallelTerminationStrategy: PID 26630 died... 22:52:24.004880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26630): Terminated: ok {rc=0} 22:52:24.051231 --- ParallelTerminationStrategy: PID 26633 died... 22:52:24.070817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26633): Terminated: ok {rc=0} 22:52:24.158860 bus /sierra_3: Setting Powered False 22:52:25.258745 bus /sierra_3: Setting Powered False 22:52:26.379003 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:52:27.624751 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:52:27.632066 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:52:27.663796 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:52:27.690439 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:52:27.742935 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:52:27.774706 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:52:27.801714 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:52:28.351203 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:52:28.399236 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:28.410409 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:52:28.475987 tst mo_mt_call.py: using LAC 24220 22:52:28.593478 tst mo_mt_call.py: using RAC 250 22:52:28.711909 tst mo_mt_call.py: using CellId 24220 22:52:28.829194 tst mo_mt_call.py: using BVCI 24221 22:52:28.938779 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:28.949964 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:28.960751 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:28.971987 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:28.982982 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:28.994445 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:52:29.114214 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:52:29.234414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:29.730042 run create_hlr_db(pid=26639): Launched 22:52:29.861125 bus /sierra_2: Setting Powered False 22:52:30.936707 run create_hlr_db(pid=26639): Terminated: ok {rc=0} 22:52:31.394439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26641): Launched 22:52:31.714810 run osmo-hlr_10.42.42.2(pid=26642): Launched 22:52:31.986295 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:32.639629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26644): Launched 22:52:32.939732 run osmo-stp_10.42.42.5(pid=26645): Launched 22:52:33.054444 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:33.594340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26647): Launched 22:52:33.892697 run osmo-msc_10.42.42.6(pid=26648): Launched 22:52:34.060623 run osmo-stp_10.42.42.5(pid=26645): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26645)] 22:52:34.187712 run osmo-stp_10.42.42.5(pid=26645): stdout: | (launched: 2022-12-09_22:52:32.885473) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:34.315527 run osmo-stp_10.42.42.5(pid=26645): stderr: | 20221209225233055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225233055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225233055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225233056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225233056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225233056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225233056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:34.440498 run osmo-stp_10.42.42.5(pid=26645): stdout: | (launched: 2022-12-09_22:52:32.885473) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:34.559502 run osmo-stp_10.42.42.5(pid=26645): stderr: | 20221209225233055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225233055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225233055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225233056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225233056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225233056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225233056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:34.701977 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26645): Process ended prematurely: osmo-stp_10.42.42.5(pid=26645) [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26645)] [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:52:34.710723 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:52:34.737457 run osmo-hlr_10.42.42.2(pid=26642): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26642)] 22:52:34.785254 run osmo-hlr_10.42.42.2(pid=26642): stdout: | (launched: 2022-12-09_22:52:31.652863) 22:52:34.834430 run osmo-hlr_10.42.42.2(pid=26642): stderr: | 20221209225231900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225231900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225231905 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225231905 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225231905 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225231905 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225231923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225231938 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225231938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225231938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:34.902890 run osmo-msc_10.42.42.6(pid=26648): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26648)] 22:52:34.950267 run osmo-msc_10.42.42.6(pid=26648): stdout: | (launched: 2022-12-09_22:52:33.838288) 22:52:34.999250 run osmo-msc_10.42.42.6(pid=26648): stderr: | 20221209225234112 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225234112 DLGLOBAL DEBUG validating counter group 0x7ffb31bc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225234112 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225234113 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225234113 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225234113 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225234115 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225234116 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225234116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225234116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:35.048608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26641): Terminating (SIGTERM) 22:52:35.087765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26644): Terminating (SIGTERM) 22:52:35.127089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26647): Terminating (SIGTERM) 22:52:35.166831 --- ParallelTerminationStrategy: PID 26641 died... 22:52:35.185837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26641): Terminated: ok {rc=0} 22:52:35.230461 --- ParallelTerminationStrategy: PID 26644 died... 22:52:35.248923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26644): Terminated: ok {rc=0} 22:52:35.293499 --- ParallelTerminationStrategy: PID 26647 died... 22:52:35.311848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26647): Terminated: ok {rc=0} 22:52:35.396035 bus /sierra_3: Setting Powered False 22:52:36.493313 bus /sierra_3: Setting Powered False 22:52:37.611409 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:52:38.755995 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:38.767561 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:52:38.833745 tst mo_mt_call_osmux.py: using LAC 24221 22:52:38.950571 tst mo_mt_call_osmux.py: using RAC 251 22:52:39.072823 tst mo_mt_call_osmux.py: using CellId 24221 22:52:39.190745 tst mo_mt_call_osmux.py: using BVCI 24222 22:52:39.301085 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:39.312177 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:39.323019 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:39.334187 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:39.345245 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:39.356347 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:52:39.475226 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:52:39.593849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:40.088828 run create_hlr_db(pid=26650): Launched 22:52:40.219093 bus /sierra_2: Setting Powered False 22:52:41.282331 run create_hlr_db(pid=26650): Terminated: ok {rc=0} 22:52:41.709523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26652): Launched 22:52:42.013304 run osmo-hlr_10.42.42.2(pid=26653): Launched 22:52:42.128767 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:42.646634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26655): Launched 22:52:42.948034 run osmo-stp_10.42.42.5(pid=26656): Launched 22:52:43.062733 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:43.604680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26658): Launched 22:52:43.904347 run osmo-msc_10.42.42.6(pid=26659): Launched 22:52:44.073127 run osmo-stp_10.42.42.5(pid=26656): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26656)] 22:52:44.200488 run osmo-stp_10.42.42.5(pid=26656): stdout: | (launched: 2022-12-09_22:52:42.893309) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:44.328295 run osmo-stp_10.42.42.5(pid=26656): stderr: | 20221209225243065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225243065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225243065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225243066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225243066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225243066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225243066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:44.453259 run osmo-stp_10.42.42.5(pid=26656): stdout: | (launched: 2022-12-09_22:52:42.893309) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:44.572440 run osmo-stp_10.42.42.5(pid=26656): stderr: | 20221209225243065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225243065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225243065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225243066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225243066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225243066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225243066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:44.715257 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26656): Process ended prematurely: osmo-stp_10.42.42.5(pid=26656) [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26656)] [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:52:44.724303 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:52:44.751151 run osmo-hlr_10.42.42.2(pid=26653): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26653)] 22:52:44.799124 run osmo-hlr_10.42.42.2(pid=26653): stdout: | (launched: 2022-12-09_22:52:41.958457) 22:52:44.848408 run osmo-hlr_10.42.42.2(pid=26653): stderr: | 20221209225242136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225242136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225242136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225242136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225242136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225242136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225242149 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225242158 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225242158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225242158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:44.917070 run osmo-msc_10.42.42.6(pid=26659): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26659)] 22:52:44.964361 run osmo-msc_10.42.42.6(pid=26659): stdout: | (launched: 2022-12-09_22:52:43.849439) 22:52:45.012840 run osmo-msc_10.42.42.6(pid=26659): stderr: | 20221209225244120 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225244120 DLGLOBAL DEBUG validating counter group 0x7ff005fcac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225244120 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225244121 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225244121 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225244121 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225244123 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225244123 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225244123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225244123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:45.062426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26652): Terminating (SIGTERM) 22:52:45.101887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26655): Terminating (SIGTERM) 22:52:45.141246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26658): Terminating (SIGTERM) 22:52:45.180815 --- ParallelTerminationStrategy: PID 26652 died... 22:52:45.199937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26652): Terminated: ok {rc=0} 22:52:45.244837 --- ParallelTerminationStrategy: PID 26655 died... 22:52:45.263862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26655): Terminated: ok {rc=0} 22:52:45.307853 --- ParallelTerminationStrategy: PID 26658 died... 22:52:45.326810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26658): Terminated: ok {rc=0} 22:52:45.411303 bus /sierra_3: Setting Powered False 22:52:46.507995 bus /sierra_3: Setting Powered False 22:52:47.627516 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:52:48.875460 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:52:48.882787 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:52:48.915617 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:52:48.942212 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:52:48.992821 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:52:49.025185 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:52:49.051161 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:52:49.603142 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:52:49.651145 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:49.662479 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:52:49.728838 tst mo_mt_call.py: using LAC 24222 22:52:49.847445 tst mo_mt_call.py: using RAC 252 22:52:49.966257 tst mo_mt_call.py: using CellId 24222 22:52:50.082915 tst mo_mt_call.py: using BVCI 24223 22:52:50.192609 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:50.203853 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:50.214925 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:50.226374 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:50.237860 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:50.249165 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:52:50.368713 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:52:50.491775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:50.989776 run create_hlr_db(pid=26664): Launched 22:52:51.121322 bus /sierra_2: Setting Powered False 22:52:52.184889 run create_hlr_db(pid=26664): Terminated: ok {rc=0} 22:52:52.614169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26666): Launched 22:52:52.914552 run osmo-hlr_10.42.42.2(pid=26667): Launched 22:52:53.028827 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:53.557676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26669): Launched 22:52:53.859608 run osmo-stp_10.42.42.5(pid=26670): Launched 22:52:53.973696 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:54.513349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26672): Launched 22:52:54.811433 run osmo-msc_10.42.42.6(pid=26673): Launched 22:52:54.979690 run osmo-stp_10.42.42.5(pid=26670): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26670)] 22:52:55.106936 run osmo-stp_10.42.42.5(pid=26670): stdout: | (launched: 2022-12-09_22:52:53.804824) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:55.234913 run osmo-stp_10.42.42.5(pid=26670): stderr: | 20221209225253975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225253975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225253975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225253976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225253976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225253976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225253976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:55.360054 run osmo-stp_10.42.42.5(pid=26670): stdout: | (launched: 2022-12-09_22:52:53.804824) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:55.479022 run osmo-stp_10.42.42.5(pid=26670): stderr: | 20221209225253975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225253975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225253975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225253976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225253976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225253976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225253976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:55.621656 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26670): Process ended prematurely: osmo-stp_10.42.42.5(pid=26670) [trial-2365↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26670)] [trial-2365↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:52:55.630713 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:52:55.657121 run osmo-hlr_10.42.42.2(pid=26667): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26667)] 22:52:55.705273 run osmo-hlr_10.42.42.2(pid=26667): stdout: | (launched: 2022-12-09_22:52:52.859763) 22:52:55.754701 run osmo-hlr_10.42.42.2(pid=26667): stderr: | 20221209225253035 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225253035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225253035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225253035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225253035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225253035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225253048 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225253059 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225253059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225253059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:55.823612 run osmo-msc_10.42.42.6(pid=26673): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26673)] 22:52:55.871222 run osmo-msc_10.42.42.6(pid=26673): stdout: | (launched: 2022-12-09_22:52:54.756884) 22:52:55.920500 run osmo-msc_10.42.42.6(pid=26673): stderr: | 20221209225255028 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225255028 DLGLOBAL DEBUG validating counter group 0x7fde8aec0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225255028 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225255028 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225255028 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225255029 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225255030 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225255031 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225255031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225255031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:55.970085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26666): Terminating (SIGTERM) 22:52:56.009896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26669): Terminating (SIGTERM) 22:52:56.049716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26672): Terminating (SIGTERM) 22:52:56.089883 --- ParallelTerminationStrategy: PID 26666 died... 22:52:56.109072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26666): Terminated: ok {rc=0} 22:52:56.153560 --- ParallelTerminationStrategy: PID 26669 died... 22:52:56.172265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26669): Terminated: ok {rc=0} 22:52:56.216603 --- ParallelTerminationStrategy: PID 26672 died... 22:52:56.235396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26672): Terminated: ok {rc=0} 22:52:56.320228 bus /sierra_3: Setting Powered False 22:52:57.417108 bus /sierra_3: Setting Powered False 22:52:58.532132 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:52:59.677952 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:59.689701 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:52:59.759882 tst mo_mt_call_osmux.py: using LAC 24223 22:52:59.875481 tst mo_mt_call_osmux.py: using RAC 253 22:52:59.991610 tst mo_mt_call_osmux.py: using CellId 24223 22:53:00.106943 tst mo_mt_call_osmux.py: using BVCI 24224 22:53:00.215339 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:00.226497 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:00.237523 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:00.248786 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:00.260059 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:00.271458 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:53:00.388689 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:53:00.508853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:01.036510 run create_hlr_db(pid=26675): Launched 22:53:01.189359 bus /sierra_2: Setting Powered False 22:53:02.286686 run create_hlr_db(pid=26675): Terminated: ok {rc=0} 22:53:02.762911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26688): Launched 22:53:03.085712 run osmo-hlr_10.42.42.2(pid=26689): Launched 22:53:03.315588 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:04.045823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26691): Launched 22:53:04.373703 run osmo-stp_10.42.42.5(pid=26692): Launched 22:53:04.616098 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:05.297862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26694): Launched 22:53:05.637691 run osmo-msc_10.42.42.6(pid=26696): Launched 22:53:05.986798 run osmo-stp_10.42.42.5(pid=26692): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26692)] 22:53:06.251130 run osmo-stp_10.42.42.5(pid=26692): stdout: | (launched: 2022-12-09_22:53:04.303536) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:06.525987 run osmo-stp_10.42.42.5(pid=26692): stderr: | 20221209225304594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225304594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225304594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225304605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225304605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225304605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225304606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:06.700060 run osmo-stp_10.42.42.5(pid=26692): stdout: | (launched: 2022-12-09_22:53:04.303536) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:06.823231 run osmo-stp_10.42.42.5(pid=26692): stderr: | 20221209225304594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225304594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225304594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225304605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225304605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225304605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225304606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:06.972802 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26692): Process ended prematurely: osmo-stp_10.42.42.5(pid=26692) [trial-2365↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26692)] [trial-2365↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:53:06.982905 tst mo_mt_call_osmux.py:8: Test FAILED (7.3 sec) 22:53:07.013787 run osmo-hlr_10.42.42.2(pid=26689): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26689)] 22:53:07.065361 run osmo-hlr_10.42.42.2(pid=26689): stdout: | (launched: 2022-12-09_22:53:03.014636) 22:53:07.117691 run osmo-hlr_10.42.42.2(pid=26689): stderr: | 20221209225303362 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225303362 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225303362 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225303362 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225303362 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225303362 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225303379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225303393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225303393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225303393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:07.190225 run osmo-msc_10.42.42.6(pid=26696): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26696)] 22:53:07.240907 run osmo-msc_10.42.42.6(pid=26696): stdout: | (launched: 2022-12-09_22:53:05.570017) 22:53:07.292593 run osmo-msc_10.42.42.6(pid=26696): stderr: | 20221209225306164 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225306164 DLGLOBAL DEBUG validating counter group 0x7fd660034c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225306164 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225306164 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225306164 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225306164 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225306166 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225306167 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225306167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225306167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:07.345127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26688): Terminating (SIGTERM) 22:53:07.387443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26691): Terminating (SIGTERM) 22:53:07.432077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26694): Terminating (SIGTERM) 22:53:07.476127 --- ParallelTerminationStrategy: PID 26688 died... 22:53:07.498255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26688): Terminated: ok {rc=0} 22:53:07.547225 --- ParallelTerminationStrategy: PID 26691 died... 22:53:07.567234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26691): Terminated: ok {rc=0} 22:53:07.615066 --- ParallelTerminationStrategy: PID 26694 died... 22:53:07.634865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26694): Terminated: ok {rc=0} 22:53:07.724062 bus /sierra_3: Setting Powered False 22:53:08.823818 bus /sierra_3: Setting Powered False 22:53:09.940799 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:53:11.273299 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:53:11.280816 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:53:11.329534 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 22:53:11.370300 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 22:53:11.441243 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:53:11.496389 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 22:53:11.541196 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 22:53:12.052702 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 22:53:12.107933 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:12.120302 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:53:12.170414 tst mo_mt_call.py: using LAC 24224 22:53:12.296278 tst mo_mt_call.py: using RAC 254 22:53:12.424257 tst mo_mt_call.py: using CellId 24224 22:53:12.551152 tst mo_mt_call.py: using BVCI 24225 22:53:12.671855 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:12.684694 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:12.697499 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:12.710201 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:12.723342 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:12.736889 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:53:12.862601 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:53:12.988103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:13.509293 run create_hlr_db(pid=26961): Launched 22:53:13.676142 bus /sierra_2: Setting Powered False 22:53:14.740135 run create_hlr_db(pid=26961): Terminated: ok {rc=0} 22:53:15.217873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26963): Launched 22:53:15.562093 run osmo-hlr_10.42.42.2(pid=26964): Launched 22:53:15.816690 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:16.562055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26966): Launched 22:53:16.971825 run osmo-stp_10.42.42.5(pid=26967): Launched 22:53:17.266518 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:18.089839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26969): Launched 22:53:18.485393 run osmo-msc_10.42.42.6(pid=26970): Launched 22:53:18.856280 run osmo-stp_10.42.42.5(pid=26967): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26967)] 22:53:19.142321 run osmo-stp_10.42.42.5(pid=26967): stdout: | (launched: 2022-12-09_22:53:16.899391) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:19.307554 run osmo-stp_10.42.42.5(pid=26967): stderr: | 20221209225317242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225317242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225317242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225317243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225317243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225317243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225317243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:19.447658 run osmo-stp_10.42.42.5(pid=26967): stdout: | (launched: 2022-12-09_22:53:16.899391) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:19.581219 run osmo-stp_10.42.42.5(pid=26967): stderr: | 20221209225317242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225317242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225317242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225317243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225317243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225317243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225317243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:19.738293 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26967): Process ended prematurely: osmo-stp_10.42.42.5(pid=26967) [trial-2365↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26967)] [trial-2365↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 22:53:19.748610 tst mo_mt_call.py:8: Test FAILED (7.7 sec) 22:53:19.780762 run osmo-hlr_10.42.42.2(pid=26964): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26964)] 22:53:19.833388 run osmo-hlr_10.42.42.2(pid=26964): stdout: | (launched: 2022-12-09_22:53:15.493651) 22:53:19.887776 run osmo-hlr_10.42.42.2(pid=26964): stderr: | 20221209225315811 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225315811 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225315811 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225315811 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225315811 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225315811 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225315834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225315848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225315849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225315849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:19.964166 run osmo-msc_10.42.42.6(pid=26970): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26970)] 22:53:20.016318 run osmo-msc_10.42.42.6(pid=26970): stdout: | (launched: 2022-12-09_22:53:18.419310) 22:53:20.071177 run osmo-msc_10.42.42.6(pid=26970): stderr: | 20221209225318928 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225318928 DLGLOBAL DEBUG validating counter group 0x7f216013bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225318928 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225318928 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225318933 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225318933 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225318935 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225318935 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225318935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225318935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:20.126082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26963): Terminating (SIGTERM) 22:53:20.171223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26966): Terminating (SIGTERM) 22:53:20.217384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26969): Terminating (SIGTERM) 22:53:20.263302 --- ParallelTerminationStrategy: PID 26963 died... 22:53:20.284256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26963): Terminated: ok {rc=0} 22:53:20.334724 --- ParallelTerminationStrategy: PID 26966 died... 22:53:20.355645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26966): Terminated: ok {rc=0} 22:53:20.405249 --- ParallelTerminationStrategy: PID 26969 died... 22:53:20.425478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26969): Terminated: ok {rc=0} 22:53:20.515058 bus /sierra_3: Setting Powered False 22:53:21.618815 bus /sierra_3: Setting Powered False 22:53:22.737068 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 22:53:23.889785 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:23.902666 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:53:23.955227 tst mo_mt_call_osmux.py: using LAC 24225 22:53:24.078396 tst mo_mt_call_osmux.py: using RAC 255 22:53:24.201357 tst mo_mt_call_osmux.py: using CellId 24225 22:53:24.322997 tst mo_mt_call_osmux.py: using BVCI 24226 22:53:24.438648 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:24.451192 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:24.463623 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:24.477733 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:24.489963 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:24.502825 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:53:24.626013 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:53:24.755911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:25.251595 run create_hlr_db(pid=26972): Launched 22:53:25.381539 bus /sierra_2: Setting Powered False 22:53:26.445705 run create_hlr_db(pid=26972): Terminated: ok {rc=0} 22:53:26.872259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26974): Launched 22:53:27.172810 run osmo-hlr_10.42.42.2(pid=26975): Launched 22:53:27.287360 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:27.816656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26977): Launched 22:53:28.117106 run osmo-stp_10.42.42.5(pid=26978): Launched 22:53:28.232116 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:28.772462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26980): Launched 22:53:29.073659 run osmo-msc_10.42.42.6(pid=26981): Launched 22:53:29.242387 run osmo-stp_10.42.42.5(pid=26978): ERR: Terminated: ERROR {rc=1} [trial-2365↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26978)] 22:53:29.380212 run osmo-stp_10.42.42.5(pid=26978): stdout: | (launched: 2022-12-09_22:53:28.062381) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:29.517020 run osmo-stp_10.42.42.5(pid=26978): stderr: | 20221209225328235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225328235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225328235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225328236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225328236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225328236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225328236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:29.651415 run osmo-stp_10.42.42.5(pid=26978): stdout: | (launched: 2022-12-09_22:53:28.062381) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:29.779628 run osmo-stp_10.42.42.5(pid=26978): stderr: | 20221209225328235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225328235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225328235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225328236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225328236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225328236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225328236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:29.932889 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26978): Process ended prematurely: osmo-stp_10.42.42.5(pid=26978) [trial-2365↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26978)] [trial-2365↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 22:53:29.942575 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:53:29.970724 run osmo-hlr_10.42.42.2(pid=26975): ERR: Terminated: ERROR {rc=237} [trial-2365↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26975)] 22:53:30.021367 run osmo-hlr_10.42.42.2(pid=26975): stdout: | (launched: 2022-12-09_22:53:27.118188) 22:53:30.073133 run osmo-hlr_10.42.42.2(pid=26975): stderr: | 20221209225327293 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225327293 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225327293 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225327293 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225327293 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225327293 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225327305 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225327314 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225327315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225327315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:30.145449 run osmo-msc_10.42.42.6(pid=26981): ERR: Terminated: ERROR {rc=2} [trial-2365↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26981)] 22:53:30.195512 run osmo-msc_10.42.42.6(pid=26981): stdout: | (launched: 2022-12-09_22:53:29.019075) 22:53:30.247840 run osmo-msc_10.42.42.6(pid=26981): stderr: | 20221209225329289 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225329289 DLGLOBAL DEBUG validating counter group 0x7faa4c55ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225329289 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225329289 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225329289 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225329289 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225329291 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225329291 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225329292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225329292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:30.299973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26974): Terminating (SIGTERM) 22:53:30.342046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26977): Terminating (SIGTERM) 22:53:30.383716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26980): Terminating (SIGTERM) 22:53:30.425675 --- ParallelTerminationStrategy: PID 26974 died... 22:53:30.445675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26974): Terminated: ok {rc=0} 22:53:30.492259 --- ParallelTerminationStrategy: PID 26977 died... 22:53:30.511791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26977): Terminated: ok {rc=0} 22:53:30.557767 --- ParallelTerminationStrategy: PID 26980 died... 22:53:30.577715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26980): Terminated: ok {rc=0} 22:53:30.665954 bus /sierra_3: Setting Powered False 22:53:31.762529 bus /sierra_3: Setting Powered False 22:53:32.878967 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 emergency:nanobts+band-900 --------------------------------------------------------------------- 22:53:34.137427 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:53:34.143257 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 22:53:34.175815 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 22:53:34.202666 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 22:53:34.287747 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 22:53:34.320238 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 22:53:34.347359 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 22:53:34.938677 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2365 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 22:53:34.943718 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:34.954740 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 22:53:35.002454 tst emergency_mo_mt_call.py: using LAC 24226 22:53:35.124637 tst emergency_mo_mt_call.py: using RAC 1 22:53:35.246461 tst emergency_mo_mt_call.py: using CellId 24226 22:53:35.368115 tst emergency_mo_mt_call.py: using BVCI 24227 22:53:35.475062 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:35.485948 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:35.496546 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:35.507734 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:35.518943 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:35.530392 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:35.648183 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:35.766028 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:36.252563 run create_hlr_db(pid=26986): Launched 22:53:36.380837 bus /sierra_2: Setting Powered False 22:53:37.443614 run create_hlr_db(pid=26986): Terminated: ok {rc=0} 22:53:37.865496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26988): Launched 22:53:38.163055 run osmo-hlr_10.42.42.2(pid=26989): Launched 22:53:38.275297 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:38.781866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26991): Launched 22:53:39.076829 run osmo-stp_10.42.42.5(pid=26992): Launched 22:53:39.199562 tst emergency_mo_mt_call.py: using MSISDN 7413 22:53:39.364278 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:39.897154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26994): Launched 22:53:40.192604 run osmo-msc_10.42.42.6(pid=26995): Launched 22:53:40.358740 run osmo-stp_10.42.42.5(pid=26992): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26992)] 22:53:40.484231 run osmo-stp_10.42.42.5(pid=26992): stdout: | (launched: 2022-12-09_22:53:39.022841) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:40.609764 run osmo-stp_10.42.42.5(pid=26992): stderr: | 20221209225339194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225339194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225339194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225339195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225339195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225339195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225339196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:40.733212 run osmo-stp_10.42.42.5(pid=26992): stdout: | (launched: 2022-12-09_22:53:39.022841) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:40.850912 run osmo-stp_10.42.42.5(pid=26992): stderr: | 20221209225339194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225339194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225339194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225339195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225339195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225339195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225339196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:40.992027 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26992): Process ended prematurely: osmo-stp_10.42.42.5(pid=26992) [trial-2365↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26992)] [trial-2365↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 22:53:41.000538 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 22:53:41.027316 run osmo-hlr_10.42.42.2(pid=26989): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26989)] 22:53:41.076115 run osmo-hlr_10.42.42.2(pid=26989): stdout: | (launched: 2022-12-09_22:53:38.109422) 22:53:41.125923 run osmo-hlr_10.42.42.2(pid=26989): stderr: | 20221209225338284 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225338284 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225338284 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225338284 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225338284 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225338284 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225338298 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225338306 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225338307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225338307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:41.195340 run osmo-msc_10.42.42.6(pid=26995): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26995)] 22:53:41.243493 run osmo-msc_10.42.42.6(pid=26995): stdout: | (launched: 2022-12-09_22:53:40.138797) 22:53:41.293237 run osmo-msc_10.42.42.6(pid=26995): stderr: | 20221209225340408 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225340408 DLGLOBAL DEBUG validating counter group 0x7f4b80f8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225340408 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225340408 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225340408 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225340408 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225340411 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225340411 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225340411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225340411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:41.343501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26988): Terminating (SIGTERM) 22:53:41.382997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26991): Terminating (SIGTERM) 22:53:41.423328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26994): Terminating (SIGTERM) 22:53:41.463597 --- ParallelTerminationStrategy: PID 26988 died... 22:53:41.482808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26988): Terminated: ok {rc=0} 22:53:41.527771 --- ParallelTerminationStrategy: PID 26991 died... 22:53:41.546536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26991): Terminated: ok {rc=0} 22:53:41.591332 --- ParallelTerminationStrategy: PID 26994 died... 22:53:41.610131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26994): Terminated: ok {rc=0} 22:53:41.696574 bus /sierra_3: Setting Powered False 22:53:42.799187 bus /sierra_3: Setting Powered False 22:53:43.916706 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 22:53:45.004878 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:45.016703 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 22:53:45.067050 tst emergency_preemptive_call.py: using LAC 24227 22:53:45.193701 tst emergency_preemptive_call.py: using RAC 2 22:53:45.317408 tst emergency_preemptive_call.py: using CellId 24227 22:53:45.445680 tst emergency_preemptive_call.py: using BVCI 24228 22:53:45.560724 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:45.572082 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:45.583268 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:45.594377 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:45.605498 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:45.616447 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:45.731424 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:45.854082 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:45.977343 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:46.093699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:46.582635 run create_hlr_db(pid=26997): Launched 22:53:46.730539 bus /sierra_2: Setting Powered False 22:53:47.789830 run create_hlr_db(pid=26997): Terminated: ok {rc=0} 22:53:48.203409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26999): Launched 22:53:48.499328 run osmo-hlr_10.42.42.2(pid=27000): Launched 22:53:48.612604 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:49.138889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27002): Launched 22:53:49.433900 run osmo-stp_10.42.42.5(pid=27003): Launched 22:53:49.560360 tst emergency_preemptive_call.py: using MSISDN 7414 22:53:49.712158 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:50.240397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27005): Launched 22:53:50.536433 run osmo-msc_10.42.42.6(pid=27006): Launched 22:53:50.702214 run osmo-stp_10.42.42.5(pid=27003): ERR: Terminated: ERROR {rc=1} [trial-2365↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27003)] 22:53:50.827166 run osmo-stp_10.42.42.5(pid=27003): stdout: | (launched: 2022-12-09_22:53:49.380002) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:50.952754 run osmo-stp_10.42.42.5(pid=27003): stderr: | 20221209225349548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225349549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225349549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225349550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225349550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225349550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225349550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:51.076059 run osmo-stp_10.42.42.5(pid=27003): stdout: | (launched: 2022-12-09_22:53:49.380002) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:51.193840 run osmo-stp_10.42.42.5(pid=27003): stderr: | 20221209225349548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225349549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225349549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225349550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225349550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225349550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225349550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:51.335325 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=27003): Process ended prematurely: osmo-stp_10.42.42.5(pid=27003) [trial-2365↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27003)] [trial-2365↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 22:53:51.343791 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 22:53:51.370040 run osmo-hlr_10.42.42.2(pid=27000): ERR: Terminated: ERROR {rc=237} [trial-2365↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27000)] 22:53:51.418953 run osmo-hlr_10.42.42.2(pid=27000): stdout: | (launched: 2022-12-09_22:53:48.445776) 22:53:51.468523 run osmo-hlr_10.42.42.2(pid=27000): stderr: | 20221209225348623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225348623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225348623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225348623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225348623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225348623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225348636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225348645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225348645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225348645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:51.537777 run osmo-msc_10.42.42.6(pid=27006): ERR: Terminated: ERROR {rc=2} [trial-2365↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27006)] 22:53:51.585891 run osmo-msc_10.42.42.6(pid=27006): stdout: | (launched: 2022-12-09_22:53:50.482238) 22:53:51.635436 run osmo-msc_10.42.42.6(pid=27006): stderr: | 20221209225350753 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225350753 DLGLOBAL DEBUG validating counter group 0x7fadf7539c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225350753 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225350753 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225350753 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225350754 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225350755 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225350756 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225350756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225350757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:51.685258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26999): Terminating (SIGTERM) 22:53:51.725604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27002): Terminating (SIGTERM) 22:53:51.765235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27005): Terminating (SIGTERM) 22:53:51.805313 --- ParallelTerminationStrategy: PID 26999 died... 22:53:51.825592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26999): Terminated: ok {rc=0} 22:53:51.870389 --- ParallelTerminationStrategy: PID 27002 died... 22:53:51.889301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27002): Terminated: ok {rc=0} 22:53:51.933799 --- ParallelTerminationStrategy: PID 27005 died... 22:53:51.952498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27005): Terminated: ok {rc=0} 22:53:52.036432 bus /sierra_9: Setting Powered False 22:53:53.135094 bus /sierra_9: Setting Powered False 22:53:54.250576 bus /sierra_8: Setting Powered False 22:53:55.349529 bus /sierra_8: Setting Powered False 22:53:56.467302 bus /sierra_3: Setting Powered False 22:53:57.566921 bus /sierra_3: Setting Powered False 22:53:58.683029 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:nanobts+band-900 --------------------------------------------------------------------- 22:53:59.959058 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:53:59.964152 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 22:53:59.997028 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 22:54:00.034879 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 22:54:00.119714 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 22:54:00.153548 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 22:54:00.193237 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 22:54:00.786971 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 22:54:00.845169 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:00.857460 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 22:54:00.911103 tst cs_paging_gprs_active.py: using LAC 24228 22:54:01.043159 tst cs_paging_gprs_active.py: using RAC 3 22:54:01.202501 tst cs_paging_gprs_active.py: using CellId 24228 22:54:01.347808 tst cs_paging_gprs_active.py: using BVCI 24229 22:54:01.495563 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:01.509857 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:01.521026 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:01.532682 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:01.543767 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:01.557385 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:01.571441 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:01.583497 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:01.596160 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:01.719759 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:01.838912 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:54:02.045851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:02.353738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27011): Launched 22:54:02.617949 run iperf3-srv_10.42.42.10(pid=27012): Launched 22:54:02.731182 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:54:02.932319 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:03.233964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27013): Launched 22:54:03.496173 run iperf3-srv_10.42.42.10(pid=27014): Launched 22:54:03.609423 tst cs_paging_gprs_active.py:38: start network... 22:54:03.810679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:04.276320 run create_hlr_db(pid=27015): Launched 22:54:04.392363 bus /sierra_2: Setting Powered False 22:54:05.452845 run create_hlr_db(pid=27015): Terminated: ok {rc=0} 22:54:05.892731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27017): Launched 22:54:06.214653 run osmo-hlr_10.42.42.2(pid=27018): Launched 22:54:06.337694 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:06.889531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27020): Launched 22:54:07.213458 run osmo-stp_10.42.42.5(pid=27021): Launched 22:54:07.337412 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:07.896670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27023): Launched 22:54:08.020319 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:08.291136 run patchelf(pid=27024): Launched 22:54:08.471485 run osmo-stp_10.42.42.5(pid=27021): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27021)] 22:54:08.607994 run osmo-stp_10.42.42.5(pid=27021): stdout: | (launched: 2022-12-09_22:54:07.154553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:08.745976 run osmo-stp_10.42.42.5(pid=27021): stderr: | 20221209225407347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225407347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225407347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225407348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225407348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225407348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225407348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:08.883777 run osmo-stp_10.42.42.5(pid=27021): stdout: | (launched: 2022-12-09_22:54:07.154553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:09.015616 run osmo-stp_10.42.42.5(pid=27021): stderr: | 20221209225407347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225407347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225407347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225407348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225407348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225407348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225407348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:09.171974 run patchelf(pid=27024): Terminating (SIGINT) 22:54:09.354283 run patchelf(pid=27024): Terminated: ok {rc=0} 22:54:09.485884 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27021): Process ended prematurely: osmo-stp_10.42.42.5(pid=27021) [trial-2365↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27021)] [trial-2365↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 22:54:09.495902 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:54:09.524426 run osmo-hlr_10.42.42.2(pid=27018): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27018)] 22:54:09.574228 run osmo-hlr_10.42.42.2(pid=27018): stdout: | (launched: 2022-12-09_22:54:06.156633) 22:54:09.625901 run osmo-hlr_10.42.42.2(pid=27018): stderr: | 20221209225406356 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225406356 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225406356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225406356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225406357 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225406357 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225406370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225406380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225406381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225406381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:09.678223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27011): Terminating (SIGTERM) 22:54:09.720076 run iperf3-srv_10.42.42.10(pid=27012): Terminating (SIGTERM) 22:54:09.761979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27013): Terminating (SIGTERM) 22:54:09.803902 run iperf3-srv_10.42.42.10(pid=27014): Terminating (SIGTERM) 22:54:09.845621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27017): Terminating (SIGTERM) 22:54:09.887552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27020): Terminating (SIGTERM) 22:54:09.929510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27023): Terminating (SIGTERM) 22:54:09.971867 --- ParallelTerminationStrategy: PID 27011 died... 22:54:09.991700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27011): Terminated: ok {rc=0} 22:54:10.038024 --- ParallelTerminationStrategy: PID 27012 died... 22:54:10.057441 run iperf3-srv_10.42.42.10(pid=27012): Terminated {rc=256} 22:54:10.103210 --- ParallelTerminationStrategy: PID 27013 died... 22:54:10.122731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27013): Terminated: ok {rc=0} 22:54:10.168437 --- ParallelTerminationStrategy: PID 27014 died... 22:54:10.187722 run iperf3-srv_10.42.42.10(pid=27014): Terminated {rc=256} 22:54:10.233500 --- ParallelTerminationStrategy: PID 27017 died... 22:54:10.253060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27017): Terminated: ok {rc=0} 22:54:10.298674 --- ParallelTerminationStrategy: PID 27020 died... 22:54:10.318432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27020): Terminated: ok {rc=0} 22:54:10.364495 --- ParallelTerminationStrategy: PID 27023 died... 22:54:10.384418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27023): Terminated: ok {rc=0} 22:54:10.471726 bus /gobi_0: Setting Powered False 22:54:11.570490 bus /gobi_0: Setting Powered False 22:54:12.687766 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 22:54:13.833554 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:13.844683 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 22:54:13.894679 tst iperf3.py: using LAC 24229 22:54:14.012856 tst iperf3.py: using RAC 4 22:54:14.130783 tst iperf3.py: using CellId 24229 22:54:14.250878 tst iperf3.py: using BVCI 24230 22:54:14.361440 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:14.371946 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:14.382413 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:14.393095 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:14.403550 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:14.414217 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:14.424789 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:14.435878 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:14.446744 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:14.567026 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:54:14.770107 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:15.071271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27025): Launched 22:54:15.334687 run iperf3-srv_10.42.42.10(pid=27026): Launched 22:54:15.448400 tst iperf3.py:8: start network... 22:54:15.650171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:16.138850 run create_hlr_db(pid=27027): Launched 22:54:16.288548 bus /gobi_6: Setting Powered False 22:54:17.351180 run create_hlr_db(pid=27027): Terminated: ok {rc=0} 22:54:17.798675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27029): Launched 22:54:18.119345 run osmo-hlr_10.42.42.2(pid=27030): Launched 22:54:18.243070 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:18.805976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27032): Launched 22:54:19.127219 run osmo-stp_10.42.42.5(pid=27033): Launched 22:54:19.245712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:19.766120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27035): Launched 22:54:19.882268 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:20.136313 run patchelf(pid=27036): Launched 22:54:20.305104 run osmo-stp_10.42.42.5(pid=27033): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27033)] 22:54:20.433848 run osmo-stp_10.42.42.5(pid=27033): stdout: | (launched: 2022-12-09_22:54:19.069071) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:20.563505 run osmo-stp_10.42.42.5(pid=27033): stderr: | 20221209225419238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225419238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225419239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225419239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225419240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225419240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225419240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:20.693079 run osmo-stp_10.42.42.5(pid=27033): stdout: | (launched: 2022-12-09_22:54:19.069071) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:20.816768 run osmo-stp_10.42.42.5(pid=27033): stderr: | 20221209225419238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225419238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225419239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225419239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225419240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225419240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225419240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:20.962941 run patchelf(pid=27036): Terminating (SIGINT) 22:54:21.134072 run patchelf(pid=27036): Terminated: ok {rc=0} 22:54:21.256818 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27033): Process ended prematurely: osmo-stp_10.42.42.5(pid=27033) [trial-2365↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27033)] [trial-2365↪gprs:nanobts+band-900↪iperf3.py:8] 22:54:21.266368 tst iperf3.py:8: Test FAILED (7.5 sec) 22:54:21.293464 run osmo-hlr_10.42.42.2(pid=27030): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27030)] 22:54:21.341797 run osmo-hlr_10.42.42.2(pid=27030): stdout: | (launched: 2022-12-09_22:54:18.061356) 22:54:21.391449 run osmo-hlr_10.42.42.2(pid=27030): stderr: | 20221209225418261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225418261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225418261 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225418261 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225418261 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225418261 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225418274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225418282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225418282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225418282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:21.441404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27025): Terminating (SIGTERM) 22:54:21.481024 run iperf3-srv_10.42.42.10(pid=27026): Terminating (SIGTERM) 22:54:21.521566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27029): Terminating (SIGTERM) 22:54:21.561697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27032): Terminating (SIGTERM) 22:54:21.602108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27035): Terminating (SIGTERM) 22:54:21.642193 --- ParallelTerminationStrategy: PID 27025 died... 22:54:21.661811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27025): Terminated: ok {rc=0} 22:54:21.706505 --- ParallelTerminationStrategy: PID 27026 died... 22:54:21.725154 run iperf3-srv_10.42.42.10(pid=27026): Terminated {rc=256} 22:54:21.769668 --- ParallelTerminationStrategy: PID 27029 died... 22:54:21.788352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27029): Terminated: ok {rc=0} 22:54:21.832615 --- ParallelTerminationStrategy: PID 27032 died... 22:54:21.851628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27032): Terminated: ok {rc=0} 22:54:21.895971 --- ParallelTerminationStrategy: PID 27035 died... 22:54:21.915106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27035): Terminated: ok {rc=0} 22:54:21.999484 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 22:54:23.148642 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.160334 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 22:54:23.210289 tst iperf3m4.py: using LAC 24230 22:54:23.338279 tst iperf3m4.py: using RAC 5 22:54:23.466356 tst iperf3m4.py: using CellId 24230 22:54:23.593895 tst iperf3m4.py: using BVCI 24231 22:54:23.711361 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.722555 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.733484 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.744200 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.755042 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.765981 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.777497 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.788265 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.799616 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:23.919566 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:24.038329 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:24.157751 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:24.273806 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:54:24.477401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:24.781346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27037): Launched 22:54:25.044233 run iperf3-srv_10.42.42.10(pid=27038): Launched 22:54:25.157815 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:54:25.359650 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:25.662388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27039): Launched 22:54:25.924178 run iperf3-srv_10.42.42.10(pid=27040): Launched 22:54:26.038044 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:54:26.239457 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:26.540921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27041): Launched 22:54:26.802754 run iperf3-srv_10.42.42.10(pid=27042): Launched 22:54:26.915718 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:54:27.116440 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:27.417553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27043): Launched 22:54:27.681862 run iperf3-srv_10.42.42.10(pid=27044): Launched 22:54:27.796152 tst iperf3m4.py:8: start network... 22:54:27.999043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:28.468377 run create_hlr_db(pid=27045): Launched 22:54:28.585249 bus /gobi_6: Setting Powered False 22:54:29.644837 run create_hlr_db(pid=27045): Terminated: ok {rc=0} 22:54:30.066341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27047): Launched 22:54:30.369709 run osmo-hlr_10.42.42.2(pid=27048): Launched 22:54:30.486273 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:31.043108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27050): Launched 22:54:31.477728 run osmo-stp_10.42.42.5(pid=27051): Launched 22:54:31.800508 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:32.382220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27053): Launched 22:54:32.498898 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:32.753519 run patchelf(pid=27054): Launched 22:54:32.923451 run osmo-stp_10.42.42.5(pid=27051): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27051)] 22:54:33.053297 run osmo-stp_10.42.42.5(pid=27051): stdout: | (launched: 2022-12-09_22:54:31.408865) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:33.184531 run osmo-stp_10.42.42.5(pid=27051): stderr: | 20221209225431630 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225431630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225431631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225431631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225431632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225431632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225431632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:33.315615 run osmo-stp_10.42.42.5(pid=27051): stdout: | (launched: 2022-12-09_22:54:31.408865) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:33.440684 run osmo-stp_10.42.42.5(pid=27051): stderr: | 20221209225431630 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225431630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225431631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225431631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225431632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225431632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225431632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:33.588700 run patchelf(pid=27054): Terminating (SIGINT) 22:54:33.762797 run patchelf(pid=27054): Terminated: ok {rc=0} 22:54:33.887601 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27051): Process ended prematurely: osmo-stp_10.42.42.5(pid=27051) [trial-2365↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27051)] [trial-2365↪gprs:nanobts+band-900↪iperf3m4.py:8] 22:54:33.897305 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:54:33.925484 run osmo-hlr_10.42.42.2(pid=27048): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27048)] 22:54:33.973652 run osmo-hlr_10.42.42.2(pid=27048): stdout: | (launched: 2022-12-09_22:54:30.313542) 22:54:34.023432 run osmo-hlr_10.42.42.2(pid=27048): stderr: | 20221209225430489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225430489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225430489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225430489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225430489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225430489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225430501 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225430509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225430510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225430510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:34.073576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27037): Terminating (SIGTERM) 22:54:34.113310 run iperf3-srv_10.42.42.10(pid=27038): Terminating (SIGTERM) 22:54:34.152677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27039): Terminating (SIGTERM) 22:54:34.193200 run iperf3-srv_10.42.42.10(pid=27040): Terminating (SIGTERM) 22:54:34.232498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27041): Terminating (SIGTERM) 22:54:34.272892 run iperf3-srv_10.42.42.10(pid=27042): Terminating (SIGTERM) 22:54:34.312747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27043): Terminating (SIGTERM) 22:54:34.352820 run iperf3-srv_10.42.42.10(pid=27044): Terminating (SIGTERM) 22:54:34.392683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27047): Terminating (SIGTERM) 22:54:34.432725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27050): Terminating (SIGTERM) 22:54:34.473189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27053): Terminating (SIGTERM) 22:54:34.513639 --- ParallelTerminationStrategy: PID 27037 died... 22:54:34.533099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27037): Terminated: ok {rc=0} 22:54:34.577409 --- ParallelTerminationStrategy: PID 27038 died... 22:54:34.595679 run iperf3-srv_10.42.42.10(pid=27038): Terminated {rc=256} 22:54:34.640026 --- ParallelTerminationStrategy: PID 27039 died... 22:54:34.658766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27039): Terminated: ok {rc=0} 22:54:34.702874 --- ParallelTerminationStrategy: PID 27040 died... 22:54:34.721436 run iperf3-srv_10.42.42.10(pid=27040): Terminated {rc=256} 22:54:34.765740 --- ParallelTerminationStrategy: PID 27041 died... 22:54:34.784414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27041): Terminated: ok {rc=0} 22:54:34.828336 --- ParallelTerminationStrategy: PID 27042 died... 22:54:34.846999 run iperf3-srv_10.42.42.10(pid=27042): Terminated {rc=256} 22:54:34.890920 --- ParallelTerminationStrategy: PID 27043 died... 22:54:34.909520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27043): Terminated: ok {rc=0} 22:54:34.953366 --- ParallelTerminationStrategy: PID 27044 died... 22:54:34.971803 run iperf3-srv_10.42.42.10(pid=27044): Terminated {rc=256} 22:54:35.015822 --- ParallelTerminationStrategy: PID 27047 died... 22:54:35.034461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27047): Terminated: ok {rc=0} 22:54:35.078013 --- ParallelTerminationStrategy: PID 27050 died... 22:54:35.097195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27050): Terminated: ok {rc=0} 22:54:35.141139 --- ParallelTerminationStrategy: PID 27053 died... 22:54:35.159784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27053): Terminated: ok {rc=0} 22:54:35.245593 bus /gobi_4: Setting Powered False 22:54:36.344926 bus /gobi_4: Setting Powered False 22:54:37.460885 bus /gobi_1: Setting Powered False 22:54:38.559831 bus /gobi_1: Setting Powered False 22:54:39.671966 bus /gobi_0: Setting Powered False 22:54:40.769713 bus /gobi_0: Setting Powered False 22:54:41.886409 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-900 ping.py ---------------------------------------------- 22:54:42.989506 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.001290 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 22:54:43.050226 tst ping.py: using LAC 24231 22:54:43.176196 tst ping.py: using RAC 6 22:54:43.298739 tst ping.py: using CellId 24231 22:54:43.422648 tst ping.py: using BVCI 24232 22:54:43.539204 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.550432 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.561561 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.572485 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.583370 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.594272 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.605357 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.616599 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:43.734704 tst ping.py:19: start network... 22:54:43.947548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:44.434636 run create_hlr_db(pid=27056): Launched 22:54:44.562579 bus /gobi_6: Setting Powered False 22:54:45.625696 run create_hlr_db(pid=27056): Terminated: ok {rc=0} 22:54:46.081893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27058): Launched 22:54:46.412219 run osmo-hlr_10.42.42.2(pid=27059): Launched 22:54:46.688175 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:47.329678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27061): Launched 22:54:47.627019 run osmo-stp_10.42.42.5(pid=27062): Launched 22:54:47.741217 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:48.250277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27064): Launched 22:54:48.365210 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:48.615099 run patchelf(pid=27065): Launched 22:54:48.780354 run osmo-stp_10.42.42.5(pid=27062): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27062)] 22:54:48.906053 run osmo-stp_10.42.42.5(pid=27062): stdout: | (launched: 2022-12-09_22:54:47.572604) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:49.033383 run osmo-stp_10.42.42.5(pid=27062): stderr: | 20221209225447742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225447742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225447742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225447743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225447743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225447743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225447743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:49.160689 run osmo-stp_10.42.42.5(pid=27062): stdout: | (launched: 2022-12-09_22:54:47.572604) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:49.281464 run osmo-stp_10.42.42.5(pid=27062): stderr: | 20221209225447742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225447742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225447742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225447743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225447743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225447743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225447743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:49.425256 run patchelf(pid=27065): Terminating (SIGINT) 22:54:49.592700 run patchelf(pid=27065): Terminated: ok {rc=0} 22:54:49.712532 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27062): Process ended prematurely: osmo-stp_10.42.42.5(pid=27062) [trial-2365↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27062)] [trial-2365↪gprs:nanobts+band-900↪ping.py:22] 22:54:49.721429 tst ping.py:22: Test FAILED (6.7 sec) 22:54:49.748738 run osmo-hlr_10.42.42.2(pid=27059): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27059)] 22:54:49.796440 run osmo-hlr_10.42.42.2(pid=27059): stdout: | (launched: 2022-12-09_22:54:46.349844) 22:54:49.845824 run osmo-hlr_10.42.42.2(pid=27059): stderr: | 20221209225446603 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225446603 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225446603 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225446603 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225446603 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225446603 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225446618 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225446626 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225446626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225446626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:49.895513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27058): Terminating (SIGTERM) 22:54:49.935124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27061): Terminating (SIGTERM) 22:54:49.974229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27064): Terminating (SIGTERM) 22:54:50.014398 --- ParallelTerminationStrategy: PID 27058 died... 22:54:50.033582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27058): Terminated: ok {rc=0} 22:54:50.078093 --- ParallelTerminationStrategy: PID 27061 died... 22:54:50.096926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27061): Terminated: ok {rc=0} 22:54:50.141096 --- ParallelTerminationStrategy: PID 27064 died... 22:54:50.159810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27064): Terminated: ok {rc=0} 22:54:50.245542 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 22:54:51.333065 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.344266 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 22:54:51.394136 tst ping_idle_ping.py: using LAC 24232 22:54:51.512884 tst ping_idle_ping.py: using RAC 7 22:54:51.642194 tst ping_idle_ping.py: using CellId 24232 22:54:51.768271 tst ping_idle_ping.py: using BVCI 24233 22:54:51.882819 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.894125 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.905266 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.916296 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.927099 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.938000 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.949533 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.960488 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:52.075456 tst ping_idle_ping.py:24: start network... 22:54:52.275061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:52.734828 run create_hlr_db(pid=27066): Launched 22:54:52.849588 bus /gobi_6: Setting Powered False 22:54:53.909644 run create_hlr_db(pid=27066): Terminated: ok {rc=0} 22:54:54.323125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27068): Launched 22:54:54.618634 run osmo-hlr_10.42.42.2(pid=27069): Launched 22:54:54.732155 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:55.243605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27071): Launched 22:54:55.540085 run osmo-stp_10.42.42.5(pid=27072): Launched 22:54:55.653567 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:56.166059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27074): Launched 22:54:56.288652 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:56.556396 run patchelf(pid=27075): Launched 22:54:56.733050 run osmo-stp_10.42.42.5(pid=27072): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27072)] 22:54:56.867691 run osmo-stp_10.42.42.5(pid=27072): stdout: | (launched: 2022-12-09_22:54:55.486021) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:57.003700 run osmo-stp_10.42.42.5(pid=27072): stderr: | 20221209225455656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225455656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225455657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225455657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225455658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225455658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225455658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:57.139835 run osmo-stp_10.42.42.5(pid=27072): stdout: | (launched: 2022-12-09_22:54:55.486021) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:57.268823 run osmo-stp_10.42.42.5(pid=27072): stderr: | 20221209225455656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225455656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225455657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225455657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225455658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225455658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225455658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:57.423174 run patchelf(pid=27075): Terminating (SIGINT) 22:54:57.603362 run patchelf(pid=27075): Terminated: ok {rc=0} 22:54:57.732534 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27072): Process ended prematurely: osmo-stp_10.42.42.5(pid=27072) [trial-2365↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27072)] [trial-2365↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 22:54:57.742190 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:54:57.770400 run osmo-hlr_10.42.42.2(pid=27069): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27069)] 22:54:57.820775 run osmo-hlr_10.42.42.2(pid=27069): stdout: | (launched: 2022-12-09_22:54:54.564822) 22:54:57.872411 run osmo-hlr_10.42.42.2(pid=27069): stderr: | 20221209225454741 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225454741 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225454741 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225454741 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225454741 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225454741 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225454752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225454761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225454761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225454761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:57.924419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27068): Terminating (SIGTERM) 22:54:57.966089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27071): Terminating (SIGTERM) 22:54:58.007642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27074): Terminating (SIGTERM) 22:54:58.049668 --- ParallelTerminationStrategy: PID 27068 died... 22:54:58.069904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27068): Terminated: ok {rc=0} 22:54:58.116255 --- ParallelTerminationStrategy: PID 27071 died... 22:54:58.135895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27071): Terminated: ok {rc=0} 22:54:58.181669 --- ParallelTerminationStrategy: PID 27074 died... 22:54:58.201221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27074): Terminated: ok {rc=0} 22:54:58.289032 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 22:54:59.595381 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:54:59.602474 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:54:59.635513 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:54:59.674566 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:54:59.762497 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:54:59.795263 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:54:59.834719 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:55:00.436749 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:55:00.488263 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:00.499450 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:00.552604 tst cs_paging_gprs_active.py: using LAC 24233 22:55:00.677597 tst cs_paging_gprs_active.py: using RAC 8 22:55:00.802857 tst cs_paging_gprs_active.py: using CellId 24233 22:55:00.962789 tst cs_paging_gprs_active.py: using BVCI 24234 22:55:01.104056 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:01.119038 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:01.133498 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:01.150575 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:01.166095 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:01.184176 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:01.200735 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:01.216621 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:01.230576 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:01.366468 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:01.494877 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:55:01.727873 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:02.058795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27084): Launched 22:55:02.398118 run iperf3-srv_10.42.42.10(pid=27085): Launched 22:55:02.518955 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:55:02.736154 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:03.059213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27086): Launched 22:55:03.338648 run iperf3-srv_10.42.42.10(pid=27087): Launched 22:55:03.460217 tst cs_paging_gprs_active.py:38: start network... 22:55:03.676681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:04.176903 run create_hlr_db(pid=27088): Launched 22:55:04.308503 bus /gobi_6: Setting Powered False 22:55:05.372824 run create_hlr_db(pid=27088): Terminated: ok {rc=0} 22:55:05.819116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27090): Launched 22:55:06.141749 run osmo-hlr_10.42.42.2(pid=27091): Launched 22:55:06.264401 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:06.816833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27093): Launched 22:55:07.139280 run osmo-stp_10.42.42.5(pid=27094): Launched 22:55:07.262427 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:07.817436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27096): Launched 22:55:07.942846 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:08.217199 run patchelf(pid=27097): Launched 22:55:08.398313 run osmo-stp_10.42.42.5(pid=27094): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27094)] 22:55:08.535167 run osmo-stp_10.42.42.5(pid=27094): stdout: | (launched: 2022-12-09_22:55:07.080577) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:08.673404 run osmo-stp_10.42.42.5(pid=27094): stderr: | 20221209225507272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225507272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225507272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225507273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225507275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225507275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225507275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:08.811347 run osmo-stp_10.42.42.5(pid=27094): stdout: | (launched: 2022-12-09_22:55:07.080577) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:08.943622 run osmo-stp_10.42.42.5(pid=27094): stderr: | 20221209225507272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225507272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225507272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225507273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225507275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225507275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225507275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:09.100228 run patchelf(pid=27097): Terminating (SIGINT) 22:55:09.282218 run patchelf(pid=27097): Terminated: ok {rc=0} 22:55:09.413853 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27094): Process ended prematurely: osmo-stp_10.42.42.5(pid=27094) [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27094)] [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:55:09.424043 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 22:55:09.452546 run osmo-hlr_10.42.42.2(pid=27091): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27091)] 22:55:09.502298 run osmo-hlr_10.42.42.2(pid=27091): stdout: | (launched: 2022-12-09_22:55:06.083223) 22:55:09.553818 run osmo-hlr_10.42.42.2(pid=27091): stderr: | 20221209225506281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225506281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225506281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225506281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225506281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225506282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225506294 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225506302 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225506302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225506302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:09.605808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27084): Terminating (SIGTERM) 22:55:09.647339 run iperf3-srv_10.42.42.10(pid=27085): Terminating (SIGTERM) 22:55:09.688793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27086): Terminating (SIGTERM) 22:55:09.730567 run iperf3-srv_10.42.42.10(pid=27087): Terminating (SIGTERM) 22:55:09.772108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27090): Terminating (SIGTERM) 22:55:09.813826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27093): Terminating (SIGTERM) 22:55:09.855415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27096): Terminating (SIGTERM) 22:55:09.897433 --- ParallelTerminationStrategy: PID 27084 died... 22:55:09.917601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27084): Terminated: ok {rc=0} 22:55:09.963849 --- ParallelTerminationStrategy: PID 27085 died... 22:55:09.983228 run iperf3-srv_10.42.42.10(pid=27085): Terminated {rc=256} 22:55:10.028907 --- ParallelTerminationStrategy: PID 27086 died... 22:55:10.048569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27086): Terminated: ok {rc=0} 22:55:10.094386 --- ParallelTerminationStrategy: PID 27087 died... 22:55:10.113809 run iperf3-srv_10.42.42.10(pid=27087): Terminated {rc=256} 22:55:10.159497 --- ParallelTerminationStrategy: PID 27090 died... 22:55:10.178961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27090): Terminated: ok {rc=0} 22:55:10.224878 --- ParallelTerminationStrategy: PID 27093 died... 22:55:10.244795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27093): Terminated: ok {rc=0} 22:55:10.290844 --- ParallelTerminationStrategy: PID 27096 died... 22:55:10.310388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27096): Terminated: ok {rc=0} 22:55:10.397722 bus /gobi_0: Setting Powered False 22:55:11.497211 bus /gobi_0: Setting Powered False 22:55:12.612623 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:55:13.755571 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.767095 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:13.818544 tst iperf3.py: using LAC 24234 22:55:13.939329 tst iperf3.py: using RAC 9 22:55:14.057713 tst iperf3.py: using CellId 24234 22:55:14.182897 tst iperf3.py: using BVCI 24235 22:55:14.293527 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:14.304374 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:14.315216 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:14.326333 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:14.337296 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:14.348019 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:14.359212 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:14.370004 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:14.382422 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:14.497634 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:55:14.701189 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:15.004547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27098): Launched 22:55:15.267753 run iperf3-srv_10.42.42.10(pid=27099): Launched 22:55:15.381624 tst iperf3.py:8: start network... 22:55:15.583643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:16.058321 run create_hlr_db(pid=27100): Launched 22:55:16.204042 bus /gobi_6: Setting Powered False 22:55:17.274195 run create_hlr_db(pid=27100): Terminated: ok {rc=0} 22:55:17.695112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27102): Launched 22:55:17.997487 run osmo-hlr_10.42.42.2(pid=27103): Launched 22:55:18.114284 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:18.647785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27105): Launched 22:55:18.948431 run osmo-stp_10.42.42.5(pid=27106): Launched 22:55:19.063914 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:19.582282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27108): Launched 22:55:19.697833 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:19.951848 run patchelf(pid=27109): Launched 22:55:20.121529 run osmo-stp_10.42.42.5(pid=27106): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27106)] 22:55:20.250194 run osmo-stp_10.42.42.5(pid=27106): stdout: | (launched: 2022-12-09_22:55:18.893768) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:20.379784 run osmo-stp_10.42.42.5(pid=27106): stderr: | 20221209225519063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225519063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225519064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225519064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225519065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225519065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225519065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:20.509561 run osmo-stp_10.42.42.5(pid=27106): stdout: | (launched: 2022-12-09_22:55:18.893768) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:20.633488 run osmo-stp_10.42.42.5(pid=27106): stderr: | 20221209225519063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225519063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225519064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225519064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225519065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225519065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225519065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:20.779746 run patchelf(pid=27109): Terminating (SIGINT) 22:55:20.950875 run patchelf(pid=27109): Terminated: ok {rc=0} 22:55:21.073615 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27106): Process ended prematurely: osmo-stp_10.42.42.5(pid=27106) [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27106)] [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 22:55:21.082950 tst iperf3.py:8: Test FAILED (7.4 sec) 22:55:21.110462 run osmo-hlr_10.42.42.2(pid=27103): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27103)] 22:55:21.158279 run osmo-hlr_10.42.42.2(pid=27103): stdout: | (launched: 2022-12-09_22:55:17.942392) 22:55:21.207488 run osmo-hlr_10.42.42.2(pid=27103): stderr: | 20221209225518116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225518116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225518117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225518117 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225518117 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225518117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225518128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225518137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225518137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225518137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:21.257303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27098): Terminating (SIGTERM) 22:55:21.296935 run iperf3-srv_10.42.42.10(pid=27099): Terminating (SIGTERM) 22:55:21.336403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27102): Terminating (SIGTERM) 22:55:21.376052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27105): Terminating (SIGTERM) 22:55:21.415491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27108): Terminating (SIGTERM) 22:55:21.455258 --- ParallelTerminationStrategy: PID 27098 died... 22:55:21.474624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27098): Terminated: ok {rc=0} 22:55:21.519487 --- ParallelTerminationStrategy: PID 27099 died... 22:55:21.538013 run iperf3-srv_10.42.42.10(pid=27099): Terminated {rc=256} 22:55:21.581900 --- ParallelTerminationStrategy: PID 27102 died... 22:55:21.600361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27102): Terminated: ok {rc=0} 22:55:21.644910 --- ParallelTerminationStrategy: PID 27105 died... 22:55:21.663787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27105): Terminated: ok {rc=0} 22:55:21.707633 --- ParallelTerminationStrategy: PID 27108 died... 22:55:21.726165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27108): Terminated: ok {rc=0} 22:55:21.808730 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:55:22.951924 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:22.963428 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:23.012582 tst iperf3m4.py: using LAC 24235 22:55:23.131492 tst iperf3m4.py: using RAC 10 22:55:23.257876 tst iperf3m4.py: using CellId 24235 22:55:23.383749 tst iperf3m4.py: using BVCI 24236 22:55:23.502889 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.514395 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.525759 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.537024 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.548165 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.559251 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.570528 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.581668 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.592759 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:23.714834 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:23.834536 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:23.950719 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:24.071671 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:55:24.289234 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:24.612053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27110): Launched 22:55:24.892013 run iperf3-srv_10.42.42.10(pid=27111): Launched 22:55:25.013245 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:55:25.229892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:25.553234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27112): Launched 22:55:25.832749 run iperf3-srv_10.42.42.10(pid=27113): Launched 22:55:25.953813 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:55:26.171293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:26.494651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27114): Launched 22:55:26.775355 run iperf3-srv_10.42.42.10(pid=27115): Launched 22:55:26.895992 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:55:27.112722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:27.436092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27116): Launched 22:55:27.716057 run iperf3-srv_10.42.42.10(pid=27117): Launched 22:55:27.836771 tst iperf3m4.py:8: start network... 22:55:28.053798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:28.547895 run create_hlr_db(pid=27118): Launched 22:55:28.664701 bus /gobi_6: Setting Powered False 22:55:29.725442 run create_hlr_db(pid=27118): Terminated: ok {rc=0} 22:55:30.145661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27120): Launched 22:55:30.447263 run osmo-hlr_10.42.42.2(pid=27121): Launched 22:55:30.563015 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:31.095230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27123): Launched 22:55:31.445572 run osmo-stp_10.42.42.5(pid=27124): Launched 22:55:31.629538 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:32.459686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27126): Launched 22:55:32.583721 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:32.855019 run patchelf(pid=27127): Launched 22:55:33.034473 run osmo-stp_10.42.42.5(pid=27124): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27124)] 22:55:33.171356 run osmo-stp_10.42.42.5(pid=27124): stdout: | (launched: 2022-12-09_22:55:31.379568) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:33.309369 run osmo-stp_10.42.42.5(pid=27124): stderr: | 20221209225531747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225531747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225531747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225531751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225531754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225531754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225531754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:33.447694 run osmo-stp_10.42.42.5(pid=27124): stdout: | (launched: 2022-12-09_22:55:31.379568) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:33.579596 run osmo-stp_10.42.42.5(pid=27124): stderr: | 20221209225531747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225531747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225531747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225531751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225531754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225531754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225531754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:33.735794 run patchelf(pid=27127): Terminating (SIGINT) 22:55:33.917546 run patchelf(pid=27127): Terminated: ok {rc=0} 22:55:34.048065 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27124): Process ended prematurely: osmo-stp_10.42.42.5(pid=27124) [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27124)] [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 22:55:34.058272 tst iperf3m4.py:8: Test FAILED (11.1 sec) 22:55:34.087060 run osmo-hlr_10.42.42.2(pid=27121): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27121)] 22:55:34.137153 run osmo-hlr_10.42.42.2(pid=27121): stdout: | (launched: 2022-12-09_22:55:30.392030) 22:55:34.188344 run osmo-hlr_10.42.42.2(pid=27121): stderr: | 20221209225530568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225530568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225530569 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225530569 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225530569 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225530569 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225530606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225530616 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225530616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225530616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:34.240292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27110): Terminating (SIGTERM) 22:55:34.282077 run iperf3-srv_10.42.42.10(pid=27111): Terminating (SIGTERM) 22:55:34.323691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27112): Terminating (SIGTERM) 22:55:34.365443 run iperf3-srv_10.42.42.10(pid=27113): Terminating (SIGTERM) 22:55:34.407438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27114): Terminating (SIGTERM) 22:55:34.450576 run iperf3-srv_10.42.42.10(pid=27115): Terminating (SIGTERM) 22:55:34.492174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27116): Terminating (SIGTERM) 22:55:34.534082 run iperf3-srv_10.42.42.10(pid=27117): Terminating (SIGTERM) 22:55:34.576069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27120): Terminating (SIGTERM) 22:55:34.617736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27123): Terminating (SIGTERM) 22:55:34.659307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27126): Terminating (SIGTERM) 22:55:34.701380 --- ParallelTerminationStrategy: PID 27110 died... 22:55:34.721467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27110): Terminated: ok {rc=0} 22:55:34.767755 --- ParallelTerminationStrategy: PID 27111 died... 22:55:34.787488 run iperf3-srv_10.42.42.10(pid=27111): Terminated {rc=256} 22:55:34.833329 --- ParallelTerminationStrategy: PID 27112 died... 22:55:34.852727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27112): Terminated: ok {rc=0} 22:55:34.898619 --- ParallelTerminationStrategy: PID 27113 died... 22:55:34.918277 run iperf3-srv_10.42.42.10(pid=27113): Terminated {rc=256} 22:55:34.964227 --- ParallelTerminationStrategy: PID 27114 died... 22:55:34.983918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27114): Terminated: ok {rc=0} 22:55:35.029813 --- ParallelTerminationStrategy: PID 27115 died... 22:55:35.049364 run iperf3-srv_10.42.42.10(pid=27115): Terminated {rc=256} 22:55:35.095306 --- ParallelTerminationStrategy: PID 27116 died... 22:55:35.114932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27116): Terminated: ok {rc=0} 22:55:35.160754 --- ParallelTerminationStrategy: PID 27117 died... 22:55:35.180437 run iperf3-srv_10.42.42.10(pid=27117): Terminated {rc=256} 22:55:35.226167 --- ParallelTerminationStrategy: PID 27120 died... 22:55:35.245765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27120): Terminated: ok {rc=0} 22:55:35.291630 --- ParallelTerminationStrategy: PID 27123 died... 22:55:35.311325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27123): Terminated: ok {rc=0} 22:55:35.357425 --- ParallelTerminationStrategy: PID 27126 died... 22:55:35.377164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27126): Terminated: ok {rc=0} 22:55:35.465863 bus /gobi_4: Setting Powered False 22:55:36.564109 bus /gobi_4: Setting Powered False 22:55:37.680188 bus /gobi_1: Setting Powered False 22:55:38.779367 bus /gobi_1: Setting Powered False 22:55:39.896493 bus /gobi_0: Setting Powered False 22:55:40.995023 bus /gobi_0: Setting Powered False 22:55:42.112232 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 22:55:43.215006 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.226683 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:43.276128 tst ping.py: using LAC 24236 22:55:43.394345 tst ping.py: using RAC 11 22:55:43.510713 tst ping.py: using CellId 24236 22:55:43.626508 tst ping.py: using BVCI 24237 22:55:43.735466 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.746587 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.757678 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.768711 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.779577 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.790749 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.801934 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.812508 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:43.927383 tst ping.py:19: start network... 22:55:44.125793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:44.584650 run create_hlr_db(pid=27128): Launched 22:55:44.698103 bus /gobi_6: Setting Powered False 22:55:45.758051 run create_hlr_db(pid=27128): Terminated: ok {rc=0} 22:55:46.243062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27130): Launched 22:55:46.578448 run osmo-hlr_10.42.42.2(pid=27131): Launched 22:55:46.813734 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:47.523438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27133): Launched 22:55:47.819292 run osmo-stp_10.42.42.5(pid=27134): Launched 22:55:47.932575 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:48.443223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27136): Launched 22:55:48.557575 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:48.808016 run patchelf(pid=27137): Launched 22:55:48.973618 run osmo-stp_10.42.42.5(pid=27134): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27134)] 22:55:49.099713 run osmo-stp_10.42.42.5(pid=27134): stdout: | (launched: 2022-12-09_22:55:47.765578) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:49.227595 run osmo-stp_10.42.42.5(pid=27134): stderr: | 20221209225547936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225547936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225547936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225547937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225547937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225547937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225547937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:49.356105 run osmo-stp_10.42.42.5(pid=27134): stdout: | (launched: 2022-12-09_22:55:47.765578) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:49.478244 run osmo-stp_10.42.42.5(pid=27134): stderr: | 20221209225547936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225547936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225547936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225547937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225547937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225547937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225547937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:49.622753 run patchelf(pid=27137): Terminating (SIGINT) 22:55:49.791306 run patchelf(pid=27137): Terminated: ok {rc=0} 22:55:49.912305 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27134): Process ended prematurely: osmo-stp_10.42.42.5(pid=27134) [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27134)] [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 22:55:49.921342 tst ping.py:22: Test FAILED (6.7 sec) 22:55:49.948471 run osmo-hlr_10.42.42.2(pid=27131): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27131)] 22:55:49.996544 run osmo-hlr_10.42.42.2(pid=27131): stdout: | (launched: 2022-12-09_22:55:46.509561) 22:55:50.045964 run osmo-hlr_10.42.42.2(pid=27131): stderr: | 20221209225546975 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225546975 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225546975 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225546975 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225546975 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225546975 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225547002 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225547019 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225547019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225547019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:50.095783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27130): Terminating (SIGTERM) 22:55:50.135933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27133): Terminating (SIGTERM) 22:55:50.175863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27136): Terminating (SIGTERM) 22:55:50.216690 --- ParallelTerminationStrategy: PID 27130 died... 22:55:50.239515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27130): Terminated: ok {rc=0} 22:55:50.286362 --- ParallelTerminationStrategy: PID 27133 died... 22:55:50.306138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27133): Terminated: ok {rc=0} 22:55:50.352814 --- ParallelTerminationStrategy: PID 27136 died... 22:55:50.372828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27136): Terminated: ok {rc=0} 22:55:50.461706 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:55:51.549161 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:51.561289 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:51.623111 tst ping_idle_ping.py: using LAC 24237 22:55:51.749401 tst ping_idle_ping.py: using RAC 12 22:55:51.873487 tst ping_idle_ping.py: using CellId 24237 22:55:51.997440 tst ping_idle_ping.py: using BVCI 24238 22:55:52.113532 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:52.124914 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:52.136241 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:52.147624 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:52.158935 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:52.170236 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:52.181884 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:52.193173 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:52.312845 tst ping_idle_ping.py:24: start network... 22:55:52.528520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:53.020727 run create_hlr_db(pid=27138): Launched 22:55:53.150005 bus /gobi_6: Setting Powered False 22:55:54.213870 run create_hlr_db(pid=27138): Terminated: ok {rc=0} 22:55:54.639837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27140): Launched 22:55:54.936877 run osmo-hlr_10.42.42.2(pid=27141): Launched 22:55:55.050443 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:55.574730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27143): Launched 22:55:55.870738 run osmo-stp_10.42.42.5(pid=27144): Launched 22:55:55.984120 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:56.495354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27146): Launched 22:55:56.609354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:56.859034 run patchelf(pid=27147): Launched 22:55:57.024577 run osmo-stp_10.42.42.5(pid=27144): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27144)] 22:55:57.150560 run osmo-stp_10.42.42.5(pid=27144): stdout: | (launched: 2022-12-09_22:55:55.816576) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:57.279111 run osmo-stp_10.42.42.5(pid=27144): stderr: | 20221209225555984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225555984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225555984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225555985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225555985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225555985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225555985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:57.406756 run osmo-stp_10.42.42.5(pid=27144): stdout: | (launched: 2022-12-09_22:55:55.816576) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:57.528290 run osmo-stp_10.42.42.5(pid=27144): stderr: | 20221209225555984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225555984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225555984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225555985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225555985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225555985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225555985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:57.671883 run patchelf(pid=27147): Terminating (SIGINT) 22:55:57.840636 run patchelf(pid=27147): Terminated: ok {rc=0} 22:55:57.961759 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27144): Process ended prematurely: osmo-stp_10.42.42.5(pid=27144) [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27144)] [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 22:55:57.970713 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:55:57.998223 run osmo-hlr_10.42.42.2(pid=27141): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27141)] 22:55:58.045951 run osmo-hlr_10.42.42.2(pid=27141): stdout: | (launched: 2022-12-09_22:55:54.882770) 22:55:58.095662 run osmo-hlr_10.42.42.2(pid=27141): stderr: | 20221209225555059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225555059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225555059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225555059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225555059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225555059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225555072 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225555080 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225555080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225555080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:58.145467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27140): Terminating (SIGTERM) 22:55:58.185100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27143): Terminating (SIGTERM) 22:55:58.224861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27146): Terminating (SIGTERM) 22:55:58.264714 --- ParallelTerminationStrategy: PID 27140 died... 22:55:58.284215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27140): Terminated: ok {rc=0} 22:55:58.329108 --- ParallelTerminationStrategy: PID 27143 died... 22:55:58.347985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27143): Terminated: ok {rc=0} 22:55:58.392494 --- ParallelTerminationStrategy: PID 27146 died... 22:55:58.411781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27146): Terminated: ok {rc=0} 22:55:58.498494 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:55:59.802635 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:55:59.809359 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:55:59.841659 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:55:59.879536 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:55:59.963349 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:55:59.995279 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:56:00.033323 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:56:00.630754 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:56:00.679329 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:00.690274 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:00.754322 tst cs_paging_gprs_active.py: using LAC 24238 22:56:00.878765 tst cs_paging_gprs_active.py: using RAC 13 22:56:01.008762 tst cs_paging_gprs_active.py: using CellId 24238 22:56:01.132031 tst cs_paging_gprs_active.py: using BVCI 24239 22:56:01.280147 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.294572 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.306092 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.318192 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.330090 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.342094 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.354784 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.366770 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.379935 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:01.503919 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:01.645784 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:56:01.881293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:02.222827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27151): Launched 22:56:02.513385 run iperf3-srv_10.42.42.10(pid=27152): Launched 22:56:02.636458 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:56:02.856558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:03.182804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27153): Launched 22:56:03.464414 run iperf3-srv_10.42.42.10(pid=27154): Launched 22:56:03.585648 tst cs_paging_gprs_active.py:38: start network... 22:56:03.802670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:04.300608 run create_hlr_db(pid=27155): Launched 22:56:04.432833 bus /gobi_6: Setting Powered False 22:56:05.497174 run create_hlr_db(pid=27155): Terminated: ok {rc=0} 22:56:05.928119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27157): Launched 22:56:06.232030 run osmo-hlr_10.42.42.2(pid=27158): Launched 22:56:06.348258 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:06.881403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27160): Launched 22:56:07.187199 run osmo-stp_10.42.42.5(pid=27161): Launched 22:56:07.302034 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:07.824281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27163): Launched 22:56:07.941559 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:08.196369 run patchelf(pid=27164): Launched 22:56:08.366436 run osmo-stp_10.42.42.5(pid=27161): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27161)] 22:56:08.495843 run osmo-stp_10.42.42.5(pid=27161): stdout: | (launched: 2022-12-09_22:56:07.131771) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:08.625787 run osmo-stp_10.42.42.5(pid=27161): stderr: | 20221209225607302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225607302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225607303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225607303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225607303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225607304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225607304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:08.755733 run osmo-stp_10.42.42.5(pid=27161): stdout: | (launched: 2022-12-09_22:56:07.131771) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:08.880018 run osmo-stp_10.42.42.5(pid=27161): stderr: | 20221209225607302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225607302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225607303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225607303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225607303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225607304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225607304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:09.027070 run patchelf(pid=27164): Terminating (SIGINT) 22:56:09.198445 run patchelf(pid=27164): Terminated: ok {rc=0} 22:56:09.321926 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27161): Process ended prematurely: osmo-stp_10.42.42.5(pid=27161) [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27161)] [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:56:09.331219 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:56:09.358906 run osmo-hlr_10.42.42.2(pid=27158): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27158)] 22:56:09.406595 run osmo-hlr_10.42.42.2(pid=27158): stdout: | (launched: 2022-12-09_22:56:06.176449) 22:56:09.456050 run osmo-hlr_10.42.42.2(pid=27158): stderr: | 20221209225606354 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225606354 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225606354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225606354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225606354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225606354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225606366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225606377 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225606377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225606377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:09.505872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27151): Terminating (SIGTERM) 22:56:09.545276 run iperf3-srv_10.42.42.10(pid=27152): Terminating (SIGTERM) 22:56:09.585163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27153): Terminating (SIGTERM) 22:56:09.624736 run iperf3-srv_10.42.42.10(pid=27154): Terminating (SIGTERM) 22:56:09.664205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27157): Terminating (SIGTERM) 22:56:09.703818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27160): Terminating (SIGTERM) 22:56:09.743437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27163): Terminating (SIGTERM) 22:56:09.783273 --- ParallelTerminationStrategy: PID 27151 died... 22:56:09.802513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27151): Terminated: ok {rc=0} 22:56:09.846989 --- ParallelTerminationStrategy: PID 27152 died... 22:56:09.865994 run iperf3-srv_10.42.42.10(pid=27152): Terminated {rc=256} 22:56:09.910127 --- ParallelTerminationStrategy: PID 27153 died... 22:56:09.928725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27153): Terminated: ok {rc=0} 22:56:09.972576 --- ParallelTerminationStrategy: PID 27154 died... 22:56:09.991419 run iperf3-srv_10.42.42.10(pid=27154): Terminated {rc=256} 22:56:10.035682 --- ParallelTerminationStrategy: PID 27157 died... 22:56:10.054286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27157): Terminated: ok {rc=0} 22:56:10.098844 --- ParallelTerminationStrategy: PID 27160 died... 22:56:10.117592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27160): Terminated: ok {rc=0} 22:56:10.161861 --- ParallelTerminationStrategy: PID 27163 died... 22:56:10.180275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27163): Terminated: ok {rc=0} 22:56:10.266812 bus /gobi_0: Setting Powered False 22:56:11.367875 bus /gobi_0: Setting Powered False 22:56:12.484907 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:56:13.633654 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.645671 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:13.719535 tst iperf3.py: using LAC 24239 22:56:13.845014 tst iperf3.py: using RAC 14 22:56:13.969918 tst iperf3.py: using CellId 24239 22:56:14.095477 tst iperf3.py: using BVCI 24240 22:56:14.211873 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:14.223232 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:14.234426 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:14.245556 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:14.256615 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:14.267925 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:14.279113 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:14.290155 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:14.301425 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:14.420694 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:56:14.638726 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:14.961810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27165): Launched 22:56:15.242440 run iperf3-srv_10.42.42.10(pid=27166): Launched 22:56:15.363713 tst iperf3.py:8: start network... 22:56:15.581518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:16.091185 run create_hlr_db(pid=27167): Launched 22:56:16.252276 bus /gobi_6: Setting Powered False 22:56:17.327114 run create_hlr_db(pid=27167): Terminated: ok {rc=0} 22:56:17.774317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27169): Launched 22:56:18.095694 run osmo-hlr_10.42.42.2(pid=27170): Launched 22:56:18.219109 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:18.773296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27172): Launched 22:56:19.093824 run osmo-stp_10.42.42.5(pid=27173): Launched 22:56:19.215991 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:19.769542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27175): Launched 22:56:19.894132 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:20.168373 run patchelf(pid=27176): Launched 22:56:20.347819 run osmo-stp_10.42.42.5(pid=27173): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27173)] 22:56:20.485823 run osmo-stp_10.42.42.5(pid=27173): stdout: | (launched: 2022-12-09_22:56:19.035234) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:20.624231 run osmo-stp_10.42.42.5(pid=27173): stderr: | 20221209225619227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225619228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225619228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225619228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225619229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225619229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225619229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:20.762207 run osmo-stp_10.42.42.5(pid=27173): stdout: | (launched: 2022-12-09_22:56:19.035234) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:20.893852 run osmo-stp_10.42.42.5(pid=27173): stderr: | 20221209225619227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225619228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225619228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225619228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225619229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225619229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225619229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:21.049984 run patchelf(pid=27176): Terminating (SIGINT) 22:56:21.232178 run patchelf(pid=27176): Terminated: ok {rc=0} 22:56:21.363308 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27173): Process ended prematurely: osmo-stp_10.42.42.5(pid=27173) [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27173)] [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 22:56:21.373477 tst iperf3.py:8: Test FAILED (7.8 sec) 22:56:21.402042 run osmo-hlr_10.42.42.2(pid=27170): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27170)] 22:56:21.452202 run osmo-hlr_10.42.42.2(pid=27170): stdout: | (launched: 2022-12-09_22:56:18.037027) 22:56:21.503872 run osmo-hlr_10.42.42.2(pid=27170): stderr: | 20221209225618237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225618237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225618237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225618237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225618237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225618237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225618250 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225618260 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225618260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225618260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:21.556037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27165): Terminating (SIGTERM) 22:56:21.597746 run iperf3-srv_10.42.42.10(pid=27166): Terminating (SIGTERM) 22:56:21.639340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27169): Terminating (SIGTERM) 22:56:21.680998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27172): Terminating (SIGTERM) 22:56:21.722649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27175): Terminating (SIGTERM) 22:56:21.764610 --- ParallelTerminationStrategy: PID 27165 died... 22:56:21.784761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27165): Terminated: ok {rc=0} 22:56:21.831320 --- ParallelTerminationStrategy: PID 27166 died... 22:56:21.850802 run iperf3-srv_10.42.42.10(pid=27166): Terminated {rc=256} 22:56:21.897050 --- ParallelTerminationStrategy: PID 27169 died... 22:56:21.916739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27169): Terminated: ok {rc=0} 22:56:21.963021 --- ParallelTerminationStrategy: PID 27172 died... 22:56:21.982880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27172): Terminated: ok {rc=0} 22:56:22.028810 --- ParallelTerminationStrategy: PID 27175 died... 22:56:22.048755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27175): Terminated: ok {rc=0} 22:56:22.136292 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:56:23.287493 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.299451 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:23.366371 tst iperf3m4.py: using LAC 24240 22:56:23.490909 tst iperf3m4.py: using RAC 15 22:56:23.615611 tst iperf3m4.py: using CellId 24240 22:56:23.740214 tst iperf3m4.py: using BVCI 24241 22:56:23.857149 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.868432 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.879681 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.890817 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.901876 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.912941 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.924200 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.935246 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.946560 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:24.062592 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:24.185686 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:24.303645 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:24.429524 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:56:24.632466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:24.935510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27177): Launched 22:56:25.198983 run iperf3-srv_10.42.42.10(pid=27178): Launched 22:56:25.312678 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:56:25.514904 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:25.817397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27179): Launched 22:56:26.082518 run iperf3-srv_10.42.42.10(pid=27180): Launched 22:56:26.196198 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:56:26.398294 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:26.701856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27181): Launched 22:56:26.964900 run iperf3-srv_10.42.42.10(pid=27182): Launched 22:56:27.078842 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:56:27.280610 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:27.583736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27183): Launched 22:56:27.846628 run iperf3-srv_10.42.42.10(pid=27184): Launched 22:56:27.959993 tst iperf3m4.py:8: start network... 22:56:28.162094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:28.628764 run create_hlr_db(pid=27185): Launched 22:56:28.745371 bus /gobi_6: Setting Powered False 22:56:29.806046 run create_hlr_db(pid=27185): Terminated: ok {rc=0} 22:56:30.247013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27187): Launched 22:56:30.574292 run osmo-hlr_10.42.42.2(pid=27188): Launched 22:56:30.698575 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:31.337715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27190): Launched 22:56:31.666898 run osmo-stp_10.42.42.5(pid=27191): Launched 22:56:31.911606 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:32.575163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27193): Launched 22:56:32.692692 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:32.949182 run patchelf(pid=27194): Launched 22:56:33.118028 run osmo-stp_10.42.42.5(pid=27191): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27191)] 22:56:33.246882 run osmo-stp_10.42.42.5(pid=27191): stdout: | (launched: 2022-12-09_22:56:31.601200) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:33.376237 run osmo-stp_10.42.42.5(pid=27191): stderr: | 20221209225631902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225631903 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225631903 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225631903 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225631904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225631904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225631904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:33.505876 run osmo-stp_10.42.42.5(pid=27191): stdout: | (launched: 2022-12-09_22:56:31.601200) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:33.629361 run osmo-stp_10.42.42.5(pid=27191): stderr: | 20221209225631902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225631903 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225631903 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225631903 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225631904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225631904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225631904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:33.775036 run patchelf(pid=27194): Terminating (SIGINT) 22:56:33.946513 run patchelf(pid=27194): Terminated: ok {rc=0} 22:56:34.069385 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27191): Process ended prematurely: osmo-stp_10.42.42.5(pid=27191) [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27191)] [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:56:34.078892 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:56:34.107267 run osmo-hlr_10.42.42.2(pid=27188): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27188)] 22:56:34.155125 run osmo-hlr_10.42.42.2(pid=27188): stdout: | (launched: 2022-12-09_22:56:30.514878) 22:56:34.204392 run osmo-hlr_10.42.42.2(pid=27188): stderr: | 20221209225630714 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225630714 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225630714 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225630715 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225630715 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225630715 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225630728 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225630737 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225630738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225630738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:34.254451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27177): Terminating (SIGTERM) 22:56:34.294247 run iperf3-srv_10.42.42.10(pid=27178): Terminating (SIGTERM) 22:56:34.333989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27179): Terminating (SIGTERM) 22:56:34.373859 run iperf3-srv_10.42.42.10(pid=27180): Terminating (SIGTERM) 22:56:34.413479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27181): Terminating (SIGTERM) 22:56:34.453200 run iperf3-srv_10.42.42.10(pid=27182): Terminating (SIGTERM) 22:56:34.492845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27183): Terminating (SIGTERM) 22:56:34.532826 run iperf3-srv_10.42.42.10(pid=27184): Terminating (SIGTERM) 22:56:34.572755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27187): Terminating (SIGTERM) 22:56:34.612772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27190): Terminating (SIGTERM) 22:56:34.652651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27193): Terminating (SIGTERM) 22:56:34.692744 --- ParallelTerminationStrategy: PID 27177 died... 22:56:34.711500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27177): Terminated: ok {rc=0} 22:56:34.755809 --- ParallelTerminationStrategy: PID 27178 died... 22:56:34.774518 run iperf3-srv_10.42.42.10(pid=27178): Terminated {rc=256} 22:56:34.818421 --- ParallelTerminationStrategy: PID 27179 died... 22:56:34.837169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27179): Terminated: ok {rc=0} 22:56:34.881324 --- ParallelTerminationStrategy: PID 27180 died... 22:56:34.899991 run iperf3-srv_10.42.42.10(pid=27180): Terminated {rc=256} 22:56:34.944528 --- ParallelTerminationStrategy: PID 27181 died... 22:56:34.963095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27181): Terminated: ok {rc=0} 22:56:35.007540 --- ParallelTerminationStrategy: PID 27182 died... 22:56:35.026210 run iperf3-srv_10.42.42.10(pid=27182): Terminated {rc=256} 22:56:35.070751 --- ParallelTerminationStrategy: PID 27183 died... 22:56:35.089538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27183): Terminated: ok {rc=0} 22:56:35.133769 --- ParallelTerminationStrategy: PID 27184 died... 22:56:35.152433 run iperf3-srv_10.42.42.10(pid=27184): Terminated {rc=256} 22:56:35.197222 --- ParallelTerminationStrategy: PID 27187 died... 22:56:35.215847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27187): Terminated: ok {rc=0} 22:56:35.260116 --- ParallelTerminationStrategy: PID 27190 died... 22:56:35.278970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27190): Terminated: ok {rc=0} 22:56:35.323253 --- ParallelTerminationStrategy: PID 27193 died... 22:56:35.341913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27193): Terminated: ok {rc=0} 22:56:35.428280 bus /gobi_4: Setting Powered False 22:56:36.528916 bus /gobi_4: Setting Powered False 22:56:37.641112 bus /gobi_1: Setting Powered False 22:56:38.740159 bus /gobi_1: Setting Powered False 22:56:39.859512 bus /gobi_0: Setting Powered False 22:56:40.959868 bus /gobi_0: Setting Powered False 22:56:42.077199 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:56:43.180924 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:43.193083 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:43.262059 tst ping.py: using LAC 24241 22:56:43.387424 tst ping.py: using RAC 16 22:56:43.513956 tst ping.py: using CellId 24241 22:56:43.638702 tst ping.py: using BVCI 24242 22:56:43.752853 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:43.764273 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:43.775467 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:43.787031 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:43.798270 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:43.809686 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:43.821147 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:43.832365 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:43.951540 tst ping.py:19: start network... 22:56:44.165495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:44.656253 run create_hlr_db(pid=27195): Launched 22:56:44.786273 bus /gobi_6: Setting Powered False 22:56:45.851054 run create_hlr_db(pid=27195): Terminated: ok {rc=0} 22:56:46.343116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27197): Launched 22:56:46.660490 run osmo-hlr_10.42.42.2(pid=27198): Launched 22:56:46.847618 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:47.574183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27200): Launched 22:56:47.870381 run osmo-stp_10.42.42.5(pid=27201): Launched 22:56:47.983786 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:48.495205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27203): Launched 22:56:48.609703 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:48.861268 run patchelf(pid=27204): Launched 22:56:49.027629 run osmo-stp_10.42.42.5(pid=27201): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27201)] 22:56:49.154115 run osmo-stp_10.42.42.5(pid=27201): stdout: | (launched: 2022-12-09_22:56:47.816500) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:49.282666 run osmo-stp_10.42.42.5(pid=27201): stderr: | 20221209225647987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225647987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225647987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225647988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225647988 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225647988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225647988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:49.410963 run osmo-stp_10.42.42.5(pid=27201): stdout: | (launched: 2022-12-09_22:56:47.816500) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:49.532838 run osmo-stp_10.42.42.5(pid=27201): stderr: | 20221209225647987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225647987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225647987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225647988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225647988 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225647988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225647988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:49.676920 run patchelf(pid=27204): Terminating (SIGINT) 22:56:49.846577 run patchelf(pid=27204): Terminated: ok {rc=0} 22:56:49.968453 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27201): Process ended prematurely: osmo-stp_10.42.42.5(pid=27201) [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27201)] [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 22:56:49.977584 tst ping.py:22: Test FAILED (6.8 sec) 22:56:50.005685 run osmo-hlr_10.42.42.2(pid=27198): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27198)] 22:56:50.053823 run osmo-hlr_10.42.42.2(pid=27198): stdout: | (launched: 2022-12-09_22:56:46.600076) 22:56:50.103721 run osmo-hlr_10.42.42.2(pid=27198): stderr: | 20221209225646906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225646906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225646906 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225646906 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225646906 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225646907 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225646920 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225646932 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225646934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225646938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:50.153740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27197): Terminating (SIGTERM) 22:56:50.193796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27200): Terminating (SIGTERM) 22:56:50.234058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27203): Terminating (SIGTERM) 22:56:50.274292 --- ParallelTerminationStrategy: PID 27197 died... 22:56:50.294094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27197): Terminated: ok {rc=0} 22:56:50.339688 --- ParallelTerminationStrategy: PID 27200 died... 22:56:50.358730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27200): Terminated: ok {rc=0} 22:56:50.403779 --- ParallelTerminationStrategy: PID 27203 died... 22:56:50.422764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27203): Terminated: ok {rc=0} 22:56:50.507068 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:56:51.591774 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:51.603426 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:51.672028 tst ping_idle_ping.py: using LAC 24242 22:56:51.793742 tst ping_idle_ping.py: using RAC 17 22:56:51.910510 tst ping_idle_ping.py: using CellId 24242 22:56:52.027866 tst ping_idle_ping.py: using BVCI 24243 22:56:52.135896 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:52.147057 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:52.158133 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:52.169554 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:52.180801 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:52.192156 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:52.203565 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:52.214829 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:52.331714 tst ping_idle_ping.py:24: start network... 22:56:52.532506 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:52.996340 run create_hlr_db(pid=27205): Launched 22:56:53.110217 bus /gobi_6: Setting Powered False 22:56:54.170926 run create_hlr_db(pid=27205): Terminated: ok {rc=0} 22:56:54.607360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27207): Launched 22:56:54.925554 run osmo-hlr_10.42.42.2(pid=27208): Launched 22:56:55.047345 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:55.598049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27210): Launched 22:56:55.914630 run osmo-stp_10.42.42.5(pid=27211): Launched 22:56:56.035710 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:56.584564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27213): Launched 22:56:56.707053 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:56.977950 run patchelf(pid=27214): Launched 22:56:57.157085 run osmo-stp_10.42.42.5(pid=27211): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27211)] 22:56:57.293352 run osmo-stp_10.42.42.5(pid=27211): stdout: | (launched: 2022-12-09_22:56:55.857231) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:57.431476 run osmo-stp_10.42.42.5(pid=27211): stderr: | 20221209225656049 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225656049 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225656049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225656050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225656050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225656050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225656050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:57.569851 run osmo-stp_10.42.42.5(pid=27211): stdout: | (launched: 2022-12-09_22:56:55.857231) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:57.701246 run osmo-stp_10.42.42.5(pid=27211): stderr: | 20221209225656049 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225656049 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225656049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225656050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225656050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225656050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225656050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:57.856696 run patchelf(pid=27214): Terminating (SIGINT) 22:56:58.038107 run patchelf(pid=27214): Terminated: ok {rc=0} 22:56:58.169137 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27211): Process ended prematurely: osmo-stp_10.42.42.5(pid=27211) [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27211)] [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:56:58.178665 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:56:58.207022 run osmo-hlr_10.42.42.2(pid=27208): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27208)] 22:56:58.256892 run osmo-hlr_10.42.42.2(pid=27208): stdout: | (launched: 2022-12-09_22:56:54.868029) 22:56:58.308619 run osmo-hlr_10.42.42.2(pid=27208): stderr: | 20221209225655065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225655065 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225655066 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225655066 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225655066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225655066 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225655107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225655117 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225655117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225655117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:58.360682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27207): Terminating (SIGTERM) 22:56:58.402756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27210): Terminating (SIGTERM) 22:56:58.445380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27213): Terminating (SIGTERM) 22:56:58.487739 --- ParallelTerminationStrategy: PID 27207 died... 22:56:58.507914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27207): Terminated: ok {rc=0} 22:56:58.554624 --- ParallelTerminationStrategy: PID 27210 died... 22:56:58.574576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27210): Terminated: ok {rc=0} 22:56:58.621326 --- ParallelTerminationStrategy: PID 27213 died... 22:56:58.641044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27213): Terminated: ok {rc=0} 22:56:58.728761 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:57:00.043849 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:57:00.051786 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:57:00.084863 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 22:57:00.123958 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 22:57:00.213737 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:57:00.247088 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 22:57:00.286148 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 22:57:00.914527 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 22:57:00.967098 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:00.979165 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:57:01.037855 tst cs_paging_gprs_active.py: using LAC 24243 22:57:01.159117 tst cs_paging_gprs_active.py: using RAC 18 22:57:01.285605 tst cs_paging_gprs_active.py: using CellId 24243 22:57:01.409257 tst cs_paging_gprs_active.py: using BVCI 24244 22:57:01.540897 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:01.553250 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:01.565468 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:01.578706 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:01.591216 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:01.603228 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:01.615832 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:01.628059 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:01.640461 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:01.767552 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:01.894952 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:57:02.114466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:02.439149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27220): Launched 22:57:02.717297 run iperf3-srv_10.42.42.10(pid=27221): Launched 22:57:02.837656 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:57:03.052458 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:03.372728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27222): Launched 22:57:03.651299 run iperf3-srv_10.42.42.10(pid=27223): Launched 22:57:03.771130 tst cs_paging_gprs_active.py:38: start network... 22:57:03.986750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:04.483638 run create_hlr_db(pid=27224): Launched 22:57:04.614626 bus /gobi_6: Setting Powered False 22:57:05.677686 run create_hlr_db(pid=27224): Terminated: ok {rc=0} 22:57:06.106103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27226): Launched 22:57:06.406725 run osmo-hlr_10.42.42.2(pid=27227): Launched 22:57:06.521976 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:07.054914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27229): Launched 22:57:07.353957 run osmo-stp_10.42.42.5(pid=27230): Launched 22:57:07.467923 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:07.986425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27232): Launched 22:57:08.102425 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:08.355199 run patchelf(pid=27233): Launched 22:57:08.523327 run osmo-stp_10.42.42.5(pid=27230): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27230)] 22:57:08.651010 run osmo-stp_10.42.42.5(pid=27230): stdout: | (launched: 2022-12-09_22:57:07.299858) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:08.780141 run osmo-stp_10.42.42.5(pid=27230): stderr: | 20221209225707468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225707468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225707469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225707469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225707470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225707470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225707470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:08.910156 run osmo-stp_10.42.42.5(pid=27230): stdout: | (launched: 2022-12-09_22:57:07.299858) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:09.033272 run osmo-stp_10.42.42.5(pid=27230): stderr: | 20221209225707468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225707468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225707469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225707469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225707470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225707470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225707470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:09.179389 run patchelf(pid=27233): Terminating (SIGINT) 22:57:09.348398 run patchelf(pid=27233): Terminated: ok {rc=0} 22:57:09.470980 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27230): Process ended prematurely: osmo-stp_10.42.42.5(pid=27230) [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27230)] [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 22:57:09.480433 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:57:09.507962 run osmo-hlr_10.42.42.2(pid=27227): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27227)] 22:57:09.555890 run osmo-hlr_10.42.42.2(pid=27227): stdout: | (launched: 2022-12-09_22:57:06.352565) 22:57:09.605756 run osmo-hlr_10.42.42.2(pid=27227): stderr: | 20221209225706528 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225706528 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225706528 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225706528 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225706528 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225706528 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225706540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225706549 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225706549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225706549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:09.655604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27220): Terminating (SIGTERM) 22:57:09.695397 run iperf3-srv_10.42.42.10(pid=27221): Terminating (SIGTERM) 22:57:09.735301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27222): Terminating (SIGTERM) 22:57:09.775415 run iperf3-srv_10.42.42.10(pid=27223): Terminating (SIGTERM) 22:57:09.815324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27226): Terminating (SIGTERM) 22:57:09.855536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27229): Terminating (SIGTERM) 22:57:09.895654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27232): Terminating (SIGTERM) 22:57:09.935829 --- ParallelTerminationStrategy: PID 27220 died... 22:57:09.954925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27220): Terminated: ok {rc=0} 22:57:09.999200 --- ParallelTerminationStrategy: PID 27221 died... 22:57:10.017817 run iperf3-srv_10.42.42.10(pid=27221): Terminated {rc=256} 22:57:10.062331 --- ParallelTerminationStrategy: PID 27222 died... 22:57:10.080743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27222): Terminated: ok {rc=0} 22:57:10.124841 --- ParallelTerminationStrategy: PID 27223 died... 22:57:10.143721 run iperf3-srv_10.42.42.10(pid=27223): Terminated {rc=256} 22:57:10.188153 --- ParallelTerminationStrategy: PID 27226 died... 22:57:10.206717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27226): Terminated: ok {rc=0} 22:57:10.250725 --- ParallelTerminationStrategy: PID 27229 died... 22:57:10.269331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27229): Terminated: ok {rc=0} 22:57:10.313978 --- ParallelTerminationStrategy: PID 27232 died... 22:57:10.332666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27232): Terminated: ok {rc=0} 22:57:10.419144 bus /gobi_0: Setting Powered False 22:57:11.519206 bus /gobi_0: Setting Powered False 22:57:12.633816 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 22:57:13.780245 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:13.792282 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:57:13.842143 tst iperf3.py: using LAC 24244 22:57:13.960448 tst iperf3.py: using RAC 19 22:57:14.079890 tst iperf3.py: using CellId 24244 22:57:14.198719 tst iperf3.py: using BVCI 24245 22:57:14.307809 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:14.319164 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:14.330229 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:14.341502 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:14.352643 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:14.363883 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:14.375079 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:14.386212 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:14.397719 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:14.513092 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:57:14.714521 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:15.015101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27234): Launched 22:57:15.276070 run iperf3-srv_10.42.42.10(pid=27235): Launched 22:57:15.389064 tst iperf3.py:8: start network... 22:57:15.589866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:16.079038 run create_hlr_db(pid=27236): Launched 22:57:16.230051 bus /gobi_6: Setting Powered False 22:57:17.289601 run create_hlr_db(pid=27236): Terminated: ok {rc=0} 22:57:17.726847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27238): Launched 22:57:18.030978 run osmo-hlr_10.42.42.2(pid=27239): Launched 22:57:18.145324 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:18.671031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27241): Launched 22:57:18.970263 run osmo-stp_10.42.42.5(pid=27242): Launched 22:57:19.084833 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:19.601998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27244): Launched 22:57:19.716724 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:19.969280 run patchelf(pid=27245): Launched 22:57:20.137089 run osmo-stp_10.42.42.5(pid=27242): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27242)] 22:57:20.265227 run osmo-stp_10.42.42.5(pid=27242): stdout: | (launched: 2022-12-09_22:57:18.915523) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:20.394414 run osmo-stp_10.42.42.5(pid=27242): stderr: | 20221209225719085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225719085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225719086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225719086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225719086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225719086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225719087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:20.523813 run osmo-stp_10.42.42.5(pid=27242): stdout: | (launched: 2022-12-09_22:57:18.915523) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:20.646681 run osmo-stp_10.42.42.5(pid=27242): stderr: | 20221209225719085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225719085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225719086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225719086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225719086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225719086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225719087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:20.792278 run patchelf(pid=27245): Terminating (SIGINT) 22:57:20.963055 run patchelf(pid=27245): Terminated: ok {rc=0} 22:57:21.085525 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27242): Process ended prematurely: osmo-stp_10.42.42.5(pid=27242) [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27242)] [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 22:57:21.094932 tst iperf3.py:8: Test FAILED (7.4 sec) 22:57:21.122520 run osmo-hlr_10.42.42.2(pid=27239): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27239)] 22:57:21.170414 run osmo-hlr_10.42.42.2(pid=27239): stdout: | (launched: 2022-12-09_22:57:17.976735) 22:57:21.220037 run osmo-hlr_10.42.42.2(pid=27239): stderr: | 20221209225718153 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225718153 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225718153 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225718153 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225718153 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225718153 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225718164 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225718174 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225718174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225718174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:21.270242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27234): Terminating (SIGTERM) 22:57:21.310262 run iperf3-srv_10.42.42.10(pid=27235): Terminating (SIGTERM) 22:57:21.350225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27238): Terminating (SIGTERM) 22:57:21.390219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27241): Terminating (SIGTERM) 22:57:21.430209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27244): Terminating (SIGTERM) 22:57:21.470359 --- ParallelTerminationStrategy: PID 27234 died... 22:57:21.489331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27234): Terminated: ok {rc=0} 22:57:21.533777 --- ParallelTerminationStrategy: PID 27235 died... 22:57:21.552170 run iperf3-srv_10.42.42.10(pid=27235): Terminated {rc=256} 22:57:21.596487 --- ParallelTerminationStrategy: PID 27238 died... 22:57:21.614956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27238): Terminated: ok {rc=0} 22:57:21.659410 --- ParallelTerminationStrategy: PID 27241 died... 22:57:21.678110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27241): Terminated: ok {rc=0} 22:57:21.722618 --- ParallelTerminationStrategy: PID 27244 died... 22:57:21.741336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27244): Terminated: ok {rc=0} 22:57:21.825663 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 22:57:22.968337 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:22.980333 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:57:23.033449 tst iperf3m4.py: using LAC 24245 22:57:23.152294 tst iperf3m4.py: using RAC 20 22:57:23.269967 tst iperf3m4.py: using CellId 24245 22:57:23.387403 tst iperf3m4.py: using BVCI 24246 22:57:23.497558 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:23.508874 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:23.520034 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:23.531512 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:23.542884 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:23.554293 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:23.565942 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:23.577390 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:23.589289 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:23.706242 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:23.828093 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:23.950662 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:24.066744 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:57:24.270900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:24.572258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27246): Launched 22:57:24.833422 run iperf3-srv_10.42.42.10(pid=27247): Launched 22:57:24.947476 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:57:25.150577 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:25.454111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27248): Launched 22:57:25.714774 run iperf3-srv_10.42.42.10(pid=27249): Launched 22:57:25.827313 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:57:26.027739 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:26.328360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27250): Launched 22:57:26.589521 run iperf3-srv_10.42.42.10(pid=27251): Launched 22:57:26.703887 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:57:26.906877 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:27.211222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27252): Launched 22:57:27.472125 run iperf3-srv_10.42.42.10(pid=27253): Launched 22:57:27.586358 tst iperf3m4.py:8: start network... 22:57:27.787064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:28.249640 run create_hlr_db(pid=27254): Launched 22:57:28.366300 bus /gobi_6: Setting Powered False 22:57:29.425907 run create_hlr_db(pid=27254): Terminated: ok {rc=0} 22:57:29.843330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27256): Launched 22:57:30.142275 run osmo-hlr_10.42.42.2(pid=27257): Launched 22:57:30.256289 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:30.788710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27259): Launched 22:57:31.135862 run osmo-stp_10.42.42.5(pid=27260): Launched 22:57:31.385075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:32.054968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27262): Launched 22:57:32.187685 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:32.463504 run patchelf(pid=27263): Launched 22:57:32.641875 run osmo-stp_10.42.42.5(pid=27260): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27260)] 22:57:32.778195 run osmo-stp_10.42.42.5(pid=27260): stdout: | (launched: 2022-12-09_22:57:31.072256) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:32.915688 run osmo-stp_10.42.42.5(pid=27260): stderr: | 20221209225731413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225731413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225731413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225731414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225731414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225731414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225731414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:33.053605 run osmo-stp_10.42.42.5(pid=27260): stdout: | (launched: 2022-12-09_22:57:31.072256) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:33.185153 run osmo-stp_10.42.42.5(pid=27260): stderr: | 20221209225731413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225731413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225731413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225731414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225731414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225731414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225731414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:33.340173 run patchelf(pid=27263): Terminating (SIGINT) 22:57:33.522111 run patchelf(pid=27263): Terminated: ok {rc=0} 22:57:33.652353 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27260): Process ended prematurely: osmo-stp_10.42.42.5(pid=27260) [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27260)] [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 22:57:33.662470 tst iperf3m4.py:8: Test FAILED (10.7 sec) 22:57:33.690942 run osmo-hlr_10.42.42.2(pid=27257): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27257)] 22:57:33.740546 run osmo-hlr_10.42.42.2(pid=27257): stdout: | (launched: 2022-12-09_22:57:30.087879) 22:57:33.792104 run osmo-hlr_10.42.42.2(pid=27257): stderr: | 20221209225730264 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225730264 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225730264 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225730264 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225730264 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225730264 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225730275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225730284 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225730284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225730284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:33.843945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27246): Terminating (SIGTERM) 22:57:33.885414 run iperf3-srv_10.42.42.10(pid=27247): Terminating (SIGTERM) 22:57:33.927093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27248): Terminating (SIGTERM) 22:57:33.968800 run iperf3-srv_10.42.42.10(pid=27249): Terminating (SIGTERM) 22:57:34.010618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27250): Terminating (SIGTERM) 22:57:34.052352 run iperf3-srv_10.42.42.10(pid=27251): Terminating (SIGTERM) 22:57:34.093991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27252): Terminating (SIGTERM) 22:57:34.135583 run iperf3-srv_10.42.42.10(pid=27253): Terminating (SIGTERM) 22:57:34.178448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27256): Terminating (SIGTERM) 22:57:34.220372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27259): Terminating (SIGTERM) 22:57:34.262179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27262): Terminating (SIGTERM) 22:57:34.304068 --- ParallelTerminationStrategy: PID 27246 died... 22:57:34.324011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27246): Terminated: ok {rc=0} 22:57:34.370012 --- ParallelTerminationStrategy: PID 27247 died... 22:57:34.389802 run iperf3-srv_10.42.42.10(pid=27247): Terminated {rc=256} 22:57:34.435251 --- ParallelTerminationStrategy: PID 27248 died... 22:57:34.455069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27248): Terminated: ok {rc=0} 22:57:34.500687 --- ParallelTerminationStrategy: PID 27249 died... 22:57:34.520368 run iperf3-srv_10.42.42.10(pid=27249): Terminated {rc=256} 22:57:34.565850 --- ParallelTerminationStrategy: PID 27250 died... 22:57:34.585315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27250): Terminated: ok {rc=0} 22:57:34.631268 --- ParallelTerminationStrategy: PID 27251 died... 22:57:34.650728 run iperf3-srv_10.42.42.10(pid=27251): Terminated {rc=256} 22:57:34.696240 --- ParallelTerminationStrategy: PID 27252 died... 22:57:34.715714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27252): Terminated: ok {rc=0} 22:57:34.761356 --- ParallelTerminationStrategy: PID 27253 died... 22:57:34.780841 run iperf3-srv_10.42.42.10(pid=27253): Terminated {rc=256} 22:57:34.826500 --- ParallelTerminationStrategy: PID 27256 died... 22:57:34.845967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27256): Terminated: ok {rc=0} 22:57:34.891372 --- ParallelTerminationStrategy: PID 27259 died... 22:57:34.910857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27259): Terminated: ok {rc=0} 22:57:34.956402 --- ParallelTerminationStrategy: PID 27262 died... 22:57:34.975949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27262): Terminated: ok {rc=0} 22:57:35.063817 bus /gobi_4: Setting Powered False 22:57:36.163145 bus /gobi_4: Setting Powered False 22:57:37.280880 bus /gobi_1: Setting Powered False 22:57:38.379352 bus /gobi_1: Setting Powered False 22:57:39.495816 bus /gobi_0: Setting Powered False 22:57:40.593820 bus /gobi_0: Setting Powered False 22:57:41.709306 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 22:57:42.811331 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:42.823458 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:57:42.874175 tst ping.py: using LAC 24246 22:57:42.990485 tst ping.py: using RAC 21 22:57:43.106373 tst ping.py: using CellId 24246 22:57:43.223496 tst ping.py: using BVCI 24247 22:57:43.329670 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:43.341059 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:43.352043 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:43.363310 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:43.374646 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:43.386092 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:43.397504 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:43.408658 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:43.526952 tst ping.py:19: start network... 22:57:43.739494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:44.224236 run create_hlr_db(pid=27265): Launched 22:57:44.352357 bus /gobi_6: Setting Powered False 22:57:45.414788 run create_hlr_db(pid=27265): Terminated: ok {rc=0} 22:57:45.849693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27267): Launched 22:57:46.190569 run osmo-hlr_10.42.42.2(pid=27268): Launched 22:57:46.443556 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:47.120040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27270): Launched 22:57:47.441323 run osmo-stp_10.42.42.5(pid=27271): Launched 22:57:47.562046 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:48.102609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27273): Launched 22:57:48.222486 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:48.486279 run patchelf(pid=27274): Launched 22:57:48.661209 run osmo-stp_10.42.42.5(pid=27271): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27271)] 22:57:48.794205 run osmo-stp_10.42.42.5(pid=27271): stdout: | (launched: 2022-12-09_22:57:47.384505) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:48.928623 run osmo-stp_10.42.42.5(pid=27271): stderr: | 20221209225747576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225747576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225747576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225747576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225747579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225747579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225747579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:49.063562 run osmo-stp_10.42.42.5(pid=27271): stdout: | (launched: 2022-12-09_22:57:47.384505) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:49.192246 run osmo-stp_10.42.42.5(pid=27271): stderr: | 20221209225747576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225747576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225747576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225747576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225747579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225747579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225747579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:49.344033 run patchelf(pid=27274): Terminating (SIGINT) 22:57:49.521624 run patchelf(pid=27274): Terminated: ok {rc=0} 22:57:49.648839 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27271): Process ended prematurely: osmo-stp_10.42.42.5(pid=27271) [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27271)] [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 22:57:49.658392 tst ping.py:22: Test FAILED (6.8 sec) 22:57:49.686252 run osmo-hlr_10.42.42.2(pid=27268): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27268)] 22:57:49.736054 run osmo-hlr_10.42.42.2(pid=27268): stdout: | (launched: 2022-12-09_22:57:46.121736) 22:57:49.787678 run osmo-hlr_10.42.42.2(pid=27268): stderr: | 20221209225746387 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225746387 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225746387 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225746387 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225746387 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225746387 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225746407 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225746419 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225746419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225746420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:49.839638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27267): Terminating (SIGTERM) 22:57:49.881183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27270): Terminating (SIGTERM) 22:57:49.922807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27273): Terminating (SIGTERM) 22:57:49.964554 --- ParallelTerminationStrategy: PID 27267 died... 22:57:49.984501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27267): Terminated: ok {rc=0} 22:57:50.030484 --- ParallelTerminationStrategy: PID 27270 died... 22:57:50.049940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27270): Terminated: ok {rc=0} 22:57:50.095628 --- ParallelTerminationStrategy: PID 27273 died... 22:57:50.115078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27273): Terminated: ok {rc=0} 22:57:50.202185 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 22:57:51.290253 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:51.303719 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:57:51.372341 tst ping_idle_ping.py: using LAC 24247 22:57:51.495851 tst ping_idle_ping.py: using RAC 22 22:57:51.617414 tst ping_idle_ping.py: using CellId 24247 22:57:51.739753 tst ping_idle_ping.py: using BVCI 24248 22:57:51.854418 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:51.866297 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:51.877881 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:51.889767 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:51.901795 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:51.913773 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:51.925855 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:51.937796 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:52.051753 tst ping_idle_ping.py:24: start network... 22:57:52.250735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:52.708658 run create_hlr_db(pid=27275): Launched 22:57:52.823075 bus /gobi_6: Setting Powered False 22:57:53.882366 run create_hlr_db(pid=27275): Terminated: ok {rc=0} 22:57:54.314583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27277): Launched 22:57:54.631229 run osmo-hlr_10.42.42.2(pid=27278): Launched 22:57:54.752113 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:55.293918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27280): Launched 22:57:55.608204 run osmo-stp_10.42.42.5(pid=27281): Launched 22:57:55.728600 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:56.271116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27283): Launched 22:57:56.391496 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:56.657268 run patchelf(pid=27284): Launched 22:57:56.832374 run osmo-stp_10.42.42.5(pid=27281): ERR: Terminated: ERROR {rc=1} [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27281)] 22:57:56.966080 run osmo-stp_10.42.42.5(pid=27281): stdout: | (launched: 2022-12-09_22:57:55.550928) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:57.101586 run osmo-stp_10.42.42.5(pid=27281): stderr: | 20221209225755743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225755743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225755743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225755744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225755744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225755744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225755744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:57.237350 run osmo-stp_10.42.42.5(pid=27281): stdout: | (launched: 2022-12-09_22:57:55.550928) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:57.366676 run osmo-stp_10.42.42.5(pid=27281): stderr: | 20221209225755743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225755743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225755743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225755744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225755744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225755744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225755744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:57.520173 run patchelf(pid=27284): Terminating (SIGINT) 22:57:57.698383 run patchelf(pid=27284): Terminated: ok {rc=0} 22:57:57.827763 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27281): Process ended prematurely: osmo-stp_10.42.42.5(pid=27281) [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27281)] [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 22:57:57.837433 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:57:57.865233 run osmo-hlr_10.42.42.2(pid=27278): ERR: Terminated: ERROR {rc=237} [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27278)] 22:57:57.914982 run osmo-hlr_10.42.42.2(pid=27278): stdout: | (launched: 2022-12-09_22:57:54.573821) 22:57:57.966691 run osmo-hlr_10.42.42.2(pid=27278): stderr: | 20221209225754771 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225754771 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225754771 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225754771 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225754771 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225754772 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225754785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225754793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225754794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225754794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:58.018677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27277): Terminating (SIGTERM) 22:57:58.060532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27280): Terminating (SIGTERM) 22:57:58.102435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27283): Terminating (SIGTERM) 22:57:58.144353 --- ParallelTerminationStrategy: PID 27277 died... 22:57:58.164432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27277): Terminated: ok {rc=0} 22:57:58.210711 --- ParallelTerminationStrategy: PID 27280 died... 22:57:58.230288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27280): Terminated: ok {rc=0} 22:57:58.276118 --- ParallelTerminationStrategy: PID 27283 died... 22:57:58.295885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27283): Terminated: ok {rc=0} 22:57:58.383459 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 22:57:59.704775 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:57:59.713375 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:57:59.746509 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:57:59.781312 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:57:59.834773 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:57:59.867415 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:57:59.901955 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:58:00.466924 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2365 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:58:00.472102 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:00.483836 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:58:00.552165 tst switch_tch_pdch.py: using LAC 24248 22:58:00.675313 tst switch_tch_pdch.py: using RAC 23 22:58:00.798011 tst switch_tch_pdch.py: using CellId 24248 22:58:00.931339 tst switch_tch_pdch.py: using BVCI 24249 22:58:01.044863 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:01.057694 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:01.071065 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:01.084616 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:01.098623 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:01.110980 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:01.124354 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:01.138537 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:58:01.258172 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:58:01.379444 tst switch_tch_pdch.py:51: start network... 22:58:01.614191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:02.088262 run create_hlr_db(pid=27288): Launched 22:58:02.206789 bus /gobi_6: Setting Powered False 22:58:03.266184 run create_hlr_db(pid=27288): Terminated: ok {rc=0} 22:58:03.697451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27290): Launched 22:58:04.012696 run osmo-hlr_10.42.42.2(pid=27291): Launched 22:58:04.132076 run osmo-stp_10.42.42.5: Starting osmo-stp 22:58:04.680830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27293): Launched 22:58:04.994876 run osmo-stp_10.42.42.5(pid=27294): Launched 22:58:05.113880 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:58:05.657141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27296): Launched 22:58:05.777517 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:58:06.042250 run patchelf(pid=27297): Launched 22:58:06.217726 run osmo-stp_10.42.42.5(pid=27294): ERR: Terminated: ERROR {rc=1} [trial-2365↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27294)] 22:58:06.351399 run osmo-stp_10.42.42.5(pid=27294): stdout: | (launched: 2022-12-09_22:58:04.938134) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:06.487299 run osmo-stp_10.42.42.5(pid=27294): stderr: | 20221209225805126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225805126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225805126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225805127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225805127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225805127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225805127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:06.622816 run osmo-stp_10.42.42.5(pid=27294): stdout: | (launched: 2022-12-09_22:58:04.938134) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:06.751996 run osmo-stp_10.42.42.5(pid=27294): stderr: | 20221209225805126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225805126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225805126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225805127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225805127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225805127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225805127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:06.904830 run patchelf(pid=27297): Terminating (SIGINT) 22:58:07.082365 run patchelf(pid=27297): Terminated: ok {rc=0} 22:58:07.209634 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27294): Process ended prematurely: osmo-stp_10.42.42.5(pid=27294) [trial-2365↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27294)] [trial-2365↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:58:07.219135 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 22:58:07.246657 run osmo-hlr_10.42.42.2(pid=27291): ERR: Terminated: ERROR {rc=237} [trial-2365↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27291)] 22:58:07.296090 run osmo-hlr_10.42.42.2(pid=27291): stdout: | (launched: 2022-12-09_22:58:03.955953) 22:58:07.347986 run osmo-hlr_10.42.42.2(pid=27291): stderr: | 20221209225804154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225804154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225804154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225804154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225804154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225804154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225804168 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225804176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225804176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225804176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:07.399683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27290): Terminating (SIGTERM) 22:58:07.441516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27293): Terminating (SIGTERM) 22:58:07.483585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27296): Terminating (SIGTERM) 22:58:07.525707 --- ParallelTerminationStrategy: PID 27290 died... 22:58:07.545590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27290): Terminated: ok {rc=0} 22:58:07.591680 --- ParallelTerminationStrategy: PID 27293 died... 22:58:07.611145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27293): Terminated: ok {rc=0} 22:58:07.656863 --- ParallelTerminationStrategy: PID 27296 died... 22:58:07.676673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27296): Terminated: ok {rc=0} 22:58:07.765109 bus /gobi_0: Setting Powered False 22:58:08.863800 bus /gobi_0: Setting Powered False 22:58:09.979164 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2365 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 nitb_smpp --------------------------------------------------------------------- 22:58:11.235177 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:58:11.238023 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 22:58:11.259147 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 22:58:11.268454 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 22:58:11.306164 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 22:58:11.327733 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 22:58:11.334906 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 22:58:11.850806 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2365 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 22:58:11.855796 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 22:58:11.874353 tst esme_connect_policy_acceptall.py: using MSISDN 7415 22:58:12.008388 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:58:12.568457 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27302): Launched 22:58:12.868712 run osmo-nitb_10.42.42.2(pid=27303): Launched 22:58:13.035303 run osmo-nitb_10.42.42.2(pid=27303): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27303)] 22:58:13.170694 run osmo-nitb_10.42.42.2(pid=27303): stdout: | (launched: 2022-12-09_22:58:12.814292) 22:58:13.307151 run osmo-nitb_10.42.42.2(pid=27303): stderr: | (launched: 2022-12-09_22:58:12.858974) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:13.444109 run osmo-nitb_10.42.42.2(pid=27303): stdout: | (launched: 2022-12-09_22:58:12.814292) 22:58:13.575060 run osmo-nitb_10.42.42.2(pid=27303): stderr: | (launched: 2022-12-09_22:58:12.858974) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27303): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27303) [trial-2365↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27303)] 22:58:13.982402 tst osmo-nitb_10.42.42.2(pid=27303): stdout: | (launched: 2022-12-09_22:58:12.814292) 22:58:14.105735 tst osmo-nitb_10.42.42.2(pid=27303): stderr: | (launched: 2022-12-09_22:58:12.858974) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:14.251007 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=27303): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27303) [trial-2365↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27303)] [trial-2365↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 22:58:14.259177 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 22:58:14.265651 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27302): Terminating (SIGTERM) 22:58:14.474870 --- ParallelTerminationStrategy: PID 27302 died... 22:58:14.495315 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27302): Terminated: ok {rc=0} ---------------------------------------------- trial-2365 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 22:58:14.543866 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 22:58:14.564879 tst esme_connect_policy_closed.py: using MSISDN 7416 22:58:14.689970 tst esme_connect_policy_closed.py: using MSISDN 7417 22:58:14.799530 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:58:15.357182 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27304): Launched 22:58:15.659283 run osmo-nitb_10.42.42.2(pid=27305): Launched 22:58:15.821958 run osmo-nitb_10.42.42.2(pid=27305): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27305)] 22:58:15.961337 run osmo-nitb_10.42.42.2(pid=27305): stdout: | (launched: 2022-12-09_22:58:15.604632) 22:58:16.090808 run osmo-nitb_10.42.42.2(pid=27305): stderr: | (launched: 2022-12-09_22:58:15.649556) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:16.220389 run osmo-nitb_10.42.42.2(pid=27305): stdout: | (launched: 2022-12-09_22:58:15.604632) 22:58:16.344004 run osmo-nitb_10.42.42.2(pid=27305): stderr: | (launched: 2022-12-09_22:58:15.649556) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:16.492231 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=27305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27305) [trial-2365↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27305)] [trial-2365↪nitb_smpp↪esme_connect_policy_closed.py:24] 22:58:16.501563 tst esme_connect_policy_closed.py:24: Test FAILED (2.0 sec) 22:58:16.508929 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27304): Terminating (SIGTERM) 22:58:16.721607 --- ParallelTerminationStrategy: PID 27304 died... 22:58:16.750509 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27304): Terminated: ok {rc=0} ---------------------------------------------- trial-2365 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 22:58:16.814691 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 22:58:16.830110 tst nitb_smpp: Using 1 x bts (candidates: 1) 22:58:16.875264 tst esme_ms_sms_storeforward.py: using LAC 24249 22:58:17.042547 tst esme_ms_sms_storeforward.py: using RAC 24 22:58:17.169411 tst esme_ms_sms_storeforward.py: using CellId 24249 22:58:17.303511 tst esme_ms_sms_storeforward.py: using BVCI 24250 22:58:17.415784 tst nitb_smpp: Using 1 x modem (candidates: 1) 22:58:17.542866 tst esme_ms_sms_storeforward.py: using MSISDN 7418 22:58:17.660167 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 22:58:17.879384 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:58:18.538077 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27306): Launched 22:58:18.862839 run osmo-nitb_10.42.42.2(pid=27307): Launched 22:58:19.037814 run osmo-nitb_10.42.42.2(pid=27307): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27307)] 22:58:19.171404 run osmo-nitb_10.42.42.2(pid=27307): stdout: | (launched: 2022-12-09_22:58:18.804702) 22:58:19.306636 run osmo-nitb_10.42.42.2(pid=27307): stderr: | (launched: 2022-12-09_22:58:18.853064) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:19.442703 run osmo-nitb_10.42.42.2(pid=27307): stdout: | (launched: 2022-12-09_22:58:18.804702) 22:58:19.572501 run osmo-nitb_10.42.42.2(pid=27307): stderr: | (launched: 2022-12-09_22:58:18.853064) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:19.727477 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=27307): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27307) [trial-2365↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27307)] [trial-2365↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 22:58:19.736433 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 22:58:19.743390 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27306): Terminating (SIGTERM) 22:58:19.954200 --- ParallelTerminationStrategy: PID 27306 died... 22:58:19.975864 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27306): Terminated: ok {rc=0} 22:58:20.064160 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 22:58:21.150278 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 22:58:21.161425 tst nitb_smpp: Using 1 x bts (candidates: 1) 22:58:21.197830 tst esme_ms_sms_transaction.py: using LAC 24250 22:58:21.317608 tst esme_ms_sms_transaction.py: using RAC 25 22:58:21.437438 tst esme_ms_sms_transaction.py: using CellId 24250 22:58:21.566227 tst esme_ms_sms_transaction.py: using BVCI 24251 22:58:21.685475 tst nitb_smpp: Using 1 x modem (candidates: 1) 22:58:21.813574 tst esme_ms_sms_transaction.py: using MSISDN 7419 22:58:21.930908 tst esme_ms_sms_transaction.py:18: start nitb and bts... 22:58:22.149351 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:58:22.802403 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27308): Launched 22:58:23.123824 run osmo-nitb_10.42.42.2(pid=27309): Launched 22:58:23.302064 run osmo-nitb_10.42.42.2(pid=27309): ERR: Terminated: ERROR {rc=2} [trial-2365↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27309)] 22:58:23.448060 run osmo-nitb_10.42.42.2(pid=27309): stdout: | (launched: 2022-12-09_22:58:23.065777) 22:58:23.594791 run osmo-nitb_10.42.42.2(pid=27309): stderr: | (launched: 2022-12-09_22:58:23.113670) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:23.741280 run osmo-nitb_10.42.42.2(pid=27309): stdout: | (launched: 2022-12-09_22:58:23.065777) 22:58:23.881211 run osmo-nitb_10.42.42.2(pid=27309): stderr: | (launched: 2022-12-09_22:58:23.113670) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27309): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27309) [trial-2365↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27309)] 22:58:24.245493 tst osmo-nitb_10.42.42.2(pid=27309): stdout: | (launched: 2022-12-09_22:58:23.065777) 22:58:24.375546 tst osmo-nitb_10.42.42.2(pid=27309): stderr: | (launched: 2022-12-09_22:58:23.113670) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:24.530424 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=27309): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27309) [trial-2365↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27309)] [trial-2365↪nitb_smpp↪esme_ms_sms_transaction.py:21] 22:58:24.539396 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 22:58:24.546249 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27308): Terminating (SIGTERM) 22:58:24.756056 --- ParallelTerminationStrategy: PID 27308 died... 22:58:24.775635 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27308): Terminated: ok {rc=0} 22:58:24.863312 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 smpp --------------------------------------------------------------------- 22:58:26.032282 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:58:26.035637 tst smpp: Verifying 1 x bts (candidates: 11) 22:58:26.057093 tst smpp: Verifying 6 x ip_address (candidates: 9) 22:58:26.084181 tst smpp: Verifying 1 x modem (candidates: 12) 22:58:26.120149 tst smpp: Reserving 1 x bts (candidates: 11) 22:58:26.141211 tst smpp: Reserving 6 x ip_address (candidates: 9) 22:58:26.168173 tst smpp: Reserving 1 x modem (candidates: 12) 22:58:26.696505 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2365 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 22:58:26.701981 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:26.712722 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:26.723962 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:26.735636 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:26.755605 tst esme_connect_policy_acceptall.py: using MSISDN 7420 22:58:26.874904 run osmo-stp_10.42.42.4: Starting osmo-stp 22:58:27.429627 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27313): Launched 22:58:27.753391 run osmo-stp_10.42.42.4(pid=27314): Launched 22:58:27.878423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:28.382672 run create_hlr_db(pid=27315): Launched 22:58:28.514029 bus /sierra_2: Setting Powered False 22:58:29.577936 run create_hlr_db(pid=27315): Terminated: ok {rc=0} 22:58:30.009872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27317): Launched 22:58:30.312303 run osmo-hlr_10.42.42.2(pid=27318): Launched 22:58:30.429229 run osmo-msc_10.42.42.5: Starting osmo-msc 22:58:31.021752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27320): Launched 22:58:31.346394 run osmo-msc_10.42.42.5(pid=27321): Launched 22:58:31.748311 run osmo-hlr_10.42.42.2(pid=27318): ERR: Terminated: ERROR {rc=237} [trial-2365↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27318)] 22:58:31.998947 run osmo-hlr_10.42.42.2(pid=27318): stdout: | (launched: 2022-12-09_22:58:30.257951) 22:58:32.187151 run osmo-hlr_10.42.42.2(pid=27318): stderr: | 20221209225830433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225830433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225830433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225830433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225830433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225830433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225830449 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225830457 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225830457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225830457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:32.357819 run osmo-hlr_10.42.42.2(pid=27318): stdout: | (launched: 2022-12-09_22:58:30.257951) 22:58:32.480754 run osmo-hlr_10.42.42.2(pid=27318): stderr: | 20221209225830433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225830433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225830433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225830433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225830433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225830433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225830449 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225830457 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225830457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225830457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:32.627884 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=27318): Process ended prematurely: osmo-hlr_10.42.42.2(pid=27318) [trial-2365↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27318)] [trial-2365↪smpp↪esme_connect_policy_acceptall.py:23] 22:58:32.636582 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.9 sec) 22:58:32.663637 run osmo-msc_10.42.42.5(pid=27321): ERR: Terminated: ERROR {rc=9} [trial-2365↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=27321)] 22:58:32.713271 run osmo-msc_10.42.42.5(pid=27321): stdout: | (launched: 2022-12-09_22:58:31.284689) 22:58:32.763771 run osmo-msc_10.42.42.5(pid=27321): stderr: | 20221209225831821 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209225831822 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209225831822 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225831822 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209225831824 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209225831824 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209225831824 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209225831824 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209225831824 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 22:58:32.814872 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27313): Terminating (SIGTERM) 22:58:32.854517 run osmo-stp_10.42.42.4(pid=27314): Terminating (SIGTERM) 22:58:32.895941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27317): Terminating (SIGTERM) 22:58:32.938350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27320): Terminating (SIGTERM) 22:58:32.980749 --- ParallelTerminationStrategy: PID 27313 died... 22:58:33.000202 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27313): Terminated: ok {rc=0} 22:58:33.046699 --- ParallelTerminationStrategy: PID 27314 died... 22:58:33.065387 run osmo-stp_10.42.42.4(pid=27314): Terminated: ok {rc=0} 22:58:33.110606 --- ParallelTerminationStrategy: PID 27317 died... 22:58:33.129204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27317): Terminated: ok {rc=0} 22:58:33.174734 --- ParallelTerminationStrategy: PID 27320 died... 22:58:33.193383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27320): Terminated: ok {rc=0} ---------------------------------------------- trial-2365 smpp esme_connect_policy_closed.py ---------------------------------------------- 22:58:33.246089 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:33.256823 tst smpp: Using 1 x bts (candidates: 1) 22:58:33.298554 tst esme_connect_policy_closed.py: using LAC 24251 22:58:33.420148 tst esme_connect_policy_closed.py: using RAC 26 22:58:33.537976 tst esme_connect_policy_closed.py: using CellId 24251 22:58:33.662877 tst esme_connect_policy_closed.py: using BVCI 24252 22:58:33.774737 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:33.785420 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:33.795721 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:33.818788 tst esme_connect_policy_closed.py: using MSISDN 7421 22:58:33.938134 tst esme_connect_policy_closed.py: using MSISDN 7422 22:58:34.048119 run osmo-stp_10.42.42.4: Starting osmo-stp 22:58:34.564499 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27324): Launched 22:58:34.868553 run osmo-stp_10.42.42.4(pid=27325): Launched 22:58:34.984815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:35.453292 run create_hlr_db(pid=27326): Launched 22:58:36.623666 run create_hlr_db(pid=27326): Terminated: ok {rc=0} 22:58:36.942500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27328): Launched 22:58:37.244741 run osmo-hlr_10.42.42.2(pid=27329): Launched 22:58:37.360567 run osmo-msc_10.42.42.5: Starting osmo-msc 22:58:37.922163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27331): Launched 22:58:38.224797 run osmo-msc_10.42.42.5(pid=27332): Launched 22:58:38.395491 run osmo-hlr_10.42.42.2(pid=27329): ERR: Terminated: ERROR {rc=237} [trial-2365↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27329)] 22:58:38.529105 run osmo-hlr_10.42.42.2(pid=27329): stdout: | (launched: 2022-12-09_22:58:37.190012) 22:58:38.668886 run osmo-hlr_10.42.42.2(pid=27329): stderr: | 20221209225837367 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225837368 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225837368 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225837368 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225837368 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225837368 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225837380 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225837389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225837389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225837390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:38.800262 run osmo-hlr_10.42.42.2(pid=27329): stdout: | (launched: 2022-12-09_22:58:37.190012) 22:58:38.921674 run osmo-hlr_10.42.42.2(pid=27329): stderr: | 20221209225837367 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225837368 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225837368 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225837368 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225837368 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225837368 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225837380 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225837389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225837389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225837390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:39.066105 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=27329): Process ended prematurely: osmo-hlr_10.42.42.2(pid=27329) [trial-2365↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27329)] [trial-2365↪smpp↪esme_connect_policy_closed.py:31] 22:58:39.074471 tst esme_connect_policy_closed.py:31: Test FAILED (5.8 sec) 22:58:39.100989 run osmo-msc_10.42.42.5(pid=27332): ERR: Terminated: ERROR {rc=9} [trial-2365↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=27332)] 22:58:39.149044 run osmo-msc_10.42.42.5(pid=27332): stdout: | (launched: 2022-12-09_22:58:38.170046) 22:58:39.198578 run osmo-msc_10.42.42.5(pid=27332): stderr: | 20221209225838484 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209225838484 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209225838484 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225838484 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209225838484 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209225838484 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209225838484 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209225838485 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209225838485 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 22:58:39.248457 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27324): Terminating (SIGTERM) 22:58:39.287869 run osmo-stp_10.42.42.4(pid=27325): Terminating (SIGTERM) 22:58:39.327644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27328): Terminating (SIGTERM) 22:58:39.368620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27331): Terminating (SIGTERM) 22:58:39.409427 --- ParallelTerminationStrategy: PID 27324 died... 22:58:39.428432 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27324): Terminated: ok {rc=0} 22:58:39.473055 --- ParallelTerminationStrategy: PID 27325 died... 22:58:39.491580 run osmo-stp_10.42.42.4(pid=27325): Terminated: ok {rc=0} 22:58:39.535742 --- ParallelTerminationStrategy: PID 27328 died... 22:58:39.554314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27328): Terminated: ok {rc=0} 22:58:39.599227 --- ParallelTerminationStrategy: PID 27331 died... 22:58:39.617925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27331): Terminated: ok {rc=0} ---------------------------------------------- trial-2365 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 22:58:39.667409 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:39.678616 tst smpp: Using 1 x bts (candidates: 1) 22:58:39.714790 tst esme_ms_sms_storeforward.py: using LAC 24252 22:58:39.835560 tst esme_ms_sms_storeforward.py: using RAC 27 22:58:39.955638 tst esme_ms_sms_storeforward.py: using CellId 24252 22:58:40.075473 tst esme_ms_sms_storeforward.py: using BVCI 24253 22:58:40.187274 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:40.197842 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:40.208191 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:40.218970 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:40.229799 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:40.240439 tst smpp: Using 1 x modem (candidates: 1) 22:58:40.372270 tst esme_ms_sms_storeforward.py: using MSISDN 7423 22:58:40.490094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:40.991216 run create_hlr_db(pid=27335): Launched 22:58:42.180332 run create_hlr_db(pid=27335): Terminated: ok {rc=0} 22:58:42.521692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27337): Launched 22:58:42.848010 run osmo-hlr_10.42.42.2(pid=27338): Launched 22:58:42.972049 run osmo-stp_10.42.42.5: Starting osmo-stp 22:58:43.529382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27340): Launched 22:58:43.856317 run osmo-stp_10.42.42.5(pid=27341): Launched 22:58:43.981240 run osmo-msc_10.42.42.6: Starting osmo-msc 22:58:44.565238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27343): Launched 22:58:44.887329 run osmo-msc_10.42.42.6(pid=27344): Launched 22:58:45.067269 run osmo-stp_10.42.42.5(pid=27341): ERR: Terminated: ERROR {rc=1} [trial-2365↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27341)] 22:58:45.203103 run osmo-stp_10.42.42.5(pid=27341): stdout: | (launched: 2022-12-09_22:58:43.797869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:45.339177 run osmo-stp_10.42.42.5(pid=27341): stderr: | 20221209225843989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225843989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225843990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225843990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225843990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225843991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225843991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:45.474777 run osmo-stp_10.42.42.5(pid=27341): stdout: | (launched: 2022-12-09_22:58:43.797869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:45.603822 run osmo-stp_10.42.42.5(pid=27341): stderr: | 20221209225843989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225843989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225843990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225843990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225843990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225843991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225843991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:45.758274 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=27341): Process ended prematurely: osmo-stp_10.42.42.5(pid=27341) [trial-2365↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27341)] [trial-2365↪smpp↪esme_ms_sms_storeforward.py:30] 22:58:45.767254 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.1 sec) 22:58:45.794525 run osmo-hlr_10.42.42.2(pid=27338): ERR: Terminated: ERROR {rc=237} [trial-2365↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27338)] 22:58:45.857257 run osmo-hlr_10.42.42.2(pid=27338): stdout: | (launched: 2022-12-09_22:58:42.789572) 22:58:45.919141 run osmo-hlr_10.42.42.2(pid=27338): stderr: | 20221209225842987 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225842987 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225842987 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225842987 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225842987 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225842987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225843000 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225843008 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225843008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225843008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:45.992110 run osmo-msc_10.42.42.6(pid=27344): ERR: Terminated: ERROR {rc=2} [trial-2365↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27344)] 22:58:46.045449 run osmo-msc_10.42.42.6(pid=27344): stdout: | (launched: 2022-12-09_22:58:44.829292) 22:58:46.111813 run osmo-msc_10.42.42.6(pid=27344): stderr: | 20221209225845153 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225845153 DLGLOBAL DEBUG validating counter group 0x7f45c8a6fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225845153 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225845153 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225845153 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225845153 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225845155 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225845156 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225845156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225845156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:58:46.169065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27337): Terminating (SIGTERM) 22:58:46.213721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27340): Terminating (SIGTERM) 22:58:46.258426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27343): Terminating (SIGTERM) 22:58:46.303331 --- ParallelTerminationStrategy: PID 27337 died... 22:58:46.323553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27337): Terminated: ok {rc=0} 22:58:46.373852 --- ParallelTerminationStrategy: PID 27340 died... 22:58:46.394459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27340): Terminated: ok {rc=0} 22:58:46.443038 --- ParallelTerminationStrategy: PID 27343 died... 22:58:46.462831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27343): Terminated: ok {rc=0} 22:58:46.552260 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 smpp esme_ms_sms_transaction.py ---------------------------------------------- 22:58:47.642422 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:47.654002 tst smpp: Using 1 x bts (candidates: 1) 22:58:47.689762 tst esme_ms_sms_transaction.py: using LAC 24253 22:58:47.812211 tst esme_ms_sms_transaction.py: using RAC 28 22:58:47.935180 tst esme_ms_sms_transaction.py: using CellId 24253 22:58:48.053675 tst esme_ms_sms_transaction.py: using BVCI 24254 22:58:48.170542 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:48.181324 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:48.192009 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:48.202645 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:48.213237 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:48.223741 tst smpp: Using 1 x modem (candidates: 1) 22:58:48.346205 tst esme_ms_sms_transaction.py: using MSISDN 7424 22:58:48.457425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:48.924393 run create_hlr_db(pid=27346): Launched 22:58:49.039731 bus /sierra_2: Setting Powered False 22:58:50.099796 run create_hlr_db(pid=27346): Terminated: ok {rc=0} 22:58:50.522755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27348): Launched 22:58:50.828799 run osmo-hlr_10.42.42.2(pid=27349): Launched 22:58:50.945859 run osmo-stp_10.42.42.5: Starting osmo-stp 22:58:51.464023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27351): Launched 22:58:51.766813 run osmo-stp_10.42.42.5(pid=27352): Launched 22:58:51.883839 run osmo-msc_10.42.42.6: Starting osmo-msc 22:58:52.430531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27354): Launched 22:58:52.732383 run osmo-msc_10.42.42.6(pid=27355): Launched 22:58:52.902147 run osmo-stp_10.42.42.5(pid=27352): ERR: Terminated: ERROR {rc=1} [trial-2365↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27352)] 22:58:53.031112 run osmo-stp_10.42.42.5(pid=27352): stdout: | (launched: 2022-12-09_22:58:51.712092) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:53.160167 run osmo-stp_10.42.42.5(pid=27352): stderr: | 20221209225851882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225851883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225851883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225851883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225851884 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225851884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225851884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:53.286696 run osmo-stp_10.42.42.5(pid=27352): stdout: | (launched: 2022-12-09_22:58:51.712092) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:53.408213 run osmo-stp_10.42.42.5(pid=27352): stderr: | 20221209225851882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225851883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225851883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225851883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225851884 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225851884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225851884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:53.552478 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=27352): Process ended prematurely: osmo-stp_10.42.42.5(pid=27352) [trial-2365↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27352)] [trial-2365↪smpp↪esme_ms_sms_transaction.py:28] 22:58:53.560884 tst esme_ms_sms_transaction.py:28: Test FAILED (5.9 sec) 22:58:53.587266 run osmo-hlr_10.42.42.2(pid=27349): ERR: Terminated: ERROR {rc=237} [trial-2365↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27349)] 22:58:53.635796 run osmo-hlr_10.42.42.2(pid=27349): stdout: | (launched: 2022-12-09_22:58:50.773810) 22:58:53.685970 run osmo-hlr_10.42.42.2(pid=27349): stderr: | 20221209225850949 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225850949 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225850950 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225850950 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225850950 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225850950 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225850962 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225850970 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225850970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225850970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:53.755486 run osmo-msc_10.42.42.6(pid=27355): ERR: Terminated: ERROR {rc=2} [trial-2365↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27355)] 22:58:53.803614 run osmo-msc_10.42.42.6(pid=27355): stdout: | (launched: 2022-12-09_22:58:52.678025) 22:58:53.853431 run osmo-msc_10.42.42.6(pid=27355): stderr: | 20221209225852948 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225852948 DLGLOBAL DEBUG validating counter group 0x7f5f09847c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225852948 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225852948 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225852948 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225852948 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225852950 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225852951 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225852951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225852951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:58:53.903729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27348): Terminating (SIGTERM) 22:58:53.943826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27351): Terminating (SIGTERM) 22:58:53.983908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27354): Terminating (SIGTERM) 22:58:54.024336 --- ParallelTerminationStrategy: PID 27348 died... 22:58:54.043606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27348): Terminated: ok {rc=0} 22:58:54.088411 --- ParallelTerminationStrategy: PID 27351 died... 22:58:54.107217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27351): Terminated: ok {rc=0} 22:58:54.151723 --- ParallelTerminationStrategy: PID 27354 died... 22:58:54.170496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27354): Terminated: ok {rc=0} 22:58:54.255293 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 encryption --------------------------------------------------------------------- 22:58:55.448934 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:58:55.452514 tst encryption: Verifying 1 x bts (candidates: 11) 22:58:55.474250 tst encryption: Verifying 6 x ip_address (candidates: 9) 22:58:55.501540 tst encryption: Verifying 1 x modem (candidates: 12) 22:58:55.538231 tst encryption: Reserving 1 x bts (candidates: 11) 22:58:55.558892 tst encryption: Reserving 6 x ip_address (candidates: 9) 22:58:55.585785 tst encryption: Reserving 1 x modem (candidates: 12) 22:58:56.112527 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2365 encryption register_a5_0_authopt.py ---------------------------------------------- 22:58:56.167524 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:56.178160 tst encryption: Using 1 x bts (candidates: 1) 22:58:56.213636 tst register_a5_0_authopt.py: using LAC 24254 22:58:56.334768 tst register_a5_0_authopt.py: using RAC 29 22:58:56.456008 tst register_a5_0_authopt.py: using CellId 24254 22:58:56.578309 tst register_a5_0_authopt.py: using BVCI 24255 22:58:56.688877 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:56.699440 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:56.710006 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:56.720521 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:56.731265 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:56.742149 tst encryption: Using 1 x modem (candidates: 1) 22:58:56.861102 tst register_a5_0_authopt.py:8: start network... 22:58:57.083569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:57.589224 run create_hlr_db(pid=27360): Launched 22:58:57.722123 bus /sierra_2: Setting Powered False 22:58:58.786488 run create_hlr_db(pid=27360): Terminated: ok {rc=0} 22:58:59.223363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27362): Launched 22:58:59.528937 run osmo-hlr_10.42.42.2(pid=27363): Launched 22:58:59.646474 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:00.187282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27365): Launched 22:59:00.492570 run osmo-stp_10.42.42.5(pid=27366): Launched 22:59:00.610755 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:01.179038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27368): Launched 22:59:01.542684 run osmo-msc_10.42.42.6(pid=27369): Launched 22:59:01.808201 run osmo-stp_10.42.42.5(pid=27366): ERR: Terminated: ERROR {rc=1} [trial-2365↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27366)] 22:59:02.072290 run osmo-stp_10.42.42.5(pid=27366): stdout: | (launched: 2022-12-09_22:59:00.437607) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:02.311783 run osmo-stp_10.42.42.5(pid=27366): stderr: | 20221209225900608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225900608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225900608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225900608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225900609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225900609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225900609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:02.444009 run osmo-stp_10.42.42.5(pid=27366): stdout: | (launched: 2022-12-09_22:59:00.437607) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:02.566514 run osmo-stp_10.42.42.5(pid=27366): stderr: | 20221209225900608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225900608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225900608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225900608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225900609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225900609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225900609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:02.712712 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27366): Process ended prematurely: osmo-stp_10.42.42.5(pid=27366) [trial-2365↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27366)] [trial-2365↪encryption↪register_a5_0_authopt.py:8] 22:59:02.721879 tst register_a5_0_authopt.py:8: Test FAILED (6.6 sec) 22:59:02.748919 run osmo-hlr_10.42.42.2(pid=27363): ERR: Terminated: ERROR {rc=237} [trial-2365↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27363)] 22:59:02.797972 run osmo-hlr_10.42.42.2(pid=27363): stdout: | (launched: 2022-12-09_22:58:59.473666) 22:59:02.848144 run osmo-hlr_10.42.42.2(pid=27363): stderr: | 20221209225859652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225859652 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225859652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225859652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225859652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225859652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225859664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225859673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225859673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225859674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:02.917957 run osmo-msc_10.42.42.6(pid=27369): ERR: Terminated: ERROR {rc=2} [trial-2365↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27369)] 22:59:02.966208 run osmo-msc_10.42.42.6(pid=27369): stdout: | (launched: 2022-12-09_22:59:01.482500) 22:59:03.016070 run osmo-msc_10.42.42.6(pid=27369): stderr: | 20221209225902167 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225902168 DLGLOBAL DEBUG validating counter group 0x7f0381f58c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225902168 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225902169 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225902171 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225902172 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225902182 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225902185 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225902185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225902185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:03.066251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27362): Terminating (SIGTERM) 22:59:03.106481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27365): Terminating (SIGTERM) 22:59:03.146858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27368): Terminating (SIGTERM) 22:59:03.187466 --- ParallelTerminationStrategy: PID 27362 died... 22:59:03.206700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27362): Terminated: ok {rc=0} 22:59:03.251953 --- ParallelTerminationStrategy: PID 27365 died... 22:59:03.270854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27365): Terminated: ok {rc=0} 22:59:03.315619 --- ParallelTerminationStrategy: PID 27368 died... 22:59:03.334479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27368): Terminated: ok {rc=0} 22:59:03.420699 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 encryption register_a5_0_authreq.py ---------------------------------------------- 22:59:04.571322 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:04.582550 tst encryption: Using 1 x bts (candidates: 1) 22:59:04.619713 tst register_a5_0_authreq.py: using LAC 24255 22:59:04.741414 tst register_a5_0_authreq.py: using RAC 30 22:59:04.871782 tst register_a5_0_authreq.py: using CellId 24255 22:59:05.005643 tst register_a5_0_authreq.py: using BVCI 24256 22:59:05.118381 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:05.129100 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:05.139631 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:05.150628 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:05.161556 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:05.172310 tst encryption: Using 1 x modem (candidates: 1) 22:59:05.293938 tst register_a5_0_authreq.py:8: start network... 22:59:05.515275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:59:06.018676 run create_hlr_db(pid=27371): Launched 22:59:06.151965 bus /sierra_2: Setting Powered False 22:59:07.216037 run create_hlr_db(pid=27371): Terminated: ok {rc=0} 22:59:07.670914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27373): Launched 22:59:07.998874 run osmo-hlr_10.42.42.2(pid=27374): Launched 22:59:08.123681 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:08.687347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27376): Launched 22:59:09.012150 run osmo-stp_10.42.42.5(pid=27377): Launched 22:59:09.137007 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:09.725191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27379): Launched 22:59:10.052053 run osmo-msc_10.42.42.6(pid=27380): Launched 22:59:10.234816 run osmo-stp_10.42.42.5(pid=27377): ERR: Terminated: ERROR {rc=1} [trial-2365↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27377)] 22:59:10.371844 run osmo-stp_10.42.42.5(pid=27377): stdout: | (launched: 2022-12-09_22:59:08.953625) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:10.511212 run osmo-stp_10.42.42.5(pid=27377): stderr: | 20221209225909145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225909145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225909145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225909146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225909146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225909146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225909146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:10.647860 run osmo-stp_10.42.42.5(pid=27377): stdout: | (launched: 2022-12-09_22:59:08.953625) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:10.777448 run osmo-stp_10.42.42.5(pid=27377): stderr: | 20221209225909145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225909145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225909145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225909146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225909146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225909146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225909146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:10.932466 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27377): Process ended prematurely: osmo-stp_10.42.42.5(pid=27377) [trial-2365↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27377)] [trial-2365↪encryption↪register_a5_0_authreq.py:8] 22:59:10.942016 tst register_a5_0_authreq.py:8: Test FAILED (6.4 sec) 22:59:10.969571 run osmo-hlr_10.42.42.2(pid=27374): ERR: Terminated: ERROR {rc=237} [trial-2365↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27374)] 22:59:11.019489 run osmo-hlr_10.42.42.2(pid=27374): stdout: | (launched: 2022-12-09_22:59:07.939395) 22:59:11.071032 run osmo-hlr_10.42.42.2(pid=27374): stderr: | 20221209225908138 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225908138 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225908138 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225908138 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225908138 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225908138 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225908150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225908159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225908159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225908159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:11.142853 run osmo-msc_10.42.42.6(pid=27380): ERR: Terminated: ERROR {rc=2} [trial-2365↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27380)] 22:59:11.192548 run osmo-msc_10.42.42.6(pid=27380): stdout: | (launched: 2022-12-09_22:59:09.993267) 22:59:11.244212 run osmo-msc_10.42.42.6(pid=27380): stderr: | 20221209225910316 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225910316 DLGLOBAL DEBUG validating counter group 0x7f517fa52c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225910316 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225910317 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225910317 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225910317 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225910319 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225910319 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225910319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225910319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:11.296074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27373): Terminating (SIGTERM) 22:59:11.337428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27376): Terminating (SIGTERM) 22:59:11.378813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27379): Terminating (SIGTERM) 22:59:11.420573 --- ParallelTerminationStrategy: PID 27373 died... 22:59:11.440383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27373): Terminated: ok {rc=0} 22:59:11.486141 --- ParallelTerminationStrategy: PID 27376 died... 22:59:11.505826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27376): Terminated: ok {rc=0} 22:59:11.552062 --- ParallelTerminationStrategy: PID 27379 died... 22:59:11.571447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27379): Terminated: ok {rc=0} 22:59:11.658612 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 encryption register_a5_1_authreq.py ---------------------------------------------- 22:59:12.813247 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:12.824714 tst encryption: Using 1 x bts (candidates: 1) 22:59:12.862501 tst register_a5_1_authreq.py: using LAC 24256 22:59:12.995632 tst register_a5_1_authreq.py: using RAC 31 22:59:13.123660 tst register_a5_1_authreq.py: using CellId 24256 22:59:13.249464 tst register_a5_1_authreq.py: using BVCI 24257 22:59:13.363234 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:13.373915 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:13.384282 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:13.395317 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:13.406519 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:13.417732 tst encryption: Using 1 x modem (candidates: 1) 22:59:13.538202 tst register_a5_1_authreq.py:8: start network... 22:59:13.760447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:59:14.266068 run create_hlr_db(pid=27382): Launched 22:59:14.399686 bus /sierra_2: Setting Powered False 22:59:15.464914 run create_hlr_db(pid=27382): Terminated: ok {rc=0} 22:59:15.961250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27384): Launched 22:59:16.290380 run osmo-hlr_10.42.42.2(pid=27385): Launched 22:59:16.427710 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:17.163439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27387): Launched 22:59:17.480596 run osmo-stp_10.42.42.5(pid=27388): Launched 22:59:17.600597 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:18.152519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27390): Launched 22:59:18.458631 run osmo-msc_10.42.42.6(pid=27391): Launched 22:59:18.631850 run osmo-stp_10.42.42.5(pid=27388): ERR: Terminated: ERROR {rc=1} [trial-2365↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27388)] 22:59:18.761545 run osmo-stp_10.42.42.5(pid=27388): stdout: | (launched: 2022-12-09_22:59:17.425204) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:18.891669 run osmo-stp_10.42.42.5(pid=27388): stderr: | 20221209225917596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225917596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225917597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225917597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225917598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225917598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225917598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:19.019474 run osmo-stp_10.42.42.5(pid=27388): stdout: | (launched: 2022-12-09_22:59:17.425204) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:19.141504 run osmo-stp_10.42.42.5(pid=27388): stderr: | 20221209225917596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225917596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225917597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225917597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225917598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225917598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225917598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:19.287238 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27388): Process ended prematurely: osmo-stp_10.42.42.5(pid=27388) [trial-2365↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27388)] [trial-2365↪encryption↪register_a5_1_authreq.py:8] 22:59:19.296120 tst register_a5_1_authreq.py:8: Test FAILED (6.5 sec) 22:59:19.322988 run osmo-hlr_10.42.42.2(pid=27385): ERR: Terminated: ERROR {rc=237} [trial-2365↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27385)] 22:59:19.371218 run osmo-hlr_10.42.42.2(pid=27385): stdout: | (launched: 2022-12-09_22:59:16.227954) 22:59:19.420898 run osmo-hlr_10.42.42.2(pid=27385): stderr: | 20221209225916555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225916555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225916555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225916555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225916555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225916555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225916567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225916581 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225916581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225916581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:19.489972 run osmo-msc_10.42.42.6(pid=27391): ERR: Terminated: ERROR {rc=2} [trial-2365↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27391)] 22:59:19.537728 run osmo-msc_10.42.42.6(pid=27391): stdout: | (launched: 2022-12-09_22:59:18.403128) 22:59:19.587324 run osmo-msc_10.42.42.6(pid=27391): stderr: | 20221209225918675 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225918676 DLGLOBAL DEBUG validating counter group 0x7f227a7c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225918676 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225918676 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225918676 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225918676 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225918678 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225918678 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225918678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225918679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:19.637295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27384): Terminating (SIGTERM) 22:59:19.676886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27387): Terminating (SIGTERM) 22:59:19.717002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27390): Terminating (SIGTERM) 22:59:19.757206 --- ParallelTerminationStrategy: PID 27384 died... 22:59:19.776048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27384): Terminated: ok {rc=0} 22:59:19.820679 --- ParallelTerminationStrategy: PID 27387 died... 22:59:19.839331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27387): Terminated: ok {rc=0} 22:59:19.883828 --- ParallelTerminationStrategy: PID 27390 died... 22:59:19.902713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27390): Terminated: ok {rc=0} 22:59:19.988479 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2365 encryption register_a5_3_authreq.py ---------------------------------------------- 22:59:21.140723 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:21.151836 tst encryption: Using 1 x bts (candidates: 1) 22:59:21.187180 tst register_a5_3_authreq.py: using LAC 24257 22:59:21.307870 tst register_a5_3_authreq.py: using RAC 32 22:59:21.428868 tst register_a5_3_authreq.py: using CellId 24257 22:59:21.558341 tst register_a5_3_authreq.py: using BVCI 24258 22:59:21.678161 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:21.689196 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:21.700049 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:21.710909 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:21.721629 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:21.732350 tst encryption: Using 1 x modem (candidates: 1) 22:59:21.856496 tst register_a5_3_authreq.py:8: start network... 22:59:22.065239 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:59:22.538537 run create_hlr_db(pid=27393): Launched 22:59:22.657431 bus /sierra_2: Setting Powered False 22:59:23.718392 run create_hlr_db(pid=27393): Terminated: ok {rc=0} 22:59:24.166281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27395): Launched 22:59:24.493873 run osmo-hlr_10.42.42.2(pid=27396): Launched 22:59:24.620441 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:25.181686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27398): Launched 22:59:25.508830 run osmo-stp_10.42.42.5(pid=27399): Launched 22:59:25.635032 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:26.224544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27401): Launched 22:59:26.550391 run osmo-msc_10.42.42.6(pid=27402): Launched 22:59:26.732630 run osmo-stp_10.42.42.5(pid=27399): ERR: Terminated: ERROR {rc=1} [trial-2365↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27399)] 22:59:26.869440 run osmo-stp_10.42.42.5(pid=27399): stdout: | (launched: 2022-12-09_22:59:25.449902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:27.007619 run osmo-stp_10.42.42.5(pid=27399): stderr: | 20221209225925644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225925645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225925645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225925645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225925646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225925646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225925646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:27.144812 run osmo-stp_10.42.42.5(pid=27399): stdout: | (launched: 2022-12-09_22:59:25.449902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:27.274995 run osmo-stp_10.42.42.5(pid=27399): stderr: | 20221209225925644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209225925645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209225925645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209225925645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209225925646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209225925646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209225925646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:27.430472 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27399): Process ended prematurely: osmo-stp_10.42.42.5(pid=27399) [trial-2365↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27399)] [trial-2365↪encryption↪register_a5_3_authreq.py:8] 22:59:27.440129 tst register_a5_3_authreq.py:8: Test FAILED (6.3 sec) 22:59:27.467744 run osmo-hlr_10.42.42.2(pid=27396): ERR: Terminated: ERROR {rc=237} [trial-2365↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27396)] 22:59:27.518748 run osmo-hlr_10.42.42.2(pid=27396): stdout: | (launched: 2022-12-09_22:59:24.435304) 22:59:27.570864 run osmo-hlr_10.42.42.2(pid=27396): stderr: | 20221209225924634 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209225924634 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209225924634 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209225924634 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209225924634 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209225924634 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209225924654 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209225924665 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209225924665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209225924665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:27.643020 run osmo-msc_10.42.42.6(pid=27402): ERR: Terminated: ERROR {rc=2} [trial-2365↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27402)] 22:59:27.693178 run osmo-msc_10.42.42.6(pid=27402): stdout: | (launched: 2022-12-09_22:59:26.491522) 22:59:27.744886 run osmo-msc_10.42.42.6(pid=27402): stderr: | 20221209225926815 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209225926815 DLGLOBAL DEBUG validating counter group 0x7f4e8150ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209225926816 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209225926816 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209225926816 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209225926816 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209225926819 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209225926819 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209225926819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209225926819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:27.796823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27395): Terminating (SIGTERM) 22:59:27.838576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27398): Terminating (SIGTERM) 22:59:27.880462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27401): Terminating (SIGTERM) 22:59:27.922320 --- ParallelTerminationStrategy: PID 27395 died... 22:59:27.941948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27395): Terminated: ok {rc=0} 22:59:27.988506 --- ParallelTerminationStrategy: PID 27398 died... 22:59:28.007925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27398): Terminated: ok {rc=0} 22:59:28.054025 --- ParallelTerminationStrategy: PID 27401 died... 22:59:28.073637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27401): Terminated: ok {rc=0} 22:59:28.161393 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 22:59:29.371281 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:59:29.377253 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 22:59:29.397099 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 22:59:29.424883 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 22:59:29.454832 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 22:59:29.474150 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 22:59:29.500532 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 22:59:30.012324 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2365 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 22:59:30.018239 tst handover.py:11: TEST_CONFIG: {} 22:59:30.227169 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 22:59:30.243127 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 22:59:30.265952 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 22:59:30.315777 tst handover.py: using MSISDN 7425 22:59:30.436361 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7425', subscriber_id=0} 22:59:30.551355 run srsepc_10.42.42.118: Starting srsepc 22:59:32.510410 run rm-remote-dir(pid=27407): Launched 22:59:32.642726 bus /sierra_2: Setting Powered False 22:59:33.711607 run rm-remote-dir(pid=27407): Terminated: ok {rc=0} 22:59:34.185529 run mk-remote-dir(pid=27408): Launched 22:59:35.378535 run mk-remote-dir(pid=27408): Terminated: ok {rc=0} 22:59:35.685993 run scp-inst-to-remote(pid=27409): Launched 22:59:37.877781 run scp-inst-to-remote(pid=27409): Terminated: ok {rc=0} 22:59:38.234045 run rm-remote-dir(pid=27411): Launched 22:59:39.426178 run rm-remote-dir(pid=27411): Terminated: ok {rc=0} 22:59:39.784659 run mk-remote-dir(pid=27412): Launched 22:59:40.977272 run mk-remote-dir(pid=27412): Terminated: ok {rc=0} 22:59:41.281680 run scp-cfg-to-remote(pid=27413): Launched 22:59:42.472419 run scp-cfg-to-remote(pid=27413): Terminated: ok {rc=0} 22:59:42.774971 run scp-db-to-remote(pid=27415): Launched 22:59:43.964848 run scp-db-to-remote(pid=27415): Terminated: ok {rc=0} 22:59:44.106408 run srsepc_10.42.42.118: Setting RPATH for srsepc 22:59:44.434920 run patchelf(pid=27417): Launched 22:59:45.625858 run patchelf(pid=27417): Terminated: ok {rc=0} 22:59:45.766505 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 22:59:46.119710 run setcap-netadm(pid=27418): Launched 22:59:47.356552 run setcap-netadm(pid=27418): Terminated: ok {rc=0} 22:59:47.680469 run srsepc(pid=27419): Launched 22:59:47.794632 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 22:59:48.902112 run rm-remote-dir(pid=27421): Launched 22:59:49.078560 run srsepc(pid=27419): ERR: Terminated: ERROR {rc=127} [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27419)] 22:59:49.213632 run srsepc(pid=27419): stdout: | (launched: 2022-12-09_22:59:47.624906) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 22:59:49.348919 run srsepc(pid=27419): stderr: | (launched: 2022-12-09_22:59:47.670459) | Connection to 10.42.42.116 closed. 22:59:49.483803 run srsepc(pid=27419): stdout: | (launched: 2022-12-09_22:59:47.624906) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 22:59:49.614382 run srsepc(pid=27419): stderr: | (launched: 2022-12-09_22:59:47.670459) | Connection to 10.42.42.116 closed. 22:59:49.768181 run rm-remote-dir(pid=27421): Terminating (SIGINT) 22:59:49.947203 run rm-remote-dir(pid=27421): Terminated: ok {rc=0} 22:59:50.076141 tst handover.py:37: ERR: Error: srsepc(pid=27419): Process ended prematurely: srsepc(pid=27419) [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27419)] [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 22:59:50.086240 tst handover.py:37: Test FAILED (20.1 sec) 22:59:50.163497 run scp-back-log(pid=27422): Launched 22:59:51.239510 run scp-back-log(pid=27422): ERR: Terminated: ERROR {rc=1} [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27422)] 22:59:51.300197 run scp-back-log(pid=27422): stdout: | (launched: 2022-12-09_22:59:50.133660) 22:59:51.362550 run scp-back-log(pid=27422): stderr: | (launched: 2022-12-09_22:59:50.153538) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 22:59:51.432580 tst srsepc_10.42.42.118: Error('scp-back-log(pid=27422): launch_sync(): local process exited with status 1 [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27422)]') ---------------------------------------------- trial-2365 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 22:59:51.479340 tst iperf3_bidir.py:13: Number of physical ue: 1 22:59:51.686968 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 22:59:51.727886 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 22:59:51.931466 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 22:59:51.947166 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 22:59:51.978846 tst iperf3_bidir.py: using MSISDN 7426 22:59:52.092739 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7426', subscriber_id=0} 22:59:52.201315 run srsepc_10.42.42.118: Starting srsepc 22:59:52.832686 run rm-remote-dir(pid=27424): Launched 22:59:54.011749 run rm-remote-dir(pid=27424): Terminated: ok {rc=0} 22:59:54.346498 run mk-remote-dir(pid=27425): Launched 22:59:55.524371 run mk-remote-dir(pid=27425): Terminated: ok {rc=0} 22:59:55.810000 run scp-inst-to-remote(pid=27426): Launched 22:59:57.989448 run scp-inst-to-remote(pid=27426): Terminated: ok {rc=0} 22:59:58.323675 run rm-remote-dir(pid=27428): Launched 22:59:59.502813 run rm-remote-dir(pid=27428): Terminated: ok {rc=0} 22:59:59.837452 run mk-remote-dir(pid=27429): Launched 23:00:01.016440 run mk-remote-dir(pid=27429): Terminated: ok {rc=0} 23:00:01.411482 run scp-cfg-to-remote(pid=27430): Launched 23:00:02.665689 run scp-cfg-to-remote(pid=27430): Terminated: ok {rc=0} 23:00:02.949116 run scp-db-to-remote(pid=27435): Launched 23:00:04.125935 run scp-db-to-remote(pid=27435): Terminated: ok {rc=0} 23:00:04.257984 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:00:04.564413 run patchelf(pid=27437): Launched 23:00:05.754985 run patchelf(pid=27437): Terminated: ok {rc=0} 23:00:05.895852 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:00:06.222922 run setcap-netadm(pid=27438): Launched 23:00:07.411944 run setcap-netadm(pid=27438): Terminated: ok {rc=0} 23:00:07.755589 run srsepc(pid=27439): Launched 23:00:07.878323 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:00:09.068217 run rm-remote-dir(pid=27440): Launched 23:00:09.257729 run srsepc(pid=27439): ERR: Terminated: ERROR {rc=127} [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27439)] 23:00:09.402384 run srsepc(pid=27439): stdout: | (launched: 2022-12-09_23:00:07.696568) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:09.546880 run srsepc(pid=27439): stderr: | (launched: 2022-12-09_23:00:07.745468) | Connection to 10.42.42.116 closed. 23:00:09.690614 run srsepc(pid=27439): stdout: | (launched: 2022-12-09_23:00:07.696568) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:09.829311 run srsepc(pid=27439): stderr: | (launched: 2022-12-09_23:00:07.745468) | Connection to 10.42.42.116 closed. 23:00:09.993697 run rm-remote-dir(pid=27440): Terminating (SIGINT) 23:00:10.183835 run rm-remote-dir(pid=27440): Terminated: ok {rc=0} 23:00:10.321247 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=27439): Process ended prematurely: srsepc(pid=27439) [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27439)] [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 23:00:10.331988 tst iperf3_bidir.py:42: Test FAILED (18.8 sec) 23:00:10.411424 run scp-back-log(pid=27441): Launched 23:00:11.491949 run scp-back-log(pid=27441): ERR: Terminated: ERROR {rc=1} [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27441)] 23:00:11.556616 run scp-back-log(pid=27441): stdout: | (launched: 2022-12-09_23:00:10.380594) 23:00:11.622224 run scp-back-log(pid=27441): stderr: | (launched: 2022-12-09_23:00:10.401346) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:00:11.695524 tst srsepc_10.42.42.118: Error('scp-back-log(pid=27441): launch_sync(): local process exited with status 1 [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27441)]') ---------------------------------------------- trial-2365 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 23:00:11.745555 tst iperf3_dl.py:13: Number of physical ue: 1 23:00:11.966772 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:00:12.011860 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 23:00:12.218357 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:00:12.234296 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:00:12.267223 tst iperf3_dl.py: using MSISDN 7427 23:00:12.386691 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7427', subscriber_id=0} 23:00:12.500480 run srsepc_10.42.42.118: Starting srsepc 23:00:13.166282 run rm-remote-dir(pid=27443): Launched 23:00:14.358102 run rm-remote-dir(pid=27443): Terminated: ok {rc=0} 23:00:14.715060 run mk-remote-dir(pid=27444): Launched 23:00:15.926870 run mk-remote-dir(pid=27444): Terminated: ok {rc=0} 23:00:16.260487 run scp-inst-to-remote(pid=27445): Launched 23:00:18.458069 run scp-inst-to-remote(pid=27445): Terminated: ok {rc=0} 23:00:18.792379 run rm-remote-dir(pid=27447): Launched 23:00:19.970900 run rm-remote-dir(pid=27447): Terminated: ok {rc=0} 23:00:20.305490 run mk-remote-dir(pid=27448): Launched 23:00:21.486989 run mk-remote-dir(pid=27448): Terminated: ok {rc=0} 23:00:21.772128 run scp-cfg-to-remote(pid=27449): Launched 23:00:22.949517 run scp-cfg-to-remote(pid=27449): Terminated: ok {rc=0} 23:00:23.233046 run scp-db-to-remote(pid=27451): Launched 23:00:24.410898 run scp-db-to-remote(pid=27451): Terminated: ok {rc=0} 23:00:24.543040 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:00:24.850409 run patchelf(pid=27453): Launched 23:00:26.027190 run patchelf(pid=27453): Terminated: ok {rc=0} 23:00:26.158687 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:00:26.467232 run setcap-netadm(pid=27454): Launched 23:00:27.643169 run setcap-netadm(pid=27454): Terminated: ok {rc=0} 23:00:27.966371 run srsepc(pid=27455): Launched 23:00:28.080030 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:00:29.186480 run rm-remote-dir(pid=27456): Launched 23:00:29.363107 run srsepc(pid=27455): ERR: Terminated: ERROR {rc=127} [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27455)] 23:00:29.497934 run srsepc(pid=27455): stdout: | (launched: 2022-12-09_23:00:27.910610) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:29.633621 run srsepc(pid=27455): stderr: | (launched: 2022-12-09_23:00:27.956159) | Connection to 10.42.42.116 closed. 23:00:29.768715 run srsepc(pid=27455): stdout: | (launched: 2022-12-09_23:00:27.910610) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:29.898818 run srsepc(pid=27455): stderr: | (launched: 2022-12-09_23:00:27.956159) | Connection to 10.42.42.116 closed. 23:00:30.052476 run rm-remote-dir(pid=27456): Terminating (SIGINT) 23:00:30.231089 run rm-remote-dir(pid=27456): Terminated: ok {rc=0} 23:00:30.360236 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=27455): Process ended prematurely: srsepc(pid=27455) [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27455)] [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 23:00:30.370545 tst iperf3_dl.py:42: Test FAILED (18.6 sec) 23:00:30.448229 run scp-back-log(pid=27457): Launched 23:00:31.527812 run scp-back-log(pid=27457): ERR: Terminated: ERROR {rc=1} [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27457)] 23:00:31.592459 run scp-back-log(pid=27457): stdout: | (launched: 2022-12-09_23:00:30.418039) 23:00:31.658108 run scp-back-log(pid=27457): stderr: | (launched: 2022-12-09_23:00:30.437819) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:00:31.732168 tst srsepc_10.42.42.118: Error('scp-back-log(pid=27457): launch_sync(): local process exited with status 1 [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27457)]') ---------------------------------------------- trial-2365 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 23:00:31.783172 tst iperf3_ul.py:13: Number of physical ue: 1 23:00:32.030959 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:00:32.074856 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 23:00:32.300856 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:00:32.317266 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:00:32.349371 tst iperf3_ul.py: using MSISDN 7428 23:00:32.466600 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7428', subscriber_id=0} 23:00:32.580880 run srsepc_10.42.42.118: Starting srsepc 23:00:33.246571 run rm-remote-dir(pid=27459): Launched 23:00:34.438186 run rm-remote-dir(pid=27459): Terminated: ok {rc=0} 23:00:34.794426 run mk-remote-dir(pid=27460): Launched 23:00:35.983763 run mk-remote-dir(pid=27460): Terminated: ok {rc=0} 23:00:36.286121 run scp-inst-to-remote(pid=27461): Launched 23:00:38.472534 run scp-inst-to-remote(pid=27461): Terminated: ok {rc=0} 23:00:38.805233 run rm-remote-dir(pid=27463): Launched 23:00:39.989227 run rm-remote-dir(pid=27463): Terminated: ok {rc=0} 23:00:40.346124 run mk-remote-dir(pid=27464): Launched 23:00:41.537645 run mk-remote-dir(pid=27464): Terminated: ok {rc=0} 23:00:41.840357 run scp-cfg-to-remote(pid=27465): Launched 23:00:43.029257 run scp-cfg-to-remote(pid=27465): Terminated: ok {rc=0} 23:00:43.329629 run scp-db-to-remote(pid=27467): Launched 23:00:44.516579 run scp-db-to-remote(pid=27467): Terminated: ok {rc=0} 23:00:44.649412 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:00:44.955784 run patchelf(pid=27469): Launched 23:00:46.130396 run patchelf(pid=27469): Terminated: ok {rc=0} 23:00:46.266106 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:00:46.586070 run setcap-netadm(pid=27470): Launched 23:00:47.915365 run setcap-netadm(pid=27470): Terminated: ok {rc=0} 23:00:48.237616 run srsepc(pid=27471): Launched 23:00:48.352282 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:00:49.459000 run rm-remote-dir(pid=27472): Launched 23:00:49.634932 run srsepc(pid=27471): ERR: Terminated: ERROR {rc=127} [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27471)] 23:00:49.769162 run srsepc(pid=27471): stdout: | (launched: 2022-12-09_23:00:48.182095) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:49.904408 run srsepc(pid=27471): stderr: | (launched: 2022-12-09_23:00:48.227372) | Connection to 10.42.42.116 closed. 23:00:50.039611 run srsepc(pid=27471): stdout: | (launched: 2022-12-09_23:00:48.182095) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:50.170680 run srsepc(pid=27471): stderr: | (launched: 2022-12-09_23:00:48.227372) | Connection to 10.42.42.116 closed. 23:00:50.324224 run rm-remote-dir(pid=27472): Terminating (SIGINT) 23:00:50.503267 run rm-remote-dir(pid=27472): Terminated: ok {rc=0} 23:00:50.633153 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=27471): Process ended prematurely: srsepc(pid=27471) [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27471)] [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 23:00:50.643377 tst iperf3_ul.py:42: Test FAILED (18.9 sec) 23:00:50.720340 run scp-back-log(pid=27473): Launched 23:00:51.797231 run scp-back-log(pid=27473): ERR: Terminated: ERROR {rc=1} [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27473)] 23:00:51.858013 run scp-back-log(pid=27473): stdout: | (launched: 2022-12-09_23:00:50.690597) 23:00:51.920317 run scp-back-log(pid=27473): stderr: | (launched: 2022-12-09_23:00:50.710231) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:00:51.990370 tst srsepc_10.42.42.118: Error('scp-back-log(pid=27473): launch_sync(): local process exited with status 1 [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27473)]') ---------------------------------------------- trial-2365 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 23:00:52.038752 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:00:52.055311 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:00:52.079087 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:00:52.129715 tst ping.py: using MSISDN 7429 23:00:52.244158 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7429', subscriber_id=0} 23:00:52.350463 run srsepc_10.42.42.118: Starting srsepc 23:00:52.974825 run rm-remote-dir(pid=27475): Launched 23:00:54.153509 run rm-remote-dir(pid=27475): Terminated: ok {rc=0} 23:00:54.487983 run mk-remote-dir(pid=27476): Launched 23:00:55.667334 run mk-remote-dir(pid=27476): Terminated: ok {rc=0} 23:00:55.951508 run scp-inst-to-remote(pid=27477): Launched 23:00:58.133784 run scp-inst-to-remote(pid=27477): Terminated: ok {rc=0} 23:00:58.487678 run rm-remote-dir(pid=27479): Launched 23:00:59.679379 run rm-remote-dir(pid=27479): Terminated: ok {rc=0} 23:01:00.034624 run mk-remote-dir(pid=27480): Launched 23:01:01.225660 run mk-remote-dir(pid=27480): Terminated: ok {rc=0} 23:01:01.545787 run scp-cfg-to-remote(pid=27481): Launched 23:01:02.792534 run scp-cfg-to-remote(pid=27481): Terminated: ok {rc=0} 23:01:03.092940 run scp-db-to-remote(pid=27483): Launched 23:01:04.281436 run scp-db-to-remote(pid=27483): Terminated: ok {rc=0} 23:01:04.420473 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:01:04.748094 run patchelf(pid=27485): Launched 23:01:05.937257 run patchelf(pid=27485): Terminated: ok {rc=0} 23:01:06.076336 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:01:06.402719 run setcap-netadm(pid=27486): Launched 23:01:07.592648 run setcap-netadm(pid=27486): Terminated: ok {rc=0} 23:01:07.934698 run srsepc(pid=27487): Launched 23:01:08.056463 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:01:09.167998 run rm-remote-dir(pid=27488): Launched 23:01:09.345811 run srsepc(pid=27487): ERR: Terminated: ERROR {rc=127} [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27487)] 23:01:09.480054 run srsepc(pid=27487): stdout: | (launched: 2022-12-09_23:01:07.875955) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:09.615493 run srsepc(pid=27487): stderr: | (launched: 2022-12-09_23:01:07.924339) | Connection to 10.42.42.116 closed. 23:01:09.750461 run srsepc(pid=27487): stdout: | (launched: 2022-12-09_23:01:07.875955) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:09.880440 run srsepc(pid=27487): stderr: | (launched: 2022-12-09_23:01:07.924339) | Connection to 10.42.42.116 closed. 23:01:10.034781 run rm-remote-dir(pid=27488): Terminating (SIGINT) 23:01:10.214068 run rm-remote-dir(pid=27488): Terminated: ok {rc=0} 23:01:10.342766 tst ping.py:16: ERR: Error: srsepc(pid=27487): Process ended prematurely: srsepc(pid=27487) [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27487)] [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 23:01:10.352571 tst ping.py:16: Test FAILED (18.3 sec) 23:01:10.428885 run scp-back-log(pid=27489): Launched 23:01:11.505839 run scp-back-log(pid=27489): ERR: Terminated: ERROR {rc=1} [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27489)] 23:01:11.567401 run scp-back-log(pid=27489): stdout: | (launched: 2022-12-09_23:01:10.399270) 23:01:11.629243 run scp-back-log(pid=27489): stderr: | (launched: 2022-12-09_23:01:10.418792) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:01:11.698956 tst srsepc_10.42.42.118: Error('scp-back-log(pid=27489): launch_sync(): local process exited with status 1 [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27489)]') ---------------------------------------------- trial-2365 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 23:01:11.746488 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:01:11.762924 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:01:11.785811 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:01:11.836126 tst rrc_idle_mo_ping.py: using MSISDN 7430 23:01:11.950901 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7430', subscriber_id=0} 23:01:12.057324 run srsepc_10.42.42.118: Starting srsepc 23:01:12.677478 run rm-remote-dir(pid=27491): Launched 23:01:13.857281 run rm-remote-dir(pid=27491): Terminated: ok {rc=0} 23:01:14.190761 run mk-remote-dir(pid=27492): Launched 23:01:15.368500 run mk-remote-dir(pid=27492): Terminated: ok {rc=0} 23:01:15.652114 run scp-inst-to-remote(pid=27493): Launched 23:01:17.829494 run scp-inst-to-remote(pid=27493): Terminated: ok {rc=0} 23:01:18.160788 run rm-remote-dir(pid=27495): Launched 23:01:19.338712 run rm-remote-dir(pid=27495): Terminated: ok {rc=0} 23:01:19.671770 run mk-remote-dir(pid=27496): Launched 23:01:20.850037 run mk-remote-dir(pid=27496): Terminated: ok {rc=0} 23:01:21.133675 run scp-cfg-to-remote(pid=27497): Launched 23:01:22.309811 run scp-cfg-to-remote(pid=27497): Terminated: ok {rc=0} 23:01:22.592053 run scp-db-to-remote(pid=27499): Launched 23:01:23.768868 run scp-db-to-remote(pid=27499): Terminated: ok {rc=0} 23:01:23.900870 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:01:24.206472 run patchelf(pid=27501): Launched 23:01:25.381455 run patchelf(pid=27501): Terminated: ok {rc=0} 23:01:25.512835 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:01:25.818312 run setcap-netadm(pid=27502): Launched 23:01:26.994223 run setcap-netadm(pid=27502): Terminated: ok {rc=0} 23:01:27.315077 run srsepc(pid=27503): Launched 23:01:27.428316 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:01:28.530097 run rm-remote-dir(pid=27504): Launched 23:01:28.706234 run srsepc(pid=27503): ERR: Terminated: ERROR {rc=127} [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27503)] 23:01:28.840226 run srsepc(pid=27503): stdout: | (launched: 2022-12-09_23:01:27.259833) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:28.975778 run srsepc(pid=27503): stderr: | (launched: 2022-12-09_23:01:27.305166) | Connection to 10.42.42.116 closed. 23:01:29.110486 run srsepc(pid=27503): stdout: | (launched: 2022-12-09_23:01:27.259833) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:29.239977 run srsepc(pid=27503): stderr: | (launched: 2022-12-09_23:01:27.305166) | Connection to 10.42.42.116 closed. 23:01:29.393289 run rm-remote-dir(pid=27504): Terminating (SIGINT) 23:01:29.572050 run rm-remote-dir(pid=27504): Terminated: ok {rc=0} 23:01:29.700857 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=27503): Process ended prematurely: srsepc(pid=27503) [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27503)] [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 23:01:29.710677 tst rrc_idle_mo_ping.py:16: Test FAILED (18.0 sec) 23:01:29.786797 run scp-back-log(pid=27505): Launched 23:01:30.871613 run scp-back-log(pid=27505): ERR: Terminated: ERROR {rc=1} [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27505)] 23:01:30.948700 run scp-back-log(pid=27505): stdout: | (launched: 2022-12-09_23:01:29.757413) 23:01:31.022488 run scp-back-log(pid=27505): stderr: | (launched: 2022-12-09_23:01:29.777110) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:01:31.119276 tst srsepc_10.42.42.118: Error('scp-back-log(pid=27505): launch_sync(): local process exited with status 1 [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27505)]') ---------------------------------------------- trial-2365 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 23:01:31.170543 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:01:31.188776 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:01:31.214048 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:01:31.267177 tst rrc_idle_mt_ping.py: using MSISDN 7431 23:01:31.389669 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7431', subscriber_id=0} 23:01:31.506513 run srsepc_10.42.42.118: Starting srsepc 23:01:32.189694 run rm-remote-dir(pid=27507): Launched 23:01:33.385492 run rm-remote-dir(pid=27507): Terminated: ok {rc=0} 23:01:33.718734 run mk-remote-dir(pid=27508): Launched 23:01:34.895891 run mk-remote-dir(pid=27508): Terminated: ok {rc=0} 23:01:35.180541 run scp-inst-to-remote(pid=27509): Launched 23:01:37.359392 run scp-inst-to-remote(pid=27509): Terminated: ok {rc=0} 23:01:37.691065 run rm-remote-dir(pid=27511): Launched 23:01:38.869500 run rm-remote-dir(pid=27511): Terminated: ok {rc=0} 23:01:39.204031 run mk-remote-dir(pid=27512): Launched 23:01:40.381974 run mk-remote-dir(pid=27512): Terminated: ok {rc=0} 23:01:40.665998 run scp-cfg-to-remote(pid=27513): Launched 23:01:41.842482 run scp-cfg-to-remote(pid=27513): Terminated: ok {rc=0} 23:01:42.124159 run scp-db-to-remote(pid=27515): Launched 23:01:43.299997 run scp-db-to-remote(pid=27515): Terminated: ok {rc=0} 23:01:43.430789 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:01:43.736022 run patchelf(pid=27517): Launched 23:01:44.911068 run patchelf(pid=27517): Terminated: ok {rc=0} 23:01:45.042329 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:01:45.348778 run setcap-netadm(pid=27518): Launched 23:01:46.535528 run setcap-netadm(pid=27518): Terminated: ok {rc=0} 23:01:46.985348 run srsepc(pid=27519): Launched 23:01:47.120692 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:01:48.255298 run rm-remote-dir(pid=27520): Launched 23:01:48.431420 run srsepc(pid=27519): ERR: Terminated: ERROR {rc=127} [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27519)] 23:01:48.565563 run srsepc(pid=27519): stdout: | (launched: 2022-12-09_23:01:46.913124) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:48.700194 run srsepc(pid=27519): stderr: | (launched: 2022-12-09_23:01:46.969622) | Connection to 10.42.42.116 closed. 23:01:48.834917 run srsepc(pid=27519): stdout: | (launched: 2022-12-09_23:01:46.913124) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:48.964785 run srsepc(pid=27519): stderr: | (launched: 2022-12-09_23:01:46.969622) | Connection to 10.42.42.116 closed. 23:01:49.119113 run rm-remote-dir(pid=27520): Terminating (SIGINT) 23:01:49.297492 run rm-remote-dir(pid=27520): Terminated: ok {rc=0} 23:01:49.426132 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=27519): Process ended prematurely: srsepc(pid=27519) [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27519)] [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 23:01:49.435882 tst rrc_idle_mt_ping.py:16: Test FAILED (18.3 sec) 23:01:49.511827 run scp-back-log(pid=27521): Launched 23:01:50.588732 run scp-back-log(pid=27521): ERR: Terminated: ERROR {rc=1} [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27521)] 23:01:50.649297 run scp-back-log(pid=27521): stdout: | (launched: 2022-12-09_23:01:49.482395) 23:01:50.711274 run scp-back-log(pid=27521): stderr: | (launched: 2022-12-09_23:01:49.502056) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:01:50.781469 tst srsepc_10.42.42.118: Error('scp-back-log(pid=27521): launch_sync(): local process exited with status 1 [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27521)]') --------------------------------------------------------------------- trial-2365 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 23:01:50.914578 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:01:50.920504 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 23:01:50.964312 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 23:01:50.991679 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 23:01:51.046929 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 23:01:51.089873 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 23:01:51.116572 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 23:01:51.665895 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 23:01:51.672497 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:51.684905 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 23:01:51.726205 tst handover.py: using LAC 24258 23:01:51.847252 tst handover.py: using RAC 33 23:01:51.966355 tst handover.py: using CellId 24258 23:01:52.085407 tst handover.py: using BVCI 24259 23:01:52.197472 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 23:01:52.230686 tst handover.py: using LAC 24259 23:01:52.357130 tst handover.py: using RAC 34 23:01:52.480857 tst handover.py: using CellId 24259 23:01:52.604565 tst handover.py: using BVCI 24260 23:01:52.720839 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:52.731933 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:52.743023 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:52.753935 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:52.764899 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:52.775805 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 23:01:52.896435 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 23:01:53.012759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:01:53.509881 run create_hlr_db(pid=27527): Launched 23:01:54.689729 run create_hlr_db(pid=27527): Terminated: ok {rc=0} 23:01:55.027329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27529): Launched 23:01:55.347461 run osmo-hlr_10.42.42.2(pid=27530): Launched 23:01:55.470439 run osmo-stp_10.42.42.5: Starting osmo-stp 23:01:56.018492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27532): Launched 23:01:56.338585 run osmo-stp_10.42.42.5(pid=27533): Launched 23:01:56.461070 run osmo-msc_10.42.42.6: Starting osmo-msc 23:01:57.038561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27535): Launched 23:01:57.358800 run osmo-msc_10.42.42.6(pid=27536): Launched 23:01:57.539158 run osmo-stp_10.42.42.5(pid=27533): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27533)] 23:01:57.675783 run osmo-stp_10.42.42.5(pid=27533): stdout: | (launched: 2022-12-09_23:01:56.280684) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:01:57.813339 run osmo-stp_10.42.42.5(pid=27533): stderr: | 20221209230156471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230156472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230156472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230156472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230156473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230156473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230156473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:01:57.949297 run osmo-stp_10.42.42.5(pid=27533): stdout: | (launched: 2022-12-09_23:01:56.280684) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:01:58.077182 run osmo-stp_10.42.42.5(pid=27533): stderr: | 20221209230156471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230156472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230156472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230156472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230156473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230156473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230156473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:01:58.230288 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27533): Process ended prematurely: osmo-stp_10.42.42.5(pid=27533) [trial-2365↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27533)] [trial-2365↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 23:01:58.239232 tst handover.py:18: Test FAILED (6.6 sec) 23:01:58.267096 run osmo-hlr_10.42.42.2(pid=27530): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27530)] 23:01:58.317652 run osmo-hlr_10.42.42.2(pid=27530): stdout: | (launched: 2022-12-09_23:01:55.289912) 23:01:58.369727 run osmo-hlr_10.42.42.2(pid=27530): stderr: | 20221209230155487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230155487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230155487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230155487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230155487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230155487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230155498 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230155506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230155506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230155507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:01:58.442463 run osmo-msc_10.42.42.6(pid=27536): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27536)] 23:01:58.492781 run osmo-msc_10.42.42.6(pid=27536): stdout: | (launched: 2022-12-09_23:01:57.301291) 23:01:58.544811 run osmo-msc_10.42.42.6(pid=27536): stderr: | 20221209230157623 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230157623 DLGLOBAL DEBUG validating counter group 0x7ff8b77c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230157623 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230157623 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230157624 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230157624 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230157626 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230157626 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230157626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230157626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:01:58.597607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27529): Terminating (SIGTERM) 23:01:58.639587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27532): Terminating (SIGTERM) 23:01:58.681652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27535): Terminating (SIGTERM) 23:01:58.724033 --- ParallelTerminationStrategy: PID 27529 died... 23:01:58.743580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27529): Terminated: ok {rc=0} 23:01:58.790467 --- ParallelTerminationStrategy: PID 27532 died... 23:01:58.810013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27532): Terminated: ok {rc=0} 23:01:58.856519 --- ParallelTerminationStrategy: PID 27535 died... 23:01:58.875984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27535): Terminated: ok {rc=0} 23:01:58.965094 bus /sierra_3: Setting Powered False 23:02:00.064769 bus /sierra_3: Setting Powered False 23:02:01.184086 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 23:02:02.432239 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:02.437246 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 23:02:02.475812 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 23:02:02.501812 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 23:02:02.573568 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 23:02:02.615048 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 23:02:02.642528 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 23:02:03.183535 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 23:02:03.189410 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:03.200484 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 23:02:03.239791 tst handover.py: using LAC 24260 23:02:03.360249 tst handover.py: using RAC 35 23:02:03.486905 tst handover.py: using CellId 24260 23:02:03.610744 tst handover.py: using BVCI 24261 23:02:03.721514 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 23:02:03.754069 tst handover.py: using LAC 24261 23:02:03.879314 tst handover.py: using RAC 36 23:02:04.002809 tst handover.py: using CellId 24261 23:02:04.126198 tst handover.py: using BVCI 24262 23:02:04.242805 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:04.254073 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:04.265201 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:04.276449 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:04.287952 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:04.299069 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 23:02:04.417684 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 23:02:04.536176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:05.005979 run create_hlr_db(pid=27542): Launched 23:02:05.127683 bus /sierra_2: Setting Powered False 23:02:06.192092 run create_hlr_db(pid=27542): Terminated: ok {rc=0} 23:02:06.596531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27544): Launched 23:02:06.898170 run osmo-hlr_10.42.42.2(pid=27545): Launched 23:02:07.014528 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:07.512107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27547): Launched 23:02:07.813316 run osmo-stp_10.42.42.5(pid=27548): Launched 23:02:07.928861 run osmo-msc_10.42.42.6: Starting osmo-msc 23:02:08.447315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27550): Launched 23:02:08.749297 run osmo-msc_10.42.42.6(pid=27551): Launched 23:02:08.918404 run osmo-stp_10.42.42.5(pid=27548): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27548)] 23:02:09.046468 run osmo-stp_10.42.42.5(pid=27548): stdout: | (launched: 2022-12-09_23:02:07.758676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:09.174250 run osmo-stp_10.42.42.5(pid=27548): stderr: | 20221209230207927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230207927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230207927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230207928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230207930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230207930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230207930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:09.300479 run osmo-stp_10.42.42.5(pid=27548): stdout: | (launched: 2022-12-09_23:02:07.758676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:09.420380 run osmo-stp_10.42.42.5(pid=27548): stderr: | 20221209230207927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230207927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230207927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230207928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230207930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230207930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230207930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:09.563672 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27548): Process ended prematurely: osmo-stp_10.42.42.5(pid=27548) [trial-2365↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27548)] [trial-2365↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 23:02:09.571939 tst handover.py:18: Test FAILED (6.4 sec) 23:02:09.597605 run osmo-hlr_10.42.42.2(pid=27545): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27545)] 23:02:09.644763 run osmo-hlr_10.42.42.2(pid=27545): stdout: | (launched: 2022-12-09_23:02:06.843738) 23:02:09.693664 run osmo-hlr_10.42.42.2(pid=27545): stderr: | 20221209230207019 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230207019 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230207019 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230207019 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230207019 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230207019 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230207031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230207040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230207040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230207040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:09.762046 run osmo-msc_10.42.42.6(pid=27551): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27551)] 23:02:09.809190 run osmo-msc_10.42.42.6(pid=27551): stdout: | (launched: 2022-12-09_23:02:08.694765) 23:02:09.857981 run osmo-msc_10.42.42.6(pid=27551): stderr: | 20221209230208965 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230208965 DLGLOBAL DEBUG validating counter group 0x7f78c02bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230208965 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230208965 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230208966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230208966 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230208967 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230208968 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230208968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230208968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:02:09.907078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27544): Terminating (SIGTERM) 23:02:09.946401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27547): Terminating (SIGTERM) 23:02:09.985652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27550): Terminating (SIGTERM) 23:02:10.025537 --- ParallelTerminationStrategy: PID 27544 died... 23:02:10.044452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27544): Terminated: ok {rc=0} 23:02:10.088015 --- ParallelTerminationStrategy: PID 27547 died... 23:02:10.106362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27547): Terminated: ok {rc=0} 23:02:10.149779 --- ParallelTerminationStrategy: PID 27550 died... 23:02:10.168153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27550): Terminated: ok {rc=0} 23:02:10.251297 bus /sierra_3: Setting Powered False 23:02:11.349353 bus /sierra_3: Setting Powered False 23:02:12.466040 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 23:02:13.713172 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:13.718569 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 23:02:13.773296 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 23:02:13.800244 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 23:02:13.852671 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 23:02:13.906687 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 23:02:13.933485 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 23:02:14.487196 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 23:02:14.492431 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:14.503616 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:02:14.541994 tst handover.py: using LAC 24262 23:02:14.669165 tst handover.py: using RAC 37 23:02:14.795090 tst handover.py: using CellId 24262 23:02:14.920098 tst handover.py: using BVCI 24263 23:02:15.036631 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:02:15.084498 tst handover.py: using LAC 24263 23:02:15.210958 tst handover.py: using RAC 38 23:02:15.330467 tst handover.py: using CellId 24263 23:02:15.452647 tst handover.py: using BVCI 24264 23:02:15.563595 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:15.574441 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:15.585033 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:15.595765 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:15.606634 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:15.617094 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:02:15.731396 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:02:15.851395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:16.357624 run create_hlr_db(pid=27557): Launched 23:02:16.511108 bus /sierra_2: Setting Powered False 23:02:17.570982 run create_hlr_db(pid=27557): Terminated: ok {rc=0} 23:02:17.965684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27559): Launched 23:02:18.269920 run osmo-hlr_10.42.42.2(pid=27560): Launched 23:02:18.385350 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:18.880136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27562): Launched 23:02:19.181907 run osmo-stp_10.42.42.5(pid=27563): Launched 23:02:19.296861 run osmo-msc_10.42.42.6: Starting osmo-msc 23:02:19.814805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27565): Launched 23:02:20.116072 run osmo-msc_10.42.42.6(pid=27566): Launched 23:02:20.285288 run osmo-stp_10.42.42.5(pid=27563): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27563)] 23:02:20.412906 run osmo-stp_10.42.42.5(pid=27563): stdout: | (launched: 2022-12-09_23:02:19.126918) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:20.540378 run osmo-stp_10.42.42.5(pid=27563): stderr: | 20221209230219297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230219297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230219297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230219298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230219298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230219298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230219298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:20.665539 run osmo-stp_10.42.42.5(pid=27563): stdout: | (launched: 2022-12-09_23:02:19.126918) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:20.784831 run osmo-stp_10.42.42.5(pid=27563): stderr: | 20221209230219297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230219297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230219297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230219298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230219298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230219298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230219298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:20.927755 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27563): Process ended prematurely: osmo-stp_10.42.42.5(pid=27563) [trial-2365↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27563)] [trial-2365↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 23:02:20.935816 tst handover.py:18: Test FAILED (6.4 sec) 23:02:20.961483 run osmo-hlr_10.42.42.2(pid=27560): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27560)] 23:02:21.008470 run osmo-hlr_10.42.42.2(pid=27560): stdout: | (launched: 2022-12-09_23:02:18.214933) 23:02:21.057496 run osmo-hlr_10.42.42.2(pid=27560): stderr: | 20221209230218390 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230218390 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230218390 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230218390 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230218390 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230218390 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230218402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230218411 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230218412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230218412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:21.125926 run osmo-msc_10.42.42.6(pid=27566): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27566)] 23:02:21.172788 run osmo-msc_10.42.42.6(pid=27566): stdout: | (launched: 2022-12-09_23:02:20.061415) 23:02:21.221356 run osmo-msc_10.42.42.6(pid=27566): stderr: | 20221209230220332 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230220332 DLGLOBAL DEBUG validating counter group 0x7f4a49b05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230220332 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230220332 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230220332 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230220333 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230220334 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230220335 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230220335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230220335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:02:21.270337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27559): Terminating (SIGTERM) 23:02:21.309390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27562): Terminating (SIGTERM) 23:02:21.349243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27565): Terminating (SIGTERM) 23:02:21.388534 --- ParallelTerminationStrategy: PID 27559 died... 23:02:21.407399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27559): Terminated: ok {rc=0} 23:02:21.450930 --- ParallelTerminationStrategy: PID 27562 died... 23:02:21.469276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27562): Terminated: ok {rc=0} 23:02:21.512877 --- ParallelTerminationStrategy: PID 27565 died... 23:02:21.531580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27565): Terminated: ok {rc=0} 23:02:21.614367 bus /sierra_3: Setting Powered False 23:02:22.708998 bus /sierra_3: Setting Powered False 23:02:23.822855 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 23:02:25.087774 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:25.094724 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 23:02:25.146525 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:02:25.173861 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 23:02:25.224288 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 23:02:25.274979 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:02:25.302022 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 23:02:25.857410 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 23:02:25.864109 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:25.875605 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:02:25.915482 tst handover.py: using LAC 24264 23:02:26.032686 tst handover.py: using RAC 39 23:02:26.150136 tst handover.py: using CellId 24264 23:02:26.268354 tst handover.py: using BVCI 24265 23:02:26.378888 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:02:26.421801 tst handover.py: using LAC 24265 23:02:26.538304 tst handover.py: using RAC 40 23:02:26.656886 tst handover.py: using CellId 24265 23:02:26.775031 tst handover.py: using BVCI 24266 23:02:26.885294 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:26.896274 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:26.907212 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:26.918734 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:26.930137 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:26.941647 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:02:27.062750 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:02:27.180075 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:27.622359 run create_hlr_db(pid=27571): Launched 23:02:27.745734 bus /sierra_2: Setting Powered False 23:02:28.805856 run create_hlr_db(pid=27571): Terminated: ok {rc=0} 23:02:29.218921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27573): Launched 23:02:29.542092 run osmo-hlr_10.42.42.2(pid=27574): Launched 23:02:29.667949 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:30.201021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27576): Launched 23:02:30.523157 run osmo-stp_10.42.42.5(pid=27577): Launched 23:02:30.646897 run osmo-msc_10.42.42.6: Starting osmo-msc 23:02:31.228537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27579): Launched 23:02:31.550979 run osmo-msc_10.42.42.6(pid=27580): Launched 23:02:31.753197 run osmo-stp_10.42.42.5(pid=27577): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27577)] 23:02:31.974823 run osmo-stp_10.42.42.5(pid=27577): stdout: | (launched: 2022-12-09_23:02:30.465112) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:32.280565 run osmo-stp_10.42.42.5(pid=27577): stderr: | 20221209230230656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230230657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230230657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230230657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230230658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230230658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230230658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:32.436092 run osmo-stp_10.42.42.5(pid=27577): stdout: | (launched: 2022-12-09_23:02:30.465112) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:32.556131 run osmo-stp_10.42.42.5(pid=27577): stderr: | 20221209230230656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230230657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230230657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230230657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230230658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230230658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230230658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:32.699750 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27577): Process ended prematurely: osmo-stp_10.42.42.5(pid=27577) [trial-2365↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27577)] [trial-2365↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 23:02:32.708177 tst handover.py:18: Test FAILED (6.8 sec) 23:02:32.734313 run osmo-hlr_10.42.42.2(pid=27574): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27574)] 23:02:32.782240 run osmo-hlr_10.42.42.2(pid=27574): stdout: | (launched: 2022-12-09_23:02:29.484014) 23:02:32.832293 run osmo-hlr_10.42.42.2(pid=27574): stderr: | 20221209230229683 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230229683 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230229683 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230229683 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230229683 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230229683 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230229695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230229704 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230229704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230229704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:32.901415 run osmo-msc_10.42.42.6(pid=27580): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27580)] 23:02:32.949305 run osmo-msc_10.42.42.6(pid=27580): stdout: | (launched: 2022-12-09_23:02:31.490098) 23:02:32.998538 run osmo-msc_10.42.42.6(pid=27580): stderr: | 20221209230232160 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230232161 DLGLOBAL DEBUG validating counter group 0x7f7b30acbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230232161 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230232161 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230232163 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230232164 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230232174 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230232176 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230232177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230232177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:02:33.048330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27573): Terminating (SIGTERM) 23:02:33.088030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27576): Terminating (SIGTERM) 23:02:33.127711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27579): Terminating (SIGTERM) 23:02:33.167821 --- ParallelTerminationStrategy: PID 27573 died... 23:02:33.187052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27573): Terminated: ok {rc=0} 23:02:33.231255 --- ParallelTerminationStrategy: PID 27576 died... 23:02:33.250211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27576): Terminated: ok {rc=0} 23:02:33.294644 --- ParallelTerminationStrategy: PID 27579 died... 23:02:33.313484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27579): Terminated: ok {rc=0} 23:02:33.399626 bus /sierra_3: Setting Powered False 23:02:34.499954 bus /sierra_3: Setting Powered False 23:02:35.616140 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:02:36.870214 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:36.875526 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:02:36.928520 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:02:36.954655 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:02:37.004692 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:02:37.057516 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:02:37.083303 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:02:37.638905 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:02:37.644008 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:37.654811 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:02:37.692221 tst handover.py: using LAC 24266 23:02:37.810661 tst handover.py: using RAC 41 23:02:37.931590 tst handover.py: using CellId 24266 23:02:38.050620 tst handover.py: using BVCI 24267 23:02:38.161348 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:02:38.212650 tst handover.py: using LAC 24267 23:02:38.329733 tst handover.py: using RAC 42 23:02:38.446584 tst handover.py: using CellId 24267 23:02:38.564122 tst handover.py: using BVCI 24268 23:02:38.674009 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:38.685036 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:38.695672 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:38.706433 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:38.717134 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:38.727760 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:02:38.846137 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:02:38.964130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:39.433295 run create_hlr_db(pid=27585): Launched 23:02:39.557312 bus /sierra_2: Setting Powered False 23:02:40.621688 run create_hlr_db(pid=27585): Terminated: ok {rc=0} 23:02:41.043632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27587): Launched 23:02:41.365270 run osmo-hlr_10.42.42.2(pid=27588): Launched 23:02:41.489192 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:42.012352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27590): Launched 23:02:42.333619 run osmo-stp_10.42.42.5(pid=27591): Launched 23:02:42.458370 run osmo-msc_10.42.42.6: Starting osmo-msc 23:02:43.017008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27593): Launched 23:02:43.338619 run osmo-msc_10.42.42.6(pid=27594): Launched 23:02:43.518435 run osmo-stp_10.42.42.5(pid=27591): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27591)] 23:02:43.655001 run osmo-stp_10.42.42.5(pid=27591): stdout: | (launched: 2022-12-09_23:02:42.275744) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:43.791774 run osmo-stp_10.42.42.5(pid=27591): stderr: | 20221209230242467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230242467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230242467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230242468 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230242468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230242468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230242468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:43.927566 run osmo-stp_10.42.42.5(pid=27591): stdout: | (launched: 2022-12-09_23:02:42.275744) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:44.055637 run osmo-stp_10.42.42.5(pid=27591): stderr: | 20221209230242467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230242467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230242467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230242468 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230242468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230242468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230242468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:44.209024 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27591): Process ended prematurely: osmo-stp_10.42.42.5(pid=27591) [trial-2365↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27591)] [trial-2365↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 23:02:44.217914 tst handover.py:18: Test FAILED (6.6 sec) 23:02:44.245436 run osmo-hlr_10.42.42.2(pid=27588): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27588)] 23:02:44.295928 run osmo-hlr_10.42.42.2(pid=27588): stdout: | (launched: 2022-12-09_23:02:41.307424) 23:02:44.348076 run osmo-hlr_10.42.42.2(pid=27588): stderr: | 20221209230241505 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230241505 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230241505 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230241505 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230241505 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230241505 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230241517 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230241525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230241525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230241525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:44.420346 run osmo-msc_10.42.42.6(pid=27594): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27594)] 23:02:44.470347 run osmo-msc_10.42.42.6(pid=27594): stdout: | (launched: 2022-12-09_23:02:43.280415) 23:02:44.522199 run osmo-msc_10.42.42.6(pid=27594): stderr: | 20221209230243603 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230243603 DLGLOBAL DEBUG validating counter group 0x7f8917620c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230243603 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230243603 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230243603 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230243603 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230243605 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230243606 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230243606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230243606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:02:44.574348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27587): Terminating (SIGTERM) 23:02:44.616892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27590): Terminating (SIGTERM) 23:02:44.659240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27593): Terminating (SIGTERM) 23:02:44.701599 --- ParallelTerminationStrategy: PID 27587 died... 23:02:44.721506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27587): Terminated: ok {rc=0} 23:02:44.768407 --- ParallelTerminationStrategy: PID 27590 died... 23:02:44.787964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27590): Terminated: ok {rc=0} 23:02:44.834372 --- ParallelTerminationStrategy: PID 27593 died... 23:02:44.853811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27593): Terminated: ok {rc=0} 23:02:44.941262 bus /sierra_3: Setting Powered False 23:02:46.040316 bus /sierra_3: Setting Powered False 23:02:47.163575 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 23:02:48.435291 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:48.440757 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:02:48.483719 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:02:48.511070 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:02:48.563172 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:02:48.605259 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:02:48.633048 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:02:49.182060 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 23:02:49.187466 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:49.198464 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 23:02:49.236465 tst handover.py: using LAC 24268 23:02:49.354590 tst handover.py: using RAC 43 23:02:49.475903 tst handover.py: using CellId 24268 23:02:49.596787 tst handover.py: using BVCI 24269 23:02:49.708560 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 23:02:49.744043 tst handover.py: using LAC 24269 23:02:49.861448 tst handover.py: using RAC 44 23:02:49.981146 tst handover.py: using CellId 24269 23:02:50.099821 tst handover.py: using BVCI 24270 23:02:50.210268 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:50.221121 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:50.231751 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:50.242464 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:50.253034 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:50.263623 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 23:02:50.382214 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 23:02:50.501635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:50.972866 run create_hlr_db(pid=27599): Launched 23:02:51.096005 bus /sierra_2: Setting Powered False 23:02:52.159107 run create_hlr_db(pid=27599): Terminated: ok {rc=0} 23:02:52.579702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27601): Launched 23:02:52.900319 run osmo-hlr_10.42.42.2(pid=27602): Launched 23:02:53.024232 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:53.551786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27604): Launched 23:02:53.873505 run osmo-stp_10.42.42.5(pid=27605): Launched 23:02:53.997990 run osmo-msc_10.42.42.6: Starting osmo-msc 23:02:54.554753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27607): Launched 23:02:54.877377 run osmo-msc_10.42.42.6(pid=27608): Launched 23:02:55.059772 run osmo-stp_10.42.42.5(pid=27605): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27605)] 23:02:55.197441 run osmo-stp_10.42.42.5(pid=27605): stdout: | (launched: 2022-12-09_23:02:53.815642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:55.335835 run osmo-stp_10.42.42.5(pid=27605): stderr: | 20221209230254008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230254009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230254009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230254009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230254010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230254010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230254010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:55.472898 run osmo-stp_10.42.42.5(pid=27605): stdout: | (launched: 2022-12-09_23:02:53.815642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:55.602690 run osmo-stp_10.42.42.5(pid=27605): stderr: | 20221209230254008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230254009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230254009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230254009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230254010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230254010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230254010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:55.758100 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27605): Process ended prematurely: osmo-stp_10.42.42.5(pid=27605) [trial-2365↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27605)] [trial-2365↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 23:02:55.766958 tst handover.py:18: Test FAILED (6.6 sec) 23:02:55.794511 run osmo-hlr_10.42.42.2(pid=27602): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27602)] 23:02:55.845185 run osmo-hlr_10.42.42.2(pid=27602): stdout: | (launched: 2022-12-09_23:02:52.842761) 23:02:55.897371 run osmo-hlr_10.42.42.2(pid=27602): stderr: | 20221209230253042 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230253042 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230253042 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230253042 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230253042 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230253042 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230253055 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230253063 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230253063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230253063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:55.969624 run osmo-msc_10.42.42.6(pid=27608): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27608)] 23:02:56.019866 run osmo-msc_10.42.42.6(pid=27608): stdout: | (launched: 2022-12-09_23:02:54.819409) 23:02:56.071813 run osmo-msc_10.42.42.6(pid=27608): stderr: | 20221209230255138 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230255138 DLGLOBAL DEBUG validating counter group 0x7f66517abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230255138 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230255138 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230255138 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230255139 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230255140 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230255141 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230255141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230255141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:02:56.124287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27601): Terminating (SIGTERM) 23:02:56.165973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27604): Terminating (SIGTERM) 23:02:56.207844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27607): Terminating (SIGTERM) 23:02:56.250067 --- ParallelTerminationStrategy: PID 27601 died... 23:02:56.269897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27601): Terminated: ok {rc=0} 23:02:56.316191 --- ParallelTerminationStrategy: PID 27604 died... 23:02:56.335557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27604): Terminated: ok {rc=0} 23:02:56.381917 --- ParallelTerminationStrategy: PID 27607 died... 23:02:56.401433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27607): Terminated: ok {rc=0} 23:02:56.489963 bus /sierra_3: Setting Powered False 23:02:57.590087 bus /sierra_3: Setting Powered False 23:02:58.707053 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 23:02:59.955043 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:59.960580 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:03:00.015181 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:03:00.042107 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:03:00.095212 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:03:00.149711 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:03:00.176437 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:03:00.728097 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 23:03:00.733495 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:00.744476 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:03:00.783388 tst handover.py: using LAC 24270 23:03:00.939147 tst handover.py: using RAC 45 23:03:01.070360 tst handover.py: using CellId 24270 23:03:01.240736 tst handover.py: using BVCI 24271 23:03:01.360631 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:03:01.415362 tst handover.py: using LAC 24271 23:03:01.544015 tst handover.py: using RAC 46 23:03:01.671838 tst handover.py: using CellId 24271 23:03:01.792071 tst handover.py: using BVCI 24272 23:03:01.907634 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:01.919328 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:01.930983 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:01.942841 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:01.954502 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:01.965772 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:03:02.085096 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:03:02.210225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:02.687350 run create_hlr_db(pid=27614): Launched 23:03:02.810475 bus /sierra_2: Setting Powered False 23:03:03.874336 run create_hlr_db(pid=27614): Terminated: ok {rc=0} 23:03:04.279226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27616): Launched 23:03:04.582031 run osmo-hlr_10.42.42.2(pid=27617): Launched 23:03:04.698396 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:05.190159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27619): Launched 23:03:05.491046 run osmo-stp_10.42.42.5(pid=27620): Launched 23:03:05.606643 run osmo-msc_10.42.42.6: Starting osmo-msc 23:03:06.126576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27622): Launched 23:03:06.428821 run osmo-msc_10.42.42.6(pid=27623): Launched 23:03:06.598929 run osmo-stp_10.42.42.5(pid=27620): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27620)] 23:03:06.726877 run osmo-stp_10.42.42.5(pid=27620): stdout: | (launched: 2022-12-09_23:03:05.436568) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:06.853903 run osmo-stp_10.42.42.5(pid=27620): stderr: | 20221209230305607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230305607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230305607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230305608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230305608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230305608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230305608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:06.978982 run osmo-stp_10.42.42.5(pid=27620): stdout: | (launched: 2022-12-09_23:03:05.436568) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:07.099210 run osmo-stp_10.42.42.5(pid=27620): stderr: | 20221209230305607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230305607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230305607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230305608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230305608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230305608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230305608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:07.242702 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27620): Process ended prematurely: osmo-stp_10.42.42.5(pid=27620) [trial-2365↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27620)] [trial-2365↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 23:03:07.251001 tst handover.py:18: Test FAILED (6.5 sec) 23:03:07.277119 run osmo-hlr_10.42.42.2(pid=27617): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27617)] 23:03:07.324702 run osmo-hlr_10.42.42.2(pid=27617): stdout: | (launched: 2022-12-09_23:03:04.527353) 23:03:07.373885 run osmo-hlr_10.42.42.2(pid=27617): stderr: | 20221209230304702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230304702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230304702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230304703 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230304703 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230304703 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230304718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230304727 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230304727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230304727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:07.442477 run osmo-msc_10.42.42.6(pid=27623): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27623)] 23:03:07.489937 run osmo-msc_10.42.42.6(pid=27623): stdout: | (launched: 2022-12-09_23:03:06.374174) 23:03:07.538804 run osmo-msc_10.42.42.6(pid=27623): stderr: | 20221209230306646 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230306646 DLGLOBAL DEBUG validating counter group 0x7f0aaffc0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230306646 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230306646 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230306646 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230306647 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230306648 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230306649 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230306649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230306649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:03:07.588048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27616): Terminating (SIGTERM) 23:03:07.627577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27619): Terminating (SIGTERM) 23:03:07.666915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27622): Terminating (SIGTERM) 23:03:07.706933 --- ParallelTerminationStrategy: PID 27616 died... 23:03:07.725889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27616): Terminated: ok {rc=0} 23:03:07.769509 --- ParallelTerminationStrategy: PID 27619 died... 23:03:07.787924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27619): Terminated: ok {rc=0} 23:03:07.831473 --- ParallelTerminationStrategy: PID 27622 died... 23:03:07.850073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27622): Terminated: ok {rc=0} 23:03:07.933238 bus /sierra_3: Setting Powered False 23:03:09.030756 bus /sierra_3: Setting Powered False 23:03:10.146855 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 23:03:11.407054 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:03:11.413273 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:03:11.465507 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:03:11.491920 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:03:11.543521 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:03:11.597452 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:03:11.625187 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:03:12.172139 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 23:03:12.177506 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:12.188158 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:03:12.226299 tst handover.py: using LAC 24272 23:03:12.346272 tst handover.py: using RAC 47 23:03:12.466351 tst handover.py: using CellId 24272 23:03:12.587262 tst handover.py: using BVCI 24273 23:03:12.698099 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:03:12.748478 tst handover.py: using LAC 24273 23:03:12.874342 tst handover.py: using RAC 48 23:03:12.998367 tst handover.py: using CellId 24273 23:03:13.122339 tst handover.py: using BVCI 24274 23:03:13.239016 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:13.250485 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:13.261723 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:13.272919 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:13.284475 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:13.295900 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:03:13.415024 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:03:13.535021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:14.007221 run create_hlr_db(pid=27628): Launched 23:03:14.129897 bus /sierra_2: Setting Powered False 23:03:15.192858 run create_hlr_db(pid=27628): Terminated: ok {rc=0} 23:03:15.597927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27630): Launched 23:03:15.929660 run osmo-hlr_10.42.42.2(pid=27631): Launched 23:03:16.173901 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:16.818085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27633): Launched 23:03:17.162631 run osmo-stp_10.42.42.5(pid=27634): Launched 23:03:17.343038 run osmo-msc_10.42.42.6: Starting osmo-msc 23:03:17.861321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27636): Launched 23:03:18.161671 run osmo-msc_10.42.42.6(pid=27637): Launched 23:03:18.330520 run osmo-stp_10.42.42.5(pid=27634): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27634)] 23:03:18.458837 run osmo-stp_10.42.42.5(pid=27634): stdout: | (launched: 2022-12-09_23:03:17.098950) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:18.586656 run osmo-stp_10.42.42.5(pid=27634): stderr: | 20221209230317331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230317331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230317332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230317332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230317332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230317333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230317333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:18.712618 run osmo-stp_10.42.42.5(pid=27634): stdout: | (launched: 2022-12-09_23:03:17.098950) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:18.832369 run osmo-stp_10.42.42.5(pid=27634): stderr: | 20221209230317331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230317331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230317332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230317332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230317332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230317333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230317333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:18.975919 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27634): Process ended prematurely: osmo-stp_10.42.42.5(pid=27634) [trial-2365↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27634)] [trial-2365↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 23:03:18.984111 tst handover.py:18: Test FAILED (6.8 sec) 23:03:19.010397 run osmo-hlr_10.42.42.2(pid=27631): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27631)] 23:03:19.058368 run osmo-hlr_10.42.42.2(pid=27631): stdout: | (launched: 2022-12-09_23:03:15.862276) 23:03:19.108705 run osmo-hlr_10.42.42.2(pid=27631): stderr: | 20221209230316184 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230316184 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230316184 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230316184 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230316184 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230316197 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230316209 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230316225 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230316225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230316225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:19.179606 run osmo-msc_10.42.42.6(pid=27637): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27637)] 23:03:19.227282 run osmo-msc_10.42.42.6(pid=27637): stdout: | (launched: 2022-12-09_23:03:18.106908) 23:03:19.276150 run osmo-msc_10.42.42.6(pid=27637): stderr: | 20221209230318375 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230318375 DLGLOBAL DEBUG validating counter group 0x7f765996ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230318375 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230318376 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230318376 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230318376 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230318378 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230318378 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230318378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230318378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:03:19.325552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27630): Terminating (SIGTERM) 23:03:19.364726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27633): Terminating (SIGTERM) 23:03:19.403865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27636): Terminating (SIGTERM) 23:03:19.443167 --- ParallelTerminationStrategy: PID 27630 died... 23:03:19.462016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27630): Terminated: ok {rc=0} 23:03:19.505437 --- ParallelTerminationStrategy: PID 27633 died... 23:03:19.523661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27633): Terminated: ok {rc=0} 23:03:19.567155 --- ParallelTerminationStrategy: PID 27636 died... 23:03:19.585566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27636): Terminated: ok {rc=0} 23:03:19.668271 bus /sierra_3: Setting Powered False 23:03:20.766292 bus /sierra_3: Setting Powered False 23:03:21.882158 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 23:03:23.142182 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:03:23.147588 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 23:03:23.183684 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 23:03:23.209711 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 23:03:23.260739 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 23:03:23.296705 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 23:03:23.322835 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 23:03:23.873894 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 23:03:23.878922 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:23.889681 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 23:03:23.922872 tst handover.py: using LAC 24274 23:03:24.041639 tst handover.py: using RAC 49 23:03:24.161273 tst handover.py: using CellId 24274 23:03:24.284712 tst handover.py: using BVCI 24275 23:03:24.395161 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 23:03:24.431956 tst handover.py: using LAC 24275 23:03:24.550032 tst handover.py: using RAC 50 23:03:24.666455 tst handover.py: using CellId 24275 23:03:24.784534 tst handover.py: using BVCI 24276 23:03:24.894463 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:24.905263 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:24.915702 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:24.926343 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:24.937128 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:24.948014 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 23:03:25.067268 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 23:03:25.189815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:25.662244 run create_hlr_db(pid=27642): Launched 23:03:25.787304 bus /sierra_2: Setting Powered False 23:03:26.851493 run create_hlr_db(pid=27642): Terminated: ok {rc=0} 23:03:27.257936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27644): Launched 23:03:27.561327 run osmo-hlr_10.42.42.2(pid=27645): Launched 23:03:27.678018 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:28.170729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27647): Launched 23:03:28.470995 run osmo-stp_10.42.42.5(pid=27648): Launched 23:03:28.585627 run osmo-msc_10.42.42.6: Starting osmo-msc 23:03:29.101508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27650): Launched 23:03:29.405707 run osmo-msc_10.42.42.6(pid=27651): Launched 23:03:29.574727 run osmo-stp_10.42.42.5(pid=27648): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27648)] 23:03:29.702087 run osmo-stp_10.42.42.5(pid=27648): stdout: | (launched: 2022-12-09_23:03:28.416681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:29.829197 run osmo-stp_10.42.42.5(pid=27648): stderr: | 20221209230328583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230328583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230328583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230328584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230328586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230328586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230328586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:29.955860 run osmo-stp_10.42.42.5(pid=27648): stdout: | (launched: 2022-12-09_23:03:28.416681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:30.075735 run osmo-stp_10.42.42.5(pid=27648): stderr: | 20221209230328583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230328583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230328583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230328584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230328586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230328586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230328586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:30.219443 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27648): Process ended prematurely: osmo-stp_10.42.42.5(pid=27648) [trial-2365↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27648)] [trial-2365↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 23:03:30.227813 tst handover.py:18: Test FAILED (6.3 sec) 23:03:30.253982 run osmo-hlr_10.42.42.2(pid=27645): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27645)] 23:03:30.301643 run osmo-hlr_10.42.42.2(pid=27645): stdout: | (launched: 2022-12-09_23:03:27.506754) 23:03:30.351182 run osmo-hlr_10.42.42.2(pid=27645): stderr: | 20221209230327683 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230327683 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230327683 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230327683 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230327683 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230327683 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230327695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230327704 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230327704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230327704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:30.420201 run osmo-msc_10.42.42.6(pid=27651): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27651)] 23:03:30.467675 run osmo-msc_10.42.42.6(pid=27651): stdout: | (launched: 2022-12-09_23:03:29.350798) 23:03:30.516631 run osmo-msc_10.42.42.6(pid=27651): stderr: | 20221209230329619 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230329619 DLGLOBAL DEBUG validating counter group 0x7f3bcc06fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230329620 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230329620 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230329620 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230329620 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230329623 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230329624 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230329624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230329624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:03:30.566412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27644): Terminating (SIGTERM) 23:03:30.605927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27647): Terminating (SIGTERM) 23:03:30.645690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27650): Terminating (SIGTERM) 23:03:30.685539 --- ParallelTerminationStrategy: PID 27644 died... 23:03:30.704517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27644): Terminated: ok {rc=0} 23:03:30.748803 --- ParallelTerminationStrategy: PID 27647 died... 23:03:30.767545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27647): Terminated: ok {rc=0} 23:03:30.811386 --- ParallelTerminationStrategy: PID 27650 died... 23:03:30.830146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27650): Terminated: ok {rc=0} 23:03:30.935444 bus /sierra_3: Setting Powered False 23:03:32.033745 bus /sierra_3: Setting Powered False 23:03:33.152872 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 23:03:34.393485 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:03:34.399085 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 23:03:34.451165 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 23:03:34.478161 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 23:03:34.531581 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 23:03:34.583174 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 23:03:34.609963 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 23:03:35.161667 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 23:03:35.166910 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:35.178087 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:03:35.215806 tst handover.py: using LAC 24276 23:03:35.342069 tst handover.py: using RAC 51 23:03:35.470216 tst handover.py: using CellId 24276 23:03:35.598607 tst handover.py: using BVCI 24277 23:03:35.716086 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:03:35.764578 tst handover.py: using LAC 24277 23:03:35.890770 tst handover.py: using RAC 52 23:03:36.016574 tst handover.py: using CellId 24277 23:03:36.142652 tst handover.py: using BVCI 24278 23:03:36.259818 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:36.270974 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:36.282090 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:36.293076 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:36.305178 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:36.316854 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:03:36.436908 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:03:36.556939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:37.028078 run create_hlr_db(pid=27656): Launched 23:03:37.151823 bus /sierra_2: Setting Powered False 23:03:38.211399 run create_hlr_db(pid=27656): Terminated: ok {rc=0} 23:03:38.608055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27658): Launched 23:03:38.910774 run osmo-hlr_10.42.42.2(pid=27659): Launched 23:03:39.026165 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:39.518383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27661): Launched 23:03:39.819271 run osmo-stp_10.42.42.5(pid=27662): Launched 23:03:39.934470 run osmo-msc_10.42.42.6: Starting osmo-msc 23:03:40.452516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27664): Launched 23:03:40.753763 run osmo-msc_10.42.42.6(pid=27665): Launched 23:03:40.923512 run osmo-stp_10.42.42.5(pid=27662): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27662)] 23:03:41.050632 run osmo-stp_10.42.42.5(pid=27662): stdout: | (launched: 2022-12-09_23:03:39.764592) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:41.178322 run osmo-stp_10.42.42.5(pid=27662): stderr: | 20221209230339935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230339935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230339935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230339936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230339936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230339936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230339936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:41.303590 run osmo-stp_10.42.42.5(pid=27662): stdout: | (launched: 2022-12-09_23:03:39.764592) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:41.423372 run osmo-stp_10.42.42.5(pid=27662): stderr: | 20221209230339935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230339935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230339935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230339936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230339936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230339936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230339936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:41.566570 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27662): Process ended prematurely: osmo-stp_10.42.42.5(pid=27662) [trial-2365↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27662)] [trial-2365↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 23:03:41.574872 tst handover.py:18: Test FAILED (6.4 sec) 23:03:41.601219 run osmo-hlr_10.42.42.2(pid=27659): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27659)] 23:03:41.649061 run osmo-hlr_10.42.42.2(pid=27659): stdout: | (launched: 2022-12-09_23:03:38.856316) 23:03:41.698034 run osmo-hlr_10.42.42.2(pid=27659): stderr: | 20221209230339029 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230339029 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230339029 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230339029 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230339029 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230339029 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230339042 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230339051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230339051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230339051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:41.766796 run osmo-msc_10.42.42.6(pid=27665): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27665)] 23:03:41.814042 run osmo-msc_10.42.42.6(pid=27665): stdout: | (launched: 2022-12-09_23:03:40.699080) 23:03:41.863139 run osmo-msc_10.42.42.6(pid=27665): stderr: | 20221209230340969 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230340969 DLGLOBAL DEBUG validating counter group 0x7f66d146bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230340969 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230340969 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230340969 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230340969 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230340973 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230340973 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230340973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230340973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:03:41.912428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27658): Terminating (SIGTERM) 23:03:41.951578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27661): Terminating (SIGTERM) 23:03:41.991837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27664): Terminating (SIGTERM) 23:03:42.031760 --- ParallelTerminationStrategy: PID 27658 died... 23:03:42.050593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27658): Terminated: ok {rc=0} 23:03:42.094273 --- ParallelTerminationStrategy: PID 27661 died... 23:03:42.113354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27661): Terminated: ok {rc=0} 23:03:42.157137 --- ParallelTerminationStrategy: PID 27664 died... 23:03:42.175549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27664): Terminated: ok {rc=0} 23:03:42.259545 bus /sierra_3: Setting Powered False 23:03:43.358403 bus /sierra_3: Setting Powered False 23:03:44.473508 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 23:03:45.723667 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:03:45.728804 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 23:03:45.774847 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:03:45.801254 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 23:03:45.869235 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 23:03:45.923442 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:03:45.951007 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 23:03:46.512252 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 23:03:46.519734 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:46.531920 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:03:46.570695 tst handover.py: using LAC 24278 23:03:46.736809 tst handover.py: using RAC 53 23:03:46.865777 tst handover.py: using CellId 24278 23:03:46.994270 tst handover.py: using BVCI 24279 23:03:47.130629 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:03:47.176729 tst handover.py: using LAC 24279 23:03:47.299468 tst handover.py: using RAC 54 23:03:47.417846 tst handover.py: using CellId 24279 23:03:47.536567 tst handover.py: using BVCI 24280 23:03:47.646162 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:47.657280 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:47.668124 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:47.679350 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:47.690452 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:47.701587 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:03:47.821389 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:03:47.942235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:48.414626 run create_hlr_db(pid=27670): Launched 23:03:48.539642 bus /sierra_2: Setting Powered False 23:03:49.604232 run create_hlr_db(pid=27670): Terminated: ok {rc=0} 23:03:50.028630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27672): Launched 23:03:50.352866 run osmo-hlr_10.42.42.2(pid=27673): Launched 23:03:50.477584 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:51.009318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27675): Launched 23:03:51.331775 run osmo-stp_10.42.42.5(pid=27676): Launched 23:03:51.455053 run osmo-msc_10.42.42.6: Starting osmo-msc 23:03:52.010764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27678): Launched 23:03:52.334440 run osmo-msc_10.42.42.6(pid=27679): Launched 23:03:52.514782 run osmo-stp_10.42.42.5(pid=27676): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27676)] 23:03:52.651306 run osmo-stp_10.42.42.5(pid=27676): stdout: | (launched: 2022-12-09_23:03:51.273809) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:52.790102 run osmo-stp_10.42.42.5(pid=27676): stderr: | 20221209230351464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230351464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230351464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230351465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230351467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230351467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230351467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:52.926270 run osmo-stp_10.42.42.5(pid=27676): stdout: | (launched: 2022-12-09_23:03:51.273809) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:53.055052 run osmo-stp_10.42.42.5(pid=27676): stderr: | 20221209230351464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230351464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230351464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230351465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230351467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230351467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230351467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:53.208904 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27676): Process ended prematurely: osmo-stp_10.42.42.5(pid=27676) [trial-2365↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27676)] [trial-2365↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 23:03:53.217847 tst handover.py:18: Test FAILED (6.7 sec) 23:03:53.245675 run osmo-hlr_10.42.42.2(pid=27673): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27673)] 23:03:53.295625 run osmo-hlr_10.42.42.2(pid=27673): stdout: | (launched: 2022-12-09_23:03:50.294600) 23:03:53.347589 run osmo-hlr_10.42.42.2(pid=27673): stderr: | 20221209230350492 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230350492 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230350492 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230350492 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230350492 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230350492 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230350505 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230350513 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230350513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230350513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:53.419522 run osmo-msc_10.42.42.6(pid=27679): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27679)] 23:03:53.469556 run osmo-msc_10.42.42.6(pid=27679): stdout: | (launched: 2022-12-09_23:03:52.276217) 23:03:53.521542 run osmo-msc_10.42.42.6(pid=27679): stderr: | 20221209230352595 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230352595 DLGLOBAL DEBUG validating counter group 0x7f7b5c085c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230352595 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230352595 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230352595 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230352596 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230352599 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230352599 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230352600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230352600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:03:53.573848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27672): Terminating (SIGTERM) 23:03:53.615680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27675): Terminating (SIGTERM) 23:03:53.658088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27678): Terminating (SIGTERM) 23:03:53.700486 --- ParallelTerminationStrategy: PID 27672 died... 23:03:53.720515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27672): Terminated: ok {rc=0} 23:03:53.767196 --- ParallelTerminationStrategy: PID 27675 died... 23:03:53.786633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27675): Terminated: ok {rc=0} 23:03:53.833219 --- ParallelTerminationStrategy: PID 27678 died... 23:03:53.852527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27678): Terminated: ok {rc=0} 23:03:53.940529 bus /sierra_3: Setting Powered False 23:03:55.041067 bus /sierra_3: Setting Powered False 23:03:56.157736 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:03:57.417054 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:03:57.423011 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:03:57.473526 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:03:57.499819 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:03:57.551409 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:03:57.601647 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:03:57.627947 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:03:58.183041 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:03:58.189216 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:03:58.200906 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:03:58.238447 tst handover.py: using LAC 24280 23:03:58.364614 tst handover.py: using RAC 55 23:03:58.492145 tst handover.py: using CellId 24280 23:03:58.621138 tst handover.py: using BVCI 24281 23:03:58.739861 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:03:58.788251 tst handover.py: using LAC 24281 23:03:58.913292 tst handover.py: using RAC 56 23:03:59.039164 tst handover.py: using CellId 24281 23:03:59.163884 tst handover.py: using BVCI 24282 23:03:59.281169 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:03:59.292415 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:03:59.303567 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:03:59.314737 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:03:59.326631 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:03:59.338013 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:03:59.454660 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:03:59.575064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:00.046491 run create_hlr_db(pid=27685): Launched 23:04:00.169803 bus /sierra_2: Setting Powered False 23:04:01.230090 run create_hlr_db(pid=27685): Terminated: ok {rc=0} 23:04:01.715068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27687): Launched 23:04:02.041746 run osmo-hlr_10.42.42.2(pid=27688): Launched 23:04:02.233395 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:02.744651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27690): Launched 23:04:03.046232 run osmo-stp_10.42.42.5(pid=27691): Launched 23:04:03.160908 run osmo-msc_10.42.42.6: Starting osmo-msc 23:04:03.679881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27693): Launched 23:04:03.982226 run osmo-msc_10.42.42.6(pid=27694): Launched 23:04:04.152464 run osmo-stp_10.42.42.5(pid=27691): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27691)] 23:04:04.280841 run osmo-stp_10.42.42.5(pid=27691): stdout: | (launched: 2022-12-09_23:04:02.991837) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:04.409234 run osmo-stp_10.42.42.5(pid=27691): stderr: | 20221209230403161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230403161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230403162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230403162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230403162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230403163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230403163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:04.535156 run osmo-stp_10.42.42.5(pid=27691): stdout: | (launched: 2022-12-09_23:04:02.991837) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:04.655088 run osmo-stp_10.42.42.5(pid=27691): stderr: | 20221209230403161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230403161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230403162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230403162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230403162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230403163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230403163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:04.798902 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27691): Process ended prematurely: osmo-stp_10.42.42.5(pid=27691) [trial-2365↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27691)] [trial-2365↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 23:04:04.807111 tst handover.py:18: Test FAILED (6.6 sec) 23:04:04.832672 run osmo-hlr_10.42.42.2(pid=27688): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27688)] 23:04:04.880121 run osmo-hlr_10.42.42.2(pid=27688): stdout: | (launched: 2022-12-09_23:04:01.973727) 23:04:04.929088 run osmo-hlr_10.42.42.2(pid=27688): stderr: | 20221209230402321 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230402321 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230402321 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230402321 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230402321 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230402321 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230402333 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230402342 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230402342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230402342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:04.996917 run osmo-msc_10.42.42.6(pid=27694): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27694)] 23:04:05.044289 run osmo-msc_10.42.42.6(pid=27694): stdout: | (launched: 2022-12-09_23:04:03.927706) 23:04:05.093309 run osmo-msc_10.42.42.6(pid=27694): stderr: | 20221209230404198 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230404198 DLGLOBAL DEBUG validating counter group 0x7ff8c73b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230404198 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230404198 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230404198 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230404199 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230404200 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230404201 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230404201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230404201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:04:05.142500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27687): Terminating (SIGTERM) 23:04:05.181747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27690): Terminating (SIGTERM) 23:04:05.221188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27693): Terminating (SIGTERM) 23:04:05.261074 --- ParallelTerminationStrategy: PID 27687 died... 23:04:05.280088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27687): Terminated: ok {rc=0} 23:04:05.324111 --- ParallelTerminationStrategy: PID 27690 died... 23:04:05.342563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27690): Terminated: ok {rc=0} 23:04:05.386137 --- ParallelTerminationStrategy: PID 27693 died... 23:04:05.405079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27693): Terminated: ok {rc=0} 23:04:05.489712 bus /sierra_3: Setting Powered False 23:04:06.588365 bus /sierra_3: Setting Powered False 23:04:07.704097 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 23:04:08.961065 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:08.966052 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:04:09.003692 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:04:09.029843 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:04:09.079142 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:04:09.116410 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:04:09.142580 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:04:09.695040 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 23:04:09.700332 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:09.711209 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 23:04:09.746542 tst handover.py: using LAC 24282 23:04:09.873192 tst handover.py: using RAC 57 23:04:09.997139 tst handover.py: using CellId 24282 23:04:10.121384 tst handover.py: using BVCI 24283 23:04:10.238729 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 23:04:10.273270 tst handover.py: using LAC 24283 23:04:10.398215 tst handover.py: using RAC 58 23:04:10.522530 tst handover.py: using CellId 24283 23:04:10.646923 tst handover.py: using BVCI 24284 23:04:10.763991 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:10.775209 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:10.786401 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:10.798328 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:10.810259 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:10.821382 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 23:04:10.940307 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 23:04:11.060428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:11.531060 run create_hlr_db(pid=27699): Launched 23:04:11.654536 bus /sierra_2: Setting Powered False 23:04:12.718305 run create_hlr_db(pid=27699): Terminated: ok {rc=0} 23:04:13.139088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27701): Launched 23:04:13.461680 run osmo-hlr_10.42.42.2(pid=27702): Launched 23:04:13.586589 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:14.112580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27704): Launched 23:04:14.434791 run osmo-stp_10.42.42.5(pid=27705): Launched 23:04:14.558769 run osmo-msc_10.42.42.6: Starting osmo-msc 23:04:15.114472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27707): Launched 23:04:15.437562 run osmo-msc_10.42.42.6(pid=27708): Launched 23:04:15.620203 run osmo-stp_10.42.42.5(pid=27705): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27705)] 23:04:15.758441 run osmo-stp_10.42.42.5(pid=27705): stdout: | (launched: 2022-12-09_23:04:14.376781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:15.976731 run osmo-stp_10.42.42.5(pid=27705): stderr: | 20221209230414569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230414569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230414569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230414570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230414570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230414570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230414570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:16.116221 run osmo-stp_10.42.42.5(pid=27705): stdout: | (launched: 2022-12-09_23:04:14.376781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:16.249639 run osmo-stp_10.42.42.5(pid=27705): stderr: | 20221209230414569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230414569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230414569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230414570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230414570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230414570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230414570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:16.410569 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27705): Process ended prematurely: osmo-stp_10.42.42.5(pid=27705) [trial-2365↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27705)] [trial-2365↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 23:04:16.420736 tst handover.py:18: Test FAILED (6.7 sec) 23:04:16.452515 run osmo-hlr_10.42.42.2(pid=27702): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27702)] 23:04:16.505295 run osmo-hlr_10.42.42.2(pid=27702): stdout: | (launched: 2022-12-09_23:04:13.403691) 23:04:16.559997 run osmo-hlr_10.42.42.2(pid=27702): stderr: | 20221209230413599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230413600 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230413600 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230413600 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230413600 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230413600 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230413611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230413620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230413620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230413620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:16.636007 run osmo-msc_10.42.42.6(pid=27708): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27708)] 23:04:16.689252 run osmo-msc_10.42.42.6(pid=27708): stdout: | (launched: 2022-12-09_23:04:15.379434) 23:04:16.743924 run osmo-msc_10.42.42.6(pid=27708): stderr: | 20221209230415699 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230415699 DLGLOBAL DEBUG validating counter group 0x7f77369c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230415699 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230415700 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230415700 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230415700 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230415702 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230415702 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230415702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230415702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:04:16.799149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27701): Terminating (SIGTERM) 23:04:16.843520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27704): Terminating (SIGTERM) 23:04:16.888172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27707): Terminating (SIGTERM) 23:04:16.932395 --- ParallelTerminationStrategy: PID 27701 died... 23:04:16.953127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27701): Terminated: ok {rc=0} 23:04:17.003016 --- ParallelTerminationStrategy: PID 27704 died... 23:04:17.023633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27704): Terminated: ok {rc=0} 23:04:17.073599 --- ParallelTerminationStrategy: PID 27707 died... 23:04:17.094290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27707): Terminated: ok {rc=0} 23:04:17.187591 bus /sierra_3: Setting Powered False 23:04:18.286620 bus /sierra_3: Setting Powered False 23:04:19.400576 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 23:04:20.638397 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:20.645849 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:04:20.697891 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:04:20.725474 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:04:20.777807 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:04:20.828857 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:04:20.856249 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:04:21.410618 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 23:04:21.416146 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:21.427248 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:04:21.462156 tst handover.py: using LAC 24284 23:04:21.585432 tst handover.py: using RAC 59 23:04:21.712224 tst handover.py: using CellId 24284 23:04:21.838093 tst handover.py: using BVCI 24285 23:04:21.956676 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:04:22.009148 tst handover.py: using LAC 24285 23:04:22.133619 tst handover.py: using RAC 60 23:04:22.257325 tst handover.py: using CellId 24285 23:04:22.381367 tst handover.py: using BVCI 24286 23:04:22.497876 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:22.508937 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:22.519932 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:22.531225 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:22.542642 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:22.553814 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:04:22.671803 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:04:22.788146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:23.231660 run create_hlr_db(pid=27713): Launched 23:04:23.355858 bus /sierra_2: Setting Powered False 23:04:24.415929 run create_hlr_db(pid=27713): Terminated: ok {rc=0} 23:04:24.812078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27715): Launched 23:04:25.114783 run osmo-hlr_10.42.42.2(pid=27716): Launched 23:04:25.230368 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:25.723174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27718): Launched 23:04:26.025065 run osmo-stp_10.42.42.5(pid=27719): Launched 23:04:26.140832 run osmo-msc_10.42.42.6: Starting osmo-msc 23:04:26.660094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27721): Launched 23:04:26.961304 run osmo-msc_10.42.42.6(pid=27722): Launched 23:04:27.130400 run osmo-stp_10.42.42.5(pid=27719): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27719)] 23:04:27.258674 run osmo-stp_10.42.42.5(pid=27719): stdout: | (launched: 2022-12-09_23:04:25.970463) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:27.386133 run osmo-stp_10.42.42.5(pid=27719): stderr: | 20221209230426140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230426140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230426140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230426141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230426141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230426141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230426142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:27.511485 run osmo-stp_10.42.42.5(pid=27719): stdout: | (launched: 2022-12-09_23:04:25.970463) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:27.630994 run osmo-stp_10.42.42.5(pid=27719): stderr: | 20221209230426140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230426140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230426140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230426141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230426141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230426141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230426142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:27.774014 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27719): Process ended prematurely: osmo-stp_10.42.42.5(pid=27719) [trial-2365↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27719)] [trial-2365↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 23:04:27.782078 tst handover.py:18: Test FAILED (6.4 sec) 23:04:27.807885 run osmo-hlr_10.42.42.2(pid=27716): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27716)] 23:04:27.855355 run osmo-hlr_10.42.42.2(pid=27716): stdout: | (launched: 2022-12-09_23:04:25.060052) 23:04:27.904504 run osmo-hlr_10.42.42.2(pid=27716): stderr: | 20221209230425255 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230425255 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230425255 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230425255 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230425255 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230425256 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230425267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230425275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230425276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230425276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:27.973317 run osmo-msc_10.42.42.6(pid=27722): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27722)] 23:04:28.020687 run osmo-msc_10.42.42.6(pid=27722): stdout: | (launched: 2022-12-09_23:04:26.906711) 23:04:28.069559 run osmo-msc_10.42.42.6(pid=27722): stderr: | 20221209230427178 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230427178 DLGLOBAL DEBUG validating counter group 0x7ff63107cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230427178 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230427178 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230427179 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230427179 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230427181 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230427181 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230427181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230427181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:04:28.118787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27715): Terminating (SIGTERM) 23:04:28.157846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27718): Terminating (SIGTERM) 23:04:28.196846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27721): Terminating (SIGTERM) 23:04:28.236619 --- ParallelTerminationStrategy: PID 27715 died... 23:04:28.255439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27715): Terminated: ok {rc=0} 23:04:28.298828 --- ParallelTerminationStrategy: PID 27718 died... 23:04:28.317157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27718): Terminated: ok {rc=0} 23:04:28.360922 --- ParallelTerminationStrategy: PID 27721 died... 23:04:28.379696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27721): Terminated: ok {rc=0} 23:04:28.461410 bus /sierra_3: Setting Powered False 23:04:29.556119 bus /sierra_3: Setting Powered False 23:04:30.669862 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 23:04:31.971024 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:31.977310 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:04:32.039718 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:04:32.069189 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:04:32.126678 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:04:32.180788 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:04:32.209670 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:04:32.756814 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 23:04:32.762960 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:32.776134 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:04:32.810283 tst handover.py: using LAC 24286 23:04:32.937187 tst handover.py: using RAC 61 23:04:33.063358 tst handover.py: using CellId 24286 23:04:33.189115 tst handover.py: using BVCI 24287 23:04:33.307556 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:04:33.355628 tst handover.py: using LAC 24287 23:04:33.474683 tst handover.py: using RAC 62 23:04:33.596545 tst handover.py: using CellId 24287 23:04:33.716319 tst handover.py: using BVCI 24288 23:04:33.826795 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:33.837704 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:33.848340 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:33.859665 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:33.871034 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:33.882189 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:04:34.000401 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:04:34.121019 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:34.593957 run create_hlr_db(pid=27727): Launched 23:04:34.718687 bus /sierra_2: Setting Powered False 23:04:35.782502 run create_hlr_db(pid=27727): Terminated: ok {rc=0} 23:04:36.205469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27729): Launched 23:04:36.532035 run osmo-hlr_10.42.42.2(pid=27730): Launched 23:04:36.656282 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:37.186516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27732): Launched 23:04:37.509229 run osmo-stp_10.42.42.5(pid=27733): Launched 23:04:37.632836 run osmo-msc_10.42.42.6: Starting osmo-msc 23:04:38.188122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27735): Launched 23:04:38.511546 run osmo-msc_10.42.42.6(pid=27736): Launched 23:04:38.693236 run osmo-stp_10.42.42.5(pid=27733): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27733)] 23:04:38.829849 run osmo-stp_10.42.42.5(pid=27733): stdout: | (launched: 2022-12-09_23:04:37.451043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:38.967384 run osmo-stp_10.42.42.5(pid=27733): stderr: | 20221209230437645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230437645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230437645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230437646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230437646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230437646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230437646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:39.104194 run osmo-stp_10.42.42.5(pid=27733): stdout: | (launched: 2022-12-09_23:04:37.451043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:39.232914 run osmo-stp_10.42.42.5(pid=27733): stderr: | 20221209230437645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230437645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230437645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230437646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230437646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230437646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230437646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:39.387323 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27733): Process ended prematurely: osmo-stp_10.42.42.5(pid=27733) [trial-2365↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27733)] [trial-2365↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 23:04:39.396223 tst handover.py:18: Test FAILED (6.6 sec) 23:04:39.424332 run osmo-hlr_10.42.42.2(pid=27730): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27730)] 23:04:39.474906 run osmo-hlr_10.42.42.2(pid=27730): stdout: | (launched: 2022-12-09_23:04:36.473361) 23:04:39.527195 run osmo-hlr_10.42.42.2(pid=27730): stderr: | 20221209230436674 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230436674 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230436674 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230436674 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230436674 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230436674 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230436686 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230436695 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230436695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230436695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:39.599886 run osmo-msc_10.42.42.6(pid=27736): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27736)] 23:04:39.650030 run osmo-msc_10.42.42.6(pid=27736): stdout: | (launched: 2022-12-09_23:04:38.453677) 23:04:39.702223 run osmo-msc_10.42.42.6(pid=27736): stderr: | 20221209230438772 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230438773 DLGLOBAL DEBUG validating counter group 0x7f9a55b24c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230438773 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230438773 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230438773 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230438773 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230438775 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230438775 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230438775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230438775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:04:39.754696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27729): Terminating (SIGTERM) 23:04:39.796372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27732): Terminating (SIGTERM) 23:04:39.838510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27735): Terminating (SIGTERM) 23:04:39.880710 --- ParallelTerminationStrategy: PID 27729 died... 23:04:39.900651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27729): Terminated: ok {rc=0} 23:04:39.947229 --- ParallelTerminationStrategy: PID 27732 died... 23:04:39.967087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27732): Terminated: ok {rc=0} 23:04:40.013393 --- ParallelTerminationStrategy: PID 27735 died... 23:04:40.032916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27735): Terminated: ok {rc=0} 23:04:40.120941 bus /sierra_3: Setting Powered False 23:04:41.219521 bus /sierra_3: Setting Powered False 23:04:42.335230 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 23:04:43.589447 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:43.595936 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 23:04:43.645184 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 23:04:43.671304 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 23:04:43.722440 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 23:04:43.772489 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 23:04:43.799823 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 23:04:44.346330 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 23:04:44.353227 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:44.364427 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:04:44.399463 tst handover.py: using LAC 24288 23:04:44.519976 tst handover.py: using RAC 63 23:04:44.640846 tst handover.py: using CellId 24288 23:04:44.762954 tst handover.py: using BVCI 24289 23:04:44.872881 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:04:44.920876 tst handover.py: using LAC 24289 23:04:45.039694 tst handover.py: using RAC 64 23:04:45.160524 tst handover.py: using CellId 24289 23:04:45.285316 tst handover.py: using BVCI 24290 23:04:45.396058 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:45.406789 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:45.417478 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:45.427856 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:45.438431 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:45.448796 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:04:45.567122 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:04:45.683620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:46.182458 run create_hlr_db(pid=27741): Launched 23:04:46.339820 bus /sierra_2: Setting Powered False 23:04:47.401169 run create_hlr_db(pid=27741): Terminated: ok {rc=0} 23:04:47.816140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27743): Launched 23:04:48.139122 run osmo-hlr_10.42.42.2(pid=27744): Launched 23:04:48.263195 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:48.789113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27746): Launched 23:04:49.111838 run osmo-stp_10.42.42.5(pid=27747): Launched 23:04:49.235459 run osmo-msc_10.42.42.6: Starting osmo-msc 23:04:49.794712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27749): Launched 23:04:50.119270 run osmo-msc_10.42.42.6(pid=27750): Launched 23:04:50.300287 run osmo-stp_10.42.42.5(pid=27747): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27747)] 23:04:50.438054 run osmo-stp_10.42.42.5(pid=27747): stdout: | (launched: 2022-12-09_23:04:49.053775) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:50.575884 run osmo-stp_10.42.42.5(pid=27747): stderr: | 20221209230449247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230449248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230449248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230449248 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230449249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230449249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230449249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:50.713161 run osmo-stp_10.42.42.5(pid=27747): stdout: | (launched: 2022-12-09_23:04:49.053775) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:50.842126 run osmo-stp_10.42.42.5(pid=27747): stderr: | 20221209230449247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230449248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230449248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230449248 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230449249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230449249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230449249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:50.996297 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27747): Process ended prematurely: osmo-stp_10.42.42.5(pid=27747) [trial-2365↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27747)] [trial-2365↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 23:04:51.005559 tst handover.py:18: Test FAILED (6.6 sec) 23:04:51.033495 run osmo-hlr_10.42.42.2(pid=27744): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27744)] 23:04:51.084349 run osmo-hlr_10.42.42.2(pid=27744): stdout: | (launched: 2022-12-09_23:04:48.081169) 23:04:51.136686 run osmo-hlr_10.42.42.2(pid=27744): stderr: | 20221209230448277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230448277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230448277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230448277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230448278 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230448278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230448293 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230448301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230448302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230448302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:51.209278 run osmo-msc_10.42.42.6(pid=27750): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27750)] 23:04:51.259576 run osmo-msc_10.42.42.6(pid=27750): stdout: | (launched: 2022-12-09_23:04:50.060641) 23:04:51.311323 run osmo-msc_10.42.42.6(pid=27750): stderr: | 20221209230450382 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230450383 DLGLOBAL DEBUG validating counter group 0x7fd0877b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230450383 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230450383 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230450383 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230450383 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230450385 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230450385 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230450385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230450385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:04:51.363603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27743): Terminating (SIGTERM) 23:04:51.405600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27746): Terminating (SIGTERM) 23:04:51.447849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27749): Terminating (SIGTERM) 23:04:51.490388 --- ParallelTerminationStrategy: PID 27743 died... 23:04:51.510457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27743): Terminated: ok {rc=0} 23:04:51.557314 --- ParallelTerminationStrategy: PID 27746 died... 23:04:51.576733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27746): Terminated: ok {rc=0} 23:04:51.623350 --- ParallelTerminationStrategy: PID 27749 died... 23:04:51.643222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27749): Terminated: ok {rc=0} 23:04:51.732477 bus /sierra_3: Setting Powered False 23:04:52.832022 bus /sierra_3: Setting Powered False 23:04:53.948354 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 23:04:55.206499 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:55.212103 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 23:04:55.259963 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:04:55.288063 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 23:04:55.343550 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 23:04:55.390047 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:04:55.417841 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 23:04:55.968235 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 23:04:55.973816 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:04:55.985238 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:04:56.021886 tst handover.py: using LAC 24290 23:04:56.148294 tst handover.py: using RAC 65 23:04:56.274376 tst handover.py: using CellId 24290 23:04:56.402785 tst handover.py: using BVCI 24291 23:04:56.521745 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:04:56.567326 tst handover.py: using LAC 24291 23:04:56.695403 tst handover.py: using RAC 66 23:04:56.822571 tst handover.py: using CellId 24291 23:04:56.948801 tst handover.py: using BVCI 24292 23:04:57.065774 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:04:57.077176 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:04:57.088358 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:04:57.100418 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:04:57.112340 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:04:57.124264 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:04:57.246916 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:04:57.363309 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:57.806730 run create_hlr_db(pid=27755): Launched 23:04:57.931272 bus /sierra_2: Setting Powered False 23:04:58.991967 run create_hlr_db(pid=27755): Terminated: ok {rc=0} 23:04:59.406439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27758): Launched 23:04:59.731265 run osmo-hlr_10.42.42.2(pid=27759): Launched 23:04:59.855737 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:00.390904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27761): Launched 23:05:00.697549 run osmo-stp_10.42.42.5(pid=27762): Launched 23:05:00.814118 run osmo-msc_10.42.42.6: Starting osmo-msc 23:05:01.441127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27764): Launched 23:05:01.785812 run osmo-msc_10.42.42.6(pid=27765): Launched 23:05:02.112932 run osmo-stp_10.42.42.5(pid=27762): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27762)] 23:05:02.333776 run osmo-stp_10.42.42.5(pid=27762): stdout: | (launched: 2022-12-09_23:05:00.642723) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:02.501579 run osmo-stp_10.42.42.5(pid=27762): stderr: | 20221209230500811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230500811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230500811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230500812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230500812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230500812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230500812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:02.637555 run osmo-stp_10.42.42.5(pid=27762): stdout: | (launched: 2022-12-09_23:05:00.642723) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:02.767324 run osmo-stp_10.42.42.5(pid=27762): stderr: | 20221209230500811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230500811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230500811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230500812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230500812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230500812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230500812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:02.921741 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27762): Process ended prematurely: osmo-stp_10.42.42.5(pid=27762) [trial-2365↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27762)] [trial-2365↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 23:05:02.930504 tst handover.py:18: Test FAILED (7.0 sec) 23:05:02.958700 run osmo-hlr_10.42.42.2(pid=27759): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27759)] 23:05:03.009634 run osmo-hlr_10.42.42.2(pid=27759): stdout: | (launched: 2022-12-09_23:04:59.672850) 23:05:03.062554 run osmo-hlr_10.42.42.2(pid=27759): stderr: | 20221209230459869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230459869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230459869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230459870 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230459870 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230459870 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230459882 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230459890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230459890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230459891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:03.135973 run osmo-msc_10.42.42.6(pid=27765): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27765)] 23:05:03.186776 run osmo-msc_10.42.42.6(pid=27765): stdout: | (launched: 2022-12-09_23:05:01.720246) 23:05:03.239785 run osmo-msc_10.42.42.6(pid=27765): stderr: | 20221209230502118 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230502118 DLGLOBAL DEBUG validating counter group 0x7f19c4184c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230502118 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230502119 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230502119 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230502119 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230502121 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230502122 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230502123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230502123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:05:03.292558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27758): Terminating (SIGTERM) 23:05:03.335182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27761): Terminating (SIGTERM) 23:05:03.378320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27764): Terminating (SIGTERM) 23:05:03.421229 --- ParallelTerminationStrategy: PID 27758 died... 23:05:03.441495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27758): Terminated: ok {rc=0} 23:05:03.488788 --- ParallelTerminationStrategy: PID 27761 died... 23:05:03.508938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27761): Terminated: ok {rc=0} 23:05:03.555804 --- ParallelTerminationStrategy: PID 27764 died... 23:05:03.575497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27764): Terminated: ok {rc=0} 23:05:03.663432 bus /sierra_3: Setting Powered False 23:05:04.762279 bus /sierra_3: Setting Powered False 23:05:05.877760 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:05:07.127439 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:07.132573 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:05:07.182022 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:05:07.208317 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:05:07.260044 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:05:07.308857 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:05:07.335247 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:05:07.888104 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:05:07.893564 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:07.904448 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:05:07.941967 tst handover.py: using LAC 24292 23:05:08.060836 tst handover.py: using RAC 67 23:05:08.179629 tst handover.py: using CellId 24292 23:05:08.298440 tst handover.py: using BVCI 24293 23:05:08.409388 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:05:08.458273 tst handover.py: using LAC 24293 23:05:08.575454 tst handover.py: using RAC 68 23:05:08.694227 tst handover.py: using CellId 24293 23:05:08.812304 tst handover.py: using BVCI 24294 23:05:08.922879 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:08.933807 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:08.944426 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:08.955388 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:08.966306 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:08.977031 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:05:09.097521 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:05:09.217610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:09.690795 run create_hlr_db(pid=27773): Launched 23:05:09.815136 bus /sierra_2: Setting Powered False 23:05:10.879046 run create_hlr_db(pid=27773): Terminated: ok {rc=0} 23:05:11.300090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27775): Launched 23:05:11.622981 run osmo-hlr_10.42.42.2(pid=27776): Launched 23:05:11.747320 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:12.275962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27778): Launched 23:05:12.597700 run osmo-stp_10.42.42.5(pid=27779): Launched 23:05:12.721449 run osmo-msc_10.42.42.6: Starting osmo-msc 23:05:13.275380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27781): Launched 23:05:13.598649 run osmo-msc_10.42.42.6(pid=27782): Launched 23:05:13.780093 run osmo-stp_10.42.42.5(pid=27779): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27779)] 23:05:13.916587 run osmo-stp_10.42.42.5(pid=27779): stdout: | (launched: 2022-12-09_23:05:12.539628) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:14.053805 run osmo-stp_10.42.42.5(pid=27779): stderr: | 20221209230512732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230512732 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230512732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230512733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230512735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230512735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230512735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:14.189929 run osmo-stp_10.42.42.5(pid=27779): stdout: | (launched: 2022-12-09_23:05:12.539628) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:14.318670 run osmo-stp_10.42.42.5(pid=27779): stderr: | 20221209230512732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230512732 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230512732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230512733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230512735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230512735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230512735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:14.472795 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27779): Process ended prematurely: osmo-stp_10.42.42.5(pid=27779) [trial-2365↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27779)] [trial-2365↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 23:05:14.481768 tst handover.py:18: Test FAILED (6.6 sec) 23:05:14.509432 run osmo-hlr_10.42.42.2(pid=27776): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27776)] 23:05:14.559860 run osmo-hlr_10.42.42.2(pid=27776): stdout: | (launched: 2022-12-09_23:05:11.564785) 23:05:14.611999 run osmo-hlr_10.42.42.2(pid=27776): stderr: | 20221209230511763 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230511763 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230511764 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230511764 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230511764 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230511764 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230511776 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230511784 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230511784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230511784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:14.684694 run osmo-msc_10.42.42.6(pid=27782): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27782)] 23:05:14.735266 run osmo-msc_10.42.42.6(pid=27782): stdout: | (launched: 2022-12-09_23:05:13.540389) 23:05:14.787061 run osmo-msc_10.42.42.6(pid=27782): stderr: | 20221209230513861 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230513861 DLGLOBAL DEBUG validating counter group 0x7f939a99cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230513861 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230513862 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230513862 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230513862 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230513863 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230513864 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230513864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230513864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:05:14.839323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27775): Terminating (SIGTERM) 23:05:14.881332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27778): Terminating (SIGTERM) 23:05:14.923159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27781): Terminating (SIGTERM) 23:05:14.965770 --- ParallelTerminationStrategy: PID 27775 died... 23:05:14.985850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27775): Terminated: ok {rc=0} 23:05:15.032541 --- ParallelTerminationStrategy: PID 27778 died... 23:05:15.052167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27778): Terminated: ok {rc=0} 23:05:15.098615 --- ParallelTerminationStrategy: PID 27781 died... 23:05:15.118131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27781): Terminated: ok {rc=0} 23:05:15.206157 bus /sierra_3: Setting Powered False 23:05:16.301880 bus /sierra_3: Setting Powered False 23:05:17.418112 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 23:05:18.674363 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:18.679419 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:05:18.716042 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:05:18.742777 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:05:18.795121 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:05:18.832224 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:05:18.858371 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:05:19.406758 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 23:05:19.412205 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:19.423098 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 23:05:19.459207 tst handover.py: using LAC 24294 23:05:19.578357 tst handover.py: using RAC 69 23:05:19.696771 tst handover.py: using CellId 24294 23:05:19.816813 tst handover.py: using BVCI 24295 23:05:19.928789 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 23:05:19.963340 tst handover.py: using LAC 24295 23:05:20.082230 tst handover.py: using RAC 70 23:05:20.202321 tst handover.py: using CellId 24295 23:05:20.321349 tst handover.py: using BVCI 24296 23:05:20.430105 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:20.441077 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:20.451929 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:20.462667 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:20.473700 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:20.484425 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 23:05:20.604601 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 23:05:20.724621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:21.195896 run create_hlr_db(pid=27787): Launched 23:05:21.319811 bus /sierra_2: Setting Powered False 23:05:22.384599 run create_hlr_db(pid=27787): Terminated: ok {rc=0} 23:05:22.792067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27789): Launched 23:05:23.095435 run osmo-hlr_10.42.42.2(pid=27790): Launched 23:05:23.211480 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:23.707483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27792): Launched 23:05:24.008548 run osmo-stp_10.42.42.5(pid=27793): Launched 23:05:24.123687 run osmo-msc_10.42.42.6: Starting osmo-msc 23:05:24.642499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27795): Launched 23:05:24.944887 run osmo-msc_10.42.42.6(pid=27796): Launched 23:05:25.114250 run osmo-stp_10.42.42.5(pid=27793): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27793)] 23:05:25.242140 run osmo-stp_10.42.42.5(pid=27793): stdout: | (launched: 2022-12-09_23:05:23.954256) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:25.369908 run osmo-stp_10.42.42.5(pid=27793): stderr: | 20221209230524124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230524124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230524125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230524125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230524126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230524126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230524126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:25.495375 run osmo-stp_10.42.42.5(pid=27793): stdout: | (launched: 2022-12-09_23:05:23.954256) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:25.614852 run osmo-stp_10.42.42.5(pid=27793): stderr: | 20221209230524124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230524124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230524125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230524125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230524126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230524126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230524126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:25.758385 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27793): Process ended prematurely: osmo-stp_10.42.42.5(pid=27793) [trial-2365↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27793)] [trial-2365↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 23:05:25.766469 tst handover.py:18: Test FAILED (6.3 sec) 23:05:25.792358 run osmo-hlr_10.42.42.2(pid=27790): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27790)] 23:05:25.839869 run osmo-hlr_10.42.42.2(pid=27790): stdout: | (launched: 2022-12-09_23:05:23.040667) 23:05:25.889272 run osmo-hlr_10.42.42.2(pid=27790): stderr: | 20221209230523216 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230523216 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230523217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230523217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230523217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230523217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230523229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230523238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230523238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230523238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:25.957985 run osmo-msc_10.42.42.6(pid=27796): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27796)] 23:05:26.005332 run osmo-msc_10.42.42.6(pid=27796): stdout: | (launched: 2022-12-09_23:05:24.889923) 23:05:26.054262 run osmo-msc_10.42.42.6(pid=27796): stderr: | 20221209230525158 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230525159 DLGLOBAL DEBUG validating counter group 0x7f4e84739c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230525159 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230525159 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230525159 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230525159 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230525161 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230525161 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230525161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230525161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:05:26.103657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27789): Terminating (SIGTERM) 23:05:26.142982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27792): Terminating (SIGTERM) 23:05:26.182373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27795): Terminating (SIGTERM) 23:05:26.222012 --- ParallelTerminationStrategy: PID 27789 died... 23:05:26.240833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27789): Terminated: ok {rc=0} 23:05:26.284659 --- ParallelTerminationStrategy: PID 27792 died... 23:05:26.303039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27792): Terminated: ok {rc=0} 23:05:26.346586 --- ParallelTerminationStrategy: PID 27795 died... 23:05:26.365161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27795): Terminated: ok {rc=0} 23:05:26.447928 bus /sierra_3: Setting Powered False 23:05:27.545523 bus /sierra_3: Setting Powered False 23:05:28.662722 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 23:05:29.903673 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:29.909942 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:05:29.959084 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:05:29.985308 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:05:30.035395 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:05:30.083215 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:05:30.109258 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:05:30.660279 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 23:05:30.665458 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:30.675970 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:05:30.708390 tst handover.py: using LAC 24296 23:05:30.827095 tst handover.py: using RAC 71 23:05:30.966132 tst handover.py: using CellId 24296 23:05:31.100229 tst handover.py: using BVCI 24297 23:05:31.227478 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:05:31.278203 tst handover.py: using LAC 24297 23:05:31.409070 tst handover.py: using RAC 72 23:05:31.528328 tst handover.py: using CellId 24297 23:05:31.677035 tst handover.py: using BVCI 24298 23:05:31.806243 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:31.818720 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:31.831149 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:31.843887 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:31.857825 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:31.871068 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:05:31.999365 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:05:32.126869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:32.596635 run create_hlr_db(pid=27801): Launched 23:05:32.719657 bus /sierra_2: Setting Powered False 23:05:33.781162 run create_hlr_db(pid=27801): Terminated: ok {rc=0} 23:05:34.194806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27803): Launched 23:05:34.501445 run osmo-hlr_10.42.42.2(pid=27804): Launched 23:05:34.617253 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:35.119969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27806): Launched 23:05:35.422076 run osmo-stp_10.42.42.5(pid=27807): Launched 23:05:35.537184 run osmo-msc_10.42.42.6: Starting osmo-msc 23:05:36.056536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27809): Launched 23:05:36.359332 run osmo-msc_10.42.42.6(pid=27810): Launched 23:05:36.529744 run osmo-stp_10.42.42.5(pid=27807): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27807)] 23:05:36.657670 run osmo-stp_10.42.42.5(pid=27807): stdout: | (launched: 2022-12-09_23:05:35.367235) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:36.786178 run osmo-stp_10.42.42.5(pid=27807): stderr: | 20221209230535538 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230535538 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230535538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230535539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230535541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230535541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230535541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:36.912861 run osmo-stp_10.42.42.5(pid=27807): stdout: | (launched: 2022-12-09_23:05:35.367235) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:37.033415 run osmo-stp_10.42.42.5(pid=27807): stderr: | 20221209230535538 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230535538 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230535538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230535539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230535541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230535541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230535541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:37.177528 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27807): Process ended prematurely: osmo-stp_10.42.42.5(pid=27807) [trial-2365↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27807)] [trial-2365↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 23:05:37.185904 tst handover.py:18: Test FAILED (6.5 sec) 23:05:37.211724 run osmo-hlr_10.42.42.2(pid=27804): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27804)] 23:05:37.259503 run osmo-hlr_10.42.42.2(pid=27804): stdout: | (launched: 2022-12-09_23:05:34.446787) 23:05:37.308512 run osmo-hlr_10.42.42.2(pid=27804): stderr: | 20221209230534622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230534622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230534622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230534622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230534622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230534622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230534634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230534644 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230534644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230534644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:37.376937 run osmo-msc_10.42.42.6(pid=27810): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27810)] 23:05:37.424204 run osmo-msc_10.42.42.6(pid=27810): stdout: | (launched: 2022-12-09_23:05:36.304206) 23:05:37.473075 run osmo-msc_10.42.42.6(pid=27810): stderr: | 20221209230536574 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230536574 DLGLOBAL DEBUG validating counter group 0x7fac6223fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230536574 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230536575 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230536575 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230536575 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230536577 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230536577 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230536577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230536577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:05:37.522499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27803): Terminating (SIGTERM) 23:05:37.561784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27806): Terminating (SIGTERM) 23:05:37.601322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27809): Terminating (SIGTERM) 23:05:37.641666 --- ParallelTerminationStrategy: PID 27803 died... 23:05:37.660594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27803): Terminated: ok {rc=0} 23:05:37.704217 --- ParallelTerminationStrategy: PID 27806 died... 23:05:37.722654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27806): Terminated: ok {rc=0} 23:05:37.766157 --- ParallelTerminationStrategy: PID 27809 died... 23:05:37.784458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27809): Terminated: ok {rc=0} 23:05:37.867990 bus /sierra_3: Setting Powered False 23:05:38.965843 bus /sierra_3: Setting Powered False 23:05:40.083816 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 23:05:41.337063 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:41.342179 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:05:41.389861 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:05:41.416003 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:05:41.467092 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:05:41.514286 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:05:41.540295 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:05:42.091887 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 23:05:42.096900 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:42.107941 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:05:42.142059 tst handover.py: using LAC 24298 23:05:42.261381 tst handover.py: using RAC 73 23:05:42.381554 tst handover.py: using CellId 24298 23:05:42.500371 tst handover.py: using BVCI 24299 23:05:42.609732 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:05:42.657686 tst handover.py: using LAC 24299 23:05:42.781394 tst handover.py: using RAC 74 23:05:42.899098 tst handover.py: using CellId 24299 23:05:43.025754 tst handover.py: using BVCI 24300 23:05:43.145270 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:43.156613 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:43.168908 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:43.180630 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:43.192394 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:43.204475 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:05:43.322815 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:05:43.444347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:43.918589 run create_hlr_db(pid=27815): Launched 23:05:44.042668 bus /sierra_2: Setting Powered False 23:05:45.107944 run create_hlr_db(pid=27815): Terminated: ok {rc=0} 23:05:45.516377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27817): Launched 23:05:45.820396 run osmo-hlr_10.42.42.2(pid=27818): Launched 23:05:46.120650 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:46.677719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27820): Launched 23:05:47.031359 run osmo-stp_10.42.42.5(pid=27821): Launched 23:05:47.228442 run osmo-msc_10.42.42.6: Starting osmo-msc 23:05:47.788197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27823): Launched 23:05:48.112384 run osmo-msc_10.42.42.6(pid=27824): Launched 23:05:48.293148 run osmo-stp_10.42.42.5(pid=27821): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27821)] 23:05:48.430334 run osmo-stp_10.42.42.5(pid=27821): stdout: | (launched: 2022-12-09_23:05:46.958424) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:48.568051 run osmo-stp_10.42.42.5(pid=27821): stderr: | 20221209230547253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230547253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230547253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230547253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230547256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230547256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230547256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:48.705304 run osmo-stp_10.42.42.5(pid=27821): stdout: | (launched: 2022-12-09_23:05:46.958424) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:48.834791 run osmo-stp_10.42.42.5(pid=27821): stderr: | 20221209230547253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230547253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230547253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230547253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230547256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230547256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230547256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:48.989747 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27821): Process ended prematurely: osmo-stp_10.42.42.5(pid=27821) [trial-2365↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27821)] [trial-2365↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 23:05:48.998983 tst handover.py:18: Test FAILED (6.9 sec) 23:05:49.026354 run osmo-hlr_10.42.42.2(pid=27818): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27818)] 23:05:49.077635 run osmo-hlr_10.42.42.2(pid=27818): stdout: | (launched: 2022-12-09_23:05:45.765623) 23:05:49.129414 run osmo-hlr_10.42.42.2(pid=27818): stderr: | 20221209230545956 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230545956 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230545956 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230545957 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230545957 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230545957 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230545970 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230545987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230545987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230545987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:49.202190 run osmo-msc_10.42.42.6(pid=27824): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27824)] 23:05:49.252616 run osmo-msc_10.42.42.6(pid=27824): stdout: | (launched: 2022-12-09_23:05:48.054166) 23:05:49.304895 run osmo-msc_10.42.42.6(pid=27824): stderr: | 20221209230548374 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230548374 DLGLOBAL DEBUG validating counter group 0x7fdff0522c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230548374 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230548374 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230548374 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230548375 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230548376 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230548377 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230548377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230548377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:05:49.357436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27817): Terminating (SIGTERM) 23:05:49.399591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27820): Terminating (SIGTERM) 23:05:49.442288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27823): Terminating (SIGTERM) 23:05:49.485262 --- ParallelTerminationStrategy: PID 27817 died... 23:05:49.505261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27817): Terminated: ok {rc=0} 23:05:49.552065 --- ParallelTerminationStrategy: PID 27820 died... 23:05:49.571622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27820): Terminated: ok {rc=0} 23:05:49.618494 --- ParallelTerminationStrategy: PID 27823 died... 23:05:49.638075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27823): Terminated: ok {rc=0} 23:05:49.726293 bus /sierra_3: Setting Powered False 23:05:50.825394 bus /sierra_3: Setting Powered False 23:05:51.940546 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 23:05:53.197521 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:53.203289 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 23:05:53.264363 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:05:53.291685 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 23:05:53.346438 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 23:05:53.407305 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:05:53.434399 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 23:05:53.986589 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 23:05:53.992434 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:54.004023 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:05:54.057384 tst handover.py: using LAC 24300 23:05:54.183569 tst handover.py: using RAC 75 23:05:54.301400 tst handover.py: using CellId 24300 23:05:54.427074 tst handover.py: using BVCI 24301 23:05:54.547244 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:05:54.592259 tst handover.py: using LAC 24301 23:05:54.715463 tst handover.py: using RAC 76 23:05:54.831866 tst handover.py: using CellId 24301 23:05:54.951166 tst handover.py: using BVCI 24302 23:05:55.060574 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:55.071524 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:55.082254 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:55.093001 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:55.103705 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:55.114448 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:05:55.235768 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:05:55.356134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:55.828816 run create_hlr_db(pid=27829): Launched 23:05:55.952331 bus /sierra_2: Setting Powered False 23:05:57.016800 run create_hlr_db(pid=27829): Terminated: ok {rc=0} 23:05:57.440153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27831): Launched 23:05:57.766251 run osmo-hlr_10.42.42.2(pid=27832): Launched 23:05:57.890006 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:58.422148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27834): Launched 23:05:58.745465 run osmo-stp_10.42.42.5(pid=27835): Launched 23:05:58.870561 run osmo-msc_10.42.42.6: Starting osmo-msc 23:05:59.430520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27837): Launched 23:05:59.755379 run osmo-msc_10.42.42.6(pid=27838): Launched 23:05:59.936712 run osmo-stp_10.42.42.5(pid=27835): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27835)] 23:06:00.074021 run osmo-stp_10.42.42.5(pid=27835): stdout: | (launched: 2022-12-09_23:05:58.686914) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:00.211870 run osmo-stp_10.42.42.5(pid=27835): stderr: | 20221209230558880 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230558880 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230558880 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230558881 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230558881 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230558881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230558881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:00.348665 run osmo-stp_10.42.42.5(pid=27835): stdout: | (launched: 2022-12-09_23:05:58.686914) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:00.477899 run osmo-stp_10.42.42.5(pid=27835): stderr: | 20221209230558880 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230558880 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230558880 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230558881 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230558881 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230558881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230558881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:00.634384 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27835): Process ended prematurely: osmo-stp_10.42.42.5(pid=27835) [trial-2365↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27835)] [trial-2365↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 23:06:00.643521 tst handover.py:18: Test FAILED (6.6 sec) 23:06:00.671671 run osmo-hlr_10.42.42.2(pid=27832): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27832)] 23:06:00.722426 run osmo-hlr_10.42.42.2(pid=27832): stdout: | (launched: 2022-12-09_23:05:57.706139) 23:06:00.774285 run osmo-hlr_10.42.42.2(pid=27832): stderr: | 20221209230557905 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230557905 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230557905 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230557905 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230557905 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230557906 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230557918 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230557926 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230557926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230557926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:00.847361 run osmo-msc_10.42.42.6(pid=27838): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27838)] 23:06:00.898294 run osmo-msc_10.42.42.6(pid=27838): stdout: | (launched: 2022-12-09_23:05:59.696468) 23:06:00.951519 run osmo-msc_10.42.42.6(pid=27838): stderr: | 20221209230600018 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230600018 DLGLOBAL DEBUG validating counter group 0x7fbcec793c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230600018 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230600018 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230600018 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230600019 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230600020 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230600021 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230600021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230600021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:01.004924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27831): Terminating (SIGTERM) 23:06:01.047574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27834): Terminating (SIGTERM) 23:06:01.090260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27837): Terminating (SIGTERM) 23:06:01.133518 --- ParallelTerminationStrategy: PID 27831 died... 23:06:01.153653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27831): Terminated: ok {rc=0} 23:06:01.201536 --- ParallelTerminationStrategy: PID 27834 died... 23:06:01.221615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27834): Terminated: ok {rc=0} 23:06:01.269327 --- ParallelTerminationStrategy: PID 27837 died... 23:06:01.289536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27837): Terminated: ok {rc=0} 23:06:01.386642 bus /sierra_3: Setting Powered False 23:06:02.487869 bus /sierra_3: Setting Powered False 23:06:03.603673 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:06:04.874360 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:04.880121 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:06:04.945574 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:06:04.972996 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:06:05.032214 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:06:05.098751 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:06:05.126544 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:06:05.670633 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:06:05.676352 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:05.687836 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:06:05.737847 tst handover.py: using LAC 24302 23:06:05.865300 tst handover.py: using RAC 77 23:06:05.989723 tst handover.py: using CellId 24302 23:06:06.113738 tst handover.py: using BVCI 24303 23:06:06.230963 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:06:06.289837 tst handover.py: using LAC 24303 23:06:06.422174 tst handover.py: using RAC 78 23:06:06.548419 tst handover.py: using CellId 24303 23:06:06.673354 tst handover.py: using BVCI 24304 23:06:06.791191 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:06.802779 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:06.814319 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:06.826299 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:06.838166 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:06.850038 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:06:06.967754 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:06:07.086806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:07.560674 run create_hlr_db(pid=27843): Launched 23:06:07.683807 bus /sierra_2: Setting Powered False 23:06:08.749148 run create_hlr_db(pid=27843): Terminated: ok {rc=0} 23:06:09.171868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27845): Launched 23:06:09.495325 run osmo-hlr_10.42.42.2(pid=27846): Launched 23:06:09.619101 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:10.149664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27848): Launched 23:06:10.475726 run osmo-stp_10.42.42.5(pid=27849): Launched 23:06:10.599841 run osmo-msc_10.42.42.6: Starting osmo-msc 23:06:11.154931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27851): Launched 23:06:11.478957 run osmo-msc_10.42.42.6(pid=27852): Launched 23:06:11.660194 run osmo-stp_10.42.42.5(pid=27849): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27849)] 23:06:11.796845 run osmo-stp_10.42.42.5(pid=27849): stdout: | (launched: 2022-12-09_23:06:10.416821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:11.933934 run osmo-stp_10.42.42.5(pid=27849): stderr: | 20221209230610608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230610608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230610608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230610609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230610609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230610609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230610609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:12.070013 run osmo-stp_10.42.42.5(pid=27849): stdout: | (launched: 2022-12-09_23:06:10.416821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:12.199003 run osmo-stp_10.42.42.5(pid=27849): stderr: | 20221209230610608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230610608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230610608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230610609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230610609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230610609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230610609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:12.353328 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27849): Process ended prematurely: osmo-stp_10.42.42.5(pid=27849) [trial-2365↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27849)] [trial-2365↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 23:06:12.362165 tst handover.py:18: Test FAILED (6.7 sec) 23:06:12.389971 run osmo-hlr_10.42.42.2(pid=27846): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27846)] 23:06:12.439541 run osmo-hlr_10.42.42.2(pid=27846): stdout: | (launched: 2022-12-09_23:06:09.437104) 23:06:12.491858 run osmo-hlr_10.42.42.2(pid=27846): stderr: | 20221209230609635 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230609635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230609635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230609635 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230609635 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230609635 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230609647 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230609655 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230609656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230609656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:12.564319 run osmo-msc_10.42.42.6(pid=27852): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27852)] 23:06:12.614483 run osmo-msc_10.42.42.6(pid=27852): stdout: | (launched: 2022-12-09_23:06:11.420585) 23:06:12.666546 run osmo-msc_10.42.42.6(pid=27852): stderr: | 20221209230611740 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230611740 DLGLOBAL DEBUG validating counter group 0x7f0c8eb54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230611741 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230611741 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230611741 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230611741 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230611743 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230611743 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230611743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230611743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:12.719295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27845): Terminating (SIGTERM) 23:06:12.760808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27848): Terminating (SIGTERM) 23:06:12.803168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27851): Terminating (SIGTERM) 23:06:12.844904 --- ParallelTerminationStrategy: PID 27845 died... 23:06:12.865234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27845): Terminated: ok {rc=0} 23:06:12.911886 --- ParallelTerminationStrategy: PID 27848 died... 23:06:12.931417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27848): Terminated: ok {rc=0} 23:06:12.977946 --- ParallelTerminationStrategy: PID 27851 died... 23:06:12.997453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27851): Terminated: ok {rc=0} 23:06:13.085901 bus /sierra_3: Setting Powered False 23:06:14.184786 bus /sierra_3: Setting Powered False 23:06:15.300816 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 23:06:16.575453 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:16.581764 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:06:16.633332 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:06:16.661439 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:06:16.713943 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:06:16.767377 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:06:16.796648 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:06:17.344713 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 23:06:17.351216 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:17.362411 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 23:06:17.409834 tst handover.py: using LAC 24304 23:06:17.529370 tst handover.py: using RAC 79 23:06:17.656347 tst handover.py: using CellId 24304 23:06:17.782349 tst handover.py: using BVCI 24305 23:06:17.901702 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 23:06:17.935900 tst handover.py: using LAC 24305 23:06:18.060411 tst handover.py: using RAC 80 23:06:18.186556 tst handover.py: using CellId 24305 23:06:18.311507 tst handover.py: using BVCI 24306 23:06:18.428782 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:18.439976 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:18.451058 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:18.462087 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:18.474864 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:18.486578 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 23:06:18.604032 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 23:06:18.723306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:19.194445 run create_hlr_db(pid=27857): Launched 23:06:19.317758 bus /sierra_2: Setting Powered False 23:06:20.382455 run create_hlr_db(pid=27857): Terminated: ok {rc=0} 23:06:20.805330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27859): Launched 23:06:21.129128 run osmo-hlr_10.42.42.2(pid=27860): Launched 23:06:21.254022 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:21.784296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27862): Launched 23:06:22.108053 run osmo-stp_10.42.42.5(pid=27863): Launched 23:06:22.232488 run osmo-msc_10.42.42.6: Starting osmo-msc 23:06:22.789148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27865): Launched 23:06:23.112723 run osmo-msc_10.42.42.6(pid=27866): Launched 23:06:23.294698 run osmo-stp_10.42.42.5(pid=27863): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27863)] 23:06:23.431706 run osmo-stp_10.42.42.5(pid=27863): stdout: | (launched: 2022-12-09_23:06:22.049621) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:23.569915 run osmo-stp_10.42.42.5(pid=27863): stderr: | 20221209230622239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230622240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230622240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230622240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230622241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230622241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230622242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:23.706415 run osmo-stp_10.42.42.5(pid=27863): stdout: | (launched: 2022-12-09_23:06:22.049621) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:23.836094 run osmo-stp_10.42.42.5(pid=27863): stderr: | 20221209230622239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230622240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230622240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230622240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230622241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230622241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230622242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:23.990325 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27863): Process ended prematurely: osmo-stp_10.42.42.5(pid=27863) [trial-2365↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27863)] [trial-2365↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 23:06:23.999220 tst handover.py:18: Test FAILED (6.6 sec) 23:06:24.027177 run osmo-hlr_10.42.42.2(pid=27860): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27860)] 23:06:24.077735 run osmo-hlr_10.42.42.2(pid=27860): stdout: | (launched: 2022-12-09_23:06:21.070844) 23:06:24.129689 run osmo-hlr_10.42.42.2(pid=27860): stderr: | 20221209230621267 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230621267 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230621267 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230621267 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230621267 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230621267 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230621280 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230621288 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230621288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230621288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:24.202186 run osmo-msc_10.42.42.6(pid=27866): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27866)] 23:06:24.252157 run osmo-msc_10.42.42.6(pid=27866): stdout: | (launched: 2022-12-09_23:06:23.054452) 23:06:24.303989 run osmo-msc_10.42.42.6(pid=27866): stderr: | 20221209230623376 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230623377 DLGLOBAL DEBUG validating counter group 0x7f52a74dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230623377 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230623377 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230623377 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230623377 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230623379 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230623380 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230623380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230623380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:24.356305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27859): Terminating (SIGTERM) 23:06:24.397910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27862): Terminating (SIGTERM) 23:06:24.439428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27865): Terminating (SIGTERM) 23:06:24.481913 --- ParallelTerminationStrategy: PID 27859 died... 23:06:24.502079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27859): Terminated: ok {rc=0} 23:06:24.548822 --- ParallelTerminationStrategy: PID 27862 died... 23:06:24.568745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27862): Terminated: ok {rc=0} 23:06:24.615375 --- ParallelTerminationStrategy: PID 27865 died... 23:06:24.634922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27865): Terminated: ok {rc=0} 23:06:24.722907 bus /sierra_3: Setting Powered False 23:06:25.822428 bus /sierra_3: Setting Powered False 23:06:26.941171 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 23:06:28.201460 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:28.207765 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:06:28.270047 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:06:28.296340 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:06:28.346770 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:06:28.408854 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:06:28.434892 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:06:28.987128 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 23:06:28.992258 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:29.002983 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:06:29.049985 tst handover.py: using LAC 24306 23:06:29.177364 tst handover.py: using RAC 81 23:06:29.302136 tst handover.py: using CellId 24306 23:06:29.429282 tst handover.py: using BVCI 24307 23:06:29.546751 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:06:29.597596 tst handover.py: using LAC 24307 23:06:29.716153 tst handover.py: using RAC 82 23:06:29.833350 tst handover.py: using CellId 24307 23:06:29.951774 tst handover.py: using BVCI 24308 23:06:30.069934 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:30.081287 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:30.092495 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:30.104148 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:30.115346 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:30.127266 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:06:30.245793 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:06:30.362966 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:30.804893 run create_hlr_db(pid=27871): Launched 23:06:30.972304 bus /sierra_2: Setting Powered False 23:06:32.053378 run create_hlr_db(pid=27871): Terminated: ok {rc=0} 23:06:32.517642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27873): Launched 23:06:32.846724 run osmo-hlr_10.42.42.2(pid=27874): Launched 23:06:32.970725 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:33.503700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27876): Launched 23:06:33.827583 run osmo-stp_10.42.42.5(pid=27877): Launched 23:06:33.952275 run osmo-msc_10.42.42.6: Starting osmo-msc 23:06:34.512167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27879): Launched 23:06:34.837275 run osmo-msc_10.42.42.6(pid=27880): Launched 23:06:35.020058 run osmo-stp_10.42.42.5(pid=27877): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27877)] 23:06:35.157633 run osmo-stp_10.42.42.5(pid=27877): stdout: | (launched: 2022-12-09_23:06:33.769303) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:35.295820 run osmo-stp_10.42.42.5(pid=27877): stderr: | 20221209230633961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230633961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230633961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230633962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230633962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230633962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230633962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:35.433875 run osmo-stp_10.42.42.5(pid=27877): stdout: | (launched: 2022-12-09_23:06:33.769303) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:35.563512 run osmo-stp_10.42.42.5(pid=27877): stderr: | 20221209230633961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230633961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230633961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230633962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230633962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230633962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230633962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:35.718645 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27877): Process ended prematurely: osmo-stp_10.42.42.5(pid=27877) [trial-2365↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27877)] [trial-2365↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 23:06:35.728133 tst handover.py:18: Test FAILED (6.7 sec) 23:06:35.756343 run osmo-hlr_10.42.42.2(pid=27874): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27874)] 23:06:35.807101 run osmo-hlr_10.42.42.2(pid=27874): stdout: | (launched: 2022-12-09_23:06:32.787368) 23:06:35.859304 run osmo-hlr_10.42.42.2(pid=27874): stderr: | 20221209230632986 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230632986 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230632986 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230632986 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230632986 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230632986 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230632999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230633007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230633008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230633008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:35.931896 run osmo-msc_10.42.42.6(pid=27880): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27880)] 23:06:35.982094 run osmo-msc_10.42.42.6(pid=27880): stdout: | (launched: 2022-12-09_23:06:34.778426) 23:06:36.034103 run osmo-msc_10.42.42.6(pid=27880): stderr: | 20221209230635100 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230635100 DLGLOBAL DEBUG validating counter group 0x7fba198bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230635100 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230635100 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230635100 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230635101 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230635102 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230635103 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230635103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230635103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:36.086890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27873): Terminating (SIGTERM) 23:06:36.129074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27876): Terminating (SIGTERM) 23:06:36.171312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27879): Terminating (SIGTERM) 23:06:36.214287 --- ParallelTerminationStrategy: PID 27873 died... 23:06:36.234498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27873): Terminated: ok {rc=0} 23:06:36.281779 --- ParallelTerminationStrategy: PID 27876 died... 23:06:36.301606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27876): Terminated: ok {rc=0} 23:06:36.348592 --- ParallelTerminationStrategy: PID 27879 died... 23:06:36.368445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27879): Terminated: ok {rc=0} 23:06:36.456571 bus /sierra_3: Setting Powered False 23:06:37.556210 bus /sierra_3: Setting Powered False 23:06:38.673848 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 23:06:39.944616 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:39.950394 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:06:40.014129 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:06:40.041547 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:06:40.093823 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:06:40.157203 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:06:40.184359 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:06:40.734355 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 23:06:40.739762 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:40.750723 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:06:40.797844 tst handover.py: using LAC 24308 23:06:40.924863 tst handover.py: using RAC 83 23:06:41.052502 tst handover.py: using CellId 24308 23:06:41.179316 tst handover.py: using BVCI 24309 23:06:41.296711 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:06:41.345545 tst handover.py: using LAC 24309 23:06:41.474688 tst handover.py: using RAC 84 23:06:41.601955 tst handover.py: using CellId 24309 23:06:41.729912 tst handover.py: using BVCI 24310 23:06:41.849147 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:41.860360 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:41.871379 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:41.882764 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:41.893842 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:41.904811 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:06:42.022287 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:06:42.136830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:42.580844 run create_hlr_db(pid=27885): Launched 23:06:42.706031 bus /sierra_2: Setting Powered False 23:06:43.766602 run create_hlr_db(pid=27885): Terminated: ok {rc=0} 23:06:44.181578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27887): Launched 23:06:44.508420 run osmo-hlr_10.42.42.2(pid=27888): Launched 23:06:44.633088 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:45.166436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27890): Launched 23:06:45.490746 run osmo-stp_10.42.42.5(pid=27891): Launched 23:06:45.615375 run osmo-msc_10.42.42.6: Starting osmo-msc 23:06:46.187310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27893): Launched 23:06:46.524510 run osmo-msc_10.42.42.6(pid=27894): Launched 23:06:46.762361 run osmo-stp_10.42.42.5(pid=27891): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27891)] 23:06:47.146563 run osmo-stp_10.42.42.5(pid=27891): stdout: | (launched: 2022-12-09_23:06:45.432135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:47.314903 run osmo-stp_10.42.42.5(pid=27891): stderr: | 20221209230645625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230645625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230645625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230645625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230645626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230645626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230645626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:47.444292 run osmo-stp_10.42.42.5(pid=27891): stdout: | (launched: 2022-12-09_23:06:45.432135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:47.566007 run osmo-stp_10.42.42.5(pid=27891): stderr: | 20221209230645625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230645625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230645625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230645625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230645626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230645626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230645626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:47.711203 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27891): Process ended prematurely: osmo-stp_10.42.42.5(pid=27891) [trial-2365↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27891)] [trial-2365↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 23:06:47.719691 tst handover.py:18: Test FAILED (7.0 sec) 23:06:47.746292 run osmo-hlr_10.42.42.2(pid=27888): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27888)] 23:06:47.794765 run osmo-hlr_10.42.42.2(pid=27888): stdout: | (launched: 2022-12-09_23:06:44.449580) 23:06:47.844415 run osmo-hlr_10.42.42.2(pid=27888): stderr: | 20221209230644648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230644648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230644648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230644648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230644648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230644648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230644660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230644670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230644670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230644670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:47.913973 run osmo-msc_10.42.42.6(pid=27894): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27894)] 23:06:47.962081 run osmo-msc_10.42.42.6(pid=27894): stdout: | (launched: 2022-12-09_23:06:46.463543) 23:06:48.011107 run osmo-msc_10.42.42.6(pid=27894): stderr: | 20221209230646979 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230646980 DLGLOBAL DEBUG validating counter group 0x7fab0d628c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230646980 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230646980 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230646981 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230646981 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230646985 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230646986 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230646986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230646986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:48.060804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27887): Terminating (SIGTERM) 23:06:48.100750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27890): Terminating (SIGTERM) 23:06:48.141073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27893): Terminating (SIGTERM) 23:06:48.182045 --- ParallelTerminationStrategy: PID 27887 died... 23:06:48.201301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27887): Terminated: ok {rc=0} 23:06:48.245583 --- ParallelTerminationStrategy: PID 27890 died... 23:06:48.264057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27890): Terminated: ok {rc=0} 23:06:48.308593 --- ParallelTerminationStrategy: PID 27893 died... 23:06:48.327275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27893): Terminated: ok {rc=0} 23:06:48.411565 bus /sierra_3: Setting Powered False 23:06:49.510567 bus /sierra_3: Setting Powered False 23:06:50.630438 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:06:51.906651 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:51.912367 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:06:51.974434 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:06:52.001957 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:06:52.057853 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:06:52.119799 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:06:52.147743 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:06:52.698616 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:06:52.704462 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:52.716241 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:06:52.768486 tst handover.py: using LAC 24310 23:06:52.894459 tst handover.py: using RAC 85 23:06:53.019655 tst handover.py: using CellId 24310 23:06:53.138862 tst handover.py: using BVCI 24311 23:06:53.249924 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:06:53.297396 tst handover.py: using LAC 24311 23:06:53.416866 tst handover.py: using RAC 86 23:06:53.534837 tst handover.py: using CellId 24311 23:06:53.656868 tst handover.py: using BVCI 24312 23:06:53.768457 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:53.779542 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:53.790424 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:53.801368 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:53.812232 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:53.823002 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:06:53.942260 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:06:54.059389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:54.532652 run create_hlr_db(pid=27899): Launched 23:06:54.657490 bus /sierra_2: Setting Powered False 23:06:55.721962 run create_hlr_db(pid=27899): Terminated: ok {rc=0} 23:06:56.145375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27901): Launched 23:06:56.470071 run osmo-hlr_10.42.42.2(pid=27902): Launched 23:06:56.594086 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:57.129517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27904): Launched 23:06:57.456778 run osmo-stp_10.42.42.5(pid=27905): Launched 23:06:57.582653 run osmo-msc_10.42.42.6: Starting osmo-msc 23:06:58.142175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27907): Launched 23:06:58.466121 run osmo-msc_10.42.42.6(pid=27908): Launched 23:06:58.647503 run osmo-stp_10.42.42.5(pid=27905): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27905)] 23:06:58.785215 run osmo-stp_10.42.42.5(pid=27905): stdout: | (launched: 2022-12-09_23:06:57.397819) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:58.922384 run osmo-stp_10.42.42.5(pid=27905): stderr: | 20221209230657591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230657591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230657591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230657592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230657592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230657592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230657592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:59.059379 run osmo-stp_10.42.42.5(pid=27905): stdout: | (launched: 2022-12-09_23:06:57.397819) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:59.188474 run osmo-stp_10.42.42.5(pid=27905): stderr: | 20221209230657591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230657591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230657591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230657592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230657592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230657592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230657592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:59.343422 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27905): Process ended prematurely: osmo-stp_10.42.42.5(pid=27905) [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27905)] [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 23:06:59.352361 tst handover.py:18: Test FAILED (6.6 sec) 23:06:59.380718 run osmo-hlr_10.42.42.2(pid=27902): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27902)] 23:06:59.431865 run osmo-hlr_10.42.42.2(pid=27902): stdout: | (launched: 2022-12-09_23:06:56.411075) 23:06:59.484658 run osmo-hlr_10.42.42.2(pid=27902): stderr: | 20221209230656610 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230656610 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230656610 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230656610 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230656610 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230656610 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230656623 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230656631 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230656631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230656631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:59.557886 run osmo-msc_10.42.42.6(pid=27908): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27908)] 23:06:59.608666 run osmo-msc_10.42.42.6(pid=27908): stdout: | (launched: 2022-12-09_23:06:58.407694) 23:06:59.661111 run osmo-msc_10.42.42.6(pid=27908): stderr: | 20221209230658729 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230658729 DLGLOBAL DEBUG validating counter group 0x7f9b38475c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230658729 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230658729 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230658729 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230658729 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230658731 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230658731 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230658732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230658732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:59.713948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27901): Terminating (SIGTERM) 23:06:59.756729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27904): Terminating (SIGTERM) 23:06:59.799332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27907): Terminating (SIGTERM) 23:06:59.842091 --- ParallelTerminationStrategy: PID 27901 died... 23:06:59.862301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27901): Terminated: ok {rc=0} 23:06:59.909618 --- ParallelTerminationStrategy: PID 27904 died... 23:06:59.929410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27904): Terminated: ok {rc=0} 23:06:59.976258 --- ParallelTerminationStrategy: PID 27907 died... 23:06:59.995838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27907): Terminated: ok {rc=0} 23:07:00.083873 bus /sierra_3: Setting Powered False 23:07:01.194935 bus /sierra_3: Setting Powered False 23:07:02.330019 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 23:07:03.598248 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:03.603360 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:07:03.649363 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:07:03.675943 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:07:03.727441 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:07:03.772891 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:07:03.799081 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:07:04.351369 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 23:07:04.356390 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:04.367325 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 23:07:04.410519 tst handover.py: using LAC 24312 23:07:04.528658 tst handover.py: using RAC 87 23:07:04.648884 tst handover.py: using CellId 24312 23:07:04.768134 tst handover.py: using BVCI 24313 23:07:04.879992 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 23:07:04.915146 tst handover.py: using LAC 24313 23:07:05.035196 tst handover.py: using RAC 88 23:07:05.156330 tst handover.py: using CellId 24313 23:07:05.277729 tst handover.py: using BVCI 24314 23:07:05.388239 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:05.399110 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:05.409948 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:05.420792 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:05.431723 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:05.442572 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 23:07:05.556512 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 23:07:05.676059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:06.148710 run create_hlr_db(pid=27913): Launched 23:07:06.273533 bus /sierra_2: Setting Powered False 23:07:07.338014 run create_hlr_db(pid=27913): Terminated: ok {rc=0} 23:07:07.746104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27915): Launched 23:07:08.048890 run osmo-hlr_10.42.42.2(pid=27916): Launched 23:07:08.165444 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:08.674242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27918): Launched 23:07:08.976680 run osmo-stp_10.42.42.5(pid=27919): Launched 23:07:09.092542 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:09.612195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27921): Launched 23:07:09.914833 run osmo-msc_10.42.42.6(pid=27922): Launched 23:07:10.083980 run osmo-stp_10.42.42.5(pid=27919): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27919)] 23:07:10.211589 run osmo-stp_10.42.42.5(pid=27919): stdout: | (launched: 2022-12-09_23:07:08.921739) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:10.338965 run osmo-stp_10.42.42.5(pid=27919): stderr: | 20221209230709090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230709090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230709091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230709091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230709092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230709092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230709092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:10.465169 run osmo-stp_10.42.42.5(pid=27919): stdout: | (launched: 2022-12-09_23:07:08.921739) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:10.585542 run osmo-stp_10.42.42.5(pid=27919): stderr: | 20221209230709090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230709090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230709091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230709091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230709092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230709092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230709092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:10.729295 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27919): Process ended prematurely: osmo-stp_10.42.42.5(pid=27919) [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27919)] [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 23:07:10.737588 tst handover.py:18: Test FAILED (6.4 sec) 23:07:10.764089 run osmo-hlr_10.42.42.2(pid=27916): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27916)] 23:07:10.811493 run osmo-hlr_10.42.42.2(pid=27916): stdout: | (launched: 2022-12-09_23:07:07.993237) 23:07:10.860478 run osmo-hlr_10.42.42.2(pid=27916): stderr: | 20221209230708166 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230708166 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230708166 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230708166 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230708167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230708167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230708179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230708187 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230708187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230708187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:10.928626 run osmo-msc_10.42.42.6(pid=27922): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27922)] 23:07:10.975519 run osmo-msc_10.42.42.6(pid=27922): stdout: | (launched: 2022-12-09_23:07:09.859913) 23:07:11.024136 run osmo-msc_10.42.42.6(pid=27922): stderr: | 20221209230710130 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230710130 DLGLOBAL DEBUG validating counter group 0x7fabdb0f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230710130 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230710130 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230710130 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230710131 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230710132 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230710133 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230710133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230710133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:11.072880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27915): Terminating (SIGTERM) 23:07:11.111826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27918): Terminating (SIGTERM) 23:07:11.151013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27921): Terminating (SIGTERM) 23:07:11.190298 --- ParallelTerminationStrategy: PID 27915 died... 23:07:11.209346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27915): Terminated: ok {rc=0} 23:07:11.253416 --- ParallelTerminationStrategy: PID 27918 died... 23:07:11.271952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27918): Terminated: ok {rc=0} 23:07:11.315707 --- ParallelTerminationStrategy: PID 27921 died... 23:07:11.334269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27921): Terminated: ok {rc=0} 23:07:11.420075 bus /sierra_3: Setting Powered False 23:07:12.520073 bus /sierra_3: Setting Powered False 23:07:13.636069 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 23:07:14.886006 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:14.891083 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:07:14.949274 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:07:14.975539 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:07:15.028302 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:07:15.087718 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:07:15.114124 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:07:15.668774 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 23:07:15.674678 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:15.686318 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:07:15.733785 tst handover.py: using LAC 24314 23:07:15.882276 tst handover.py: using RAC 89 23:07:16.023515 tst handover.py: using CellId 24314 23:07:16.144912 tst handover.py: using BVCI 24315 23:07:16.300892 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:07:16.349946 tst handover.py: using LAC 24315 23:07:16.472812 tst handover.py: using RAC 90 23:07:16.631144 tst handover.py: using CellId 24315 23:07:16.776677 tst handover.py: using BVCI 24316 23:07:16.931436 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:16.947782 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:16.965386 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:16.982949 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:17.000754 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:17.018188 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:07:17.148648 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:07:17.264912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:17.713313 run create_hlr_db(pid=27927): Launched 23:07:17.837243 bus /sierra_2: Setting Powered False 23:07:18.897969 run create_hlr_db(pid=27927): Terminated: ok {rc=0} 23:07:19.312518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27929): Launched 23:07:19.636589 run osmo-hlr_10.42.42.2(pid=27930): Launched 23:07:19.762288 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:20.291273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27932): Launched 23:07:20.614715 run osmo-stp_10.42.42.5(pid=27933): Launched 23:07:20.738975 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:21.298461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27935): Launched 23:07:21.623239 run osmo-msc_10.42.42.6(pid=27936): Launched 23:07:21.805370 run osmo-stp_10.42.42.5(pid=27933): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27933)] 23:07:21.943630 run osmo-stp_10.42.42.5(pid=27933): stdout: | (launched: 2022-12-09_23:07:20.556288) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:22.081349 run osmo-stp_10.42.42.5(pid=27933): stderr: | 20221209230720748 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230720748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230720748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230720749 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230720749 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230720749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230720749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:22.217879 run osmo-stp_10.42.42.5(pid=27933): stdout: | (launched: 2022-12-09_23:07:20.556288) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:22.347199 run osmo-stp_10.42.42.5(pid=27933): stderr: | 20221209230720748 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230720748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230720748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230720749 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230720749 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230720749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230720749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:22.501345 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27933): Process ended prematurely: osmo-stp_10.42.42.5(pid=27933) [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27933)] [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 23:07:22.510468 tst handover.py:18: Test FAILED (6.8 sec) 23:07:22.538820 run osmo-hlr_10.42.42.2(pid=27930): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27930)] 23:07:22.589478 run osmo-hlr_10.42.42.2(pid=27930): stdout: | (launched: 2022-12-09_23:07:19.578013) 23:07:22.641639 run osmo-hlr_10.42.42.2(pid=27930): stderr: | 20221209230719775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230719775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230719775 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230719775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230719776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230719776 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230719787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230719796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230719796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230719796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:22.714349 run osmo-msc_10.42.42.6(pid=27936): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27936)] 23:07:22.765174 run osmo-msc_10.42.42.6(pid=27936): stdout: | (launched: 2022-12-09_23:07:21.564470) 23:07:22.817277 run osmo-msc_10.42.42.6(pid=27936): stderr: | 20221209230721886 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230721886 DLGLOBAL DEBUG validating counter group 0x7f4a166b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230721886 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230721886 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230721886 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230721886 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230721888 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230721888 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230721889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230721889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:22.869267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27929): Terminating (SIGTERM) 23:07:22.911101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27932): Terminating (SIGTERM) 23:07:22.953220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27935): Terminating (SIGTERM) 23:07:22.995717 --- ParallelTerminationStrategy: PID 27929 died... 23:07:23.015822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27929): Terminated: ok {rc=0} 23:07:23.062942 --- ParallelTerminationStrategy: PID 27932 died... 23:07:23.082675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27932): Terminated: ok {rc=0} 23:07:23.129562 --- ParallelTerminationStrategy: PID 27935 died... 23:07:23.149278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27935): Terminated: ok {rc=0} 23:07:23.237348 bus /sierra_3: Setting Powered False 23:07:24.336118 bus /sierra_3: Setting Powered False 23:07:25.453413 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 23:07:26.724482 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:26.729591 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:07:26.786880 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:07:26.813110 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:07:26.867175 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:07:26.927699 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:07:26.955205 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:07:27.499801 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 23:07:27.505332 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:27.516355 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:07:27.560860 tst handover.py: using LAC 24316 23:07:27.680553 tst handover.py: using RAC 91 23:07:27.805780 tst handover.py: using CellId 24316 23:07:27.924441 tst handover.py: using BVCI 24317 23:07:28.035034 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:07:28.080624 tst handover.py: using LAC 24317 23:07:28.198356 tst handover.py: using RAC 92 23:07:28.315217 tst handover.py: using CellId 24317 23:07:28.432882 tst handover.py: using BVCI 24318 23:07:28.541988 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:28.553223 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:28.564127 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:28.575198 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:28.586328 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:28.597355 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:07:28.718586 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:07:28.839547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:29.313989 run create_hlr_db(pid=27942): Launched 23:07:29.439046 bus /sierra_2: Setting Powered False 23:07:30.502958 run create_hlr_db(pid=27942): Terminated: ok {rc=0} 23:07:30.949857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27944): Launched 23:07:31.291148 run osmo-hlr_10.42.42.2(pid=27945): Launched 23:07:31.583418 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:32.148330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27947): Launched 23:07:32.466865 run osmo-stp_10.42.42.5(pid=27948): Launched 23:07:32.584271 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:33.105341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27950): Launched 23:07:33.409316 run osmo-msc_10.42.42.6(pid=27951): Launched 23:07:33.580084 run osmo-stp_10.42.42.5(pid=27948): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27948)] 23:07:33.708374 run osmo-stp_10.42.42.5(pid=27948): stdout: | (launched: 2022-12-09_23:07:32.411435) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:33.837924 run osmo-stp_10.42.42.5(pid=27948): stderr: | 20221209230732581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230732581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230732581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230732582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230732582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230732582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230732582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:33.964506 run osmo-stp_10.42.42.5(pid=27948): stdout: | (launched: 2022-12-09_23:07:32.411435) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:34.085476 run osmo-stp_10.42.42.5(pid=27948): stderr: | 20221209230732581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230732581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230732581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230732582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230732582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230732582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230732582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:34.229854 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27948): Process ended prematurely: osmo-stp_10.42.42.5(pid=27948) [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27948)] [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 23:07:34.237958 tst handover.py:18: Test FAILED (6.7 sec) 23:07:34.264228 run osmo-hlr_10.42.42.2(pid=27945): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27945)] 23:07:34.312016 run osmo-hlr_10.42.42.2(pid=27945): stdout: | (launched: 2022-12-09_23:07:31.219830) 23:07:34.361427 run osmo-hlr_10.42.42.2(pid=27945): stderr: | 20221209230731450 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230731450 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230731450 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230731450 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230731450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230731450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230731470 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230731478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230731478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230731478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:34.430255 run osmo-msc_10.42.42.6(pid=27951): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27951)] 23:07:34.477657 run osmo-msc_10.42.42.6(pid=27951): stdout: | (launched: 2022-12-09_23:07:33.354208) 23:07:34.526925 run osmo-msc_10.42.42.6(pid=27951): stderr: | 20221209230733626 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230733626 DLGLOBAL DEBUG validating counter group 0x7f1526312c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230733626 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230733626 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230733627 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230733627 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230733628 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230733629 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230733629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230733629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:34.576539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27944): Terminating (SIGTERM) 23:07:34.615764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27947): Terminating (SIGTERM) 23:07:34.654995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27950): Terminating (SIGTERM) 23:07:34.695322 --- ParallelTerminationStrategy: PID 27944 died... 23:07:34.714258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27944): Terminated: ok {rc=0} 23:07:34.758170 --- ParallelTerminationStrategy: PID 27947 died... 23:07:34.776582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27947): Terminated: ok {rc=0} 23:07:34.820496 --- ParallelTerminationStrategy: PID 27950 died... 23:07:34.839077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27950): Terminated: ok {rc=0} 23:07:34.924075 bus /sierra_3: Setting Powered False 23:07:36.023564 bus /sierra_3: Setting Powered False 23:07:37.138438 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 23:07:38.404782 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:38.410626 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:07:38.463844 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:07:38.491303 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:07:38.544514 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:07:38.597555 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:07:38.624787 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:07:39.176576 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 23:07:39.182309 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:39.193843 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 23:07:39.242694 tst handover.py: using LAC 24318 23:07:39.370911 tst handover.py: using RAC 93 23:07:39.501439 tst handover.py: using CellId 24318 23:07:39.620043 tst handover.py: using BVCI 24319 23:07:39.732603 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 23:07:39.766676 tst handover.py: using LAC 24319 23:07:39.884477 tst handover.py: using RAC 94 23:07:40.003068 tst handover.py: using CellId 24319 23:07:40.121633 tst handover.py: using BVCI 24320 23:07:40.232724 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:40.243758 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:40.254856 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:40.266258 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:40.277870 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:40.289324 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 23:07:40.404536 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 23:07:40.522595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:40.966848 run create_hlr_db(pid=27956): Launched 23:07:41.090611 bus /sierra_2: Setting Powered False 23:07:42.151832 run create_hlr_db(pid=27956): Terminated: ok {rc=0} 23:07:42.565972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27958): Launched 23:07:42.892128 run osmo-hlr_10.42.42.2(pid=27959): Launched 23:07:43.017471 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:43.551081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27961): Launched 23:07:43.876174 run osmo-stp_10.42.42.5(pid=27962): Launched 23:07:44.001151 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:44.558502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27964): Launched 23:07:44.861671 run osmo-msc_10.42.42.6(pid=27965): Launched 23:07:45.033854 run osmo-stp_10.42.42.5(pid=27962): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27962)] 23:07:45.163616 run osmo-stp_10.42.42.5(pid=27962): stdout: | (launched: 2022-12-09_23:07:43.817707) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:45.293215 run osmo-stp_10.42.42.5(pid=27962): stderr: | 20221209230744010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230744010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230744010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230744011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230744011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230744011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230744011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:45.420688 run osmo-stp_10.42.42.5(pid=27962): stdout: | (launched: 2022-12-09_23:07:43.817707) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:45.542054 run osmo-stp_10.42.42.5(pid=27962): stderr: | 20221209230744010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230744010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230744010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230744011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230744011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230744011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230744011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:45.687668 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27962): Process ended prematurely: osmo-stp_10.42.42.5(pid=27962) [trial-2365↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27962)] [trial-2365↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 23:07:45.695955 tst handover.py:18: Test FAILED (6.5 sec) 23:07:45.722032 run osmo-hlr_10.42.42.2(pid=27959): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27959)] 23:07:45.769720 run osmo-hlr_10.42.42.2(pid=27959): stdout: | (launched: 2022-12-09_23:07:42.833653) 23:07:45.819074 run osmo-hlr_10.42.42.2(pid=27959): stderr: | 20221209230743031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230743031 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230743031 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230743031 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230743031 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230743031 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230743043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230743052 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230743052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230743052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:45.896354 run osmo-msc_10.42.42.6(pid=27965): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27965)] 23:07:45.973733 run osmo-msc_10.42.42.6(pid=27965): stdout: | (launched: 2022-12-09_23:07:44.806367) 23:07:46.028243 run osmo-msc_10.42.42.6(pid=27965): stderr: | 20221209230745078 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230745078 DLGLOBAL DEBUG validating counter group 0x7fbb4fea3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230745078 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230745078 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230745078 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230745078 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230745080 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230745081 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230745081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230745081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:46.115762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27958): Terminating (SIGTERM) 23:07:46.160712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27961): Terminating (SIGTERM) 23:07:46.207255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27964): Terminating (SIGTERM) 23:07:46.253610 --- ParallelTerminationStrategy: PID 27958 died... 23:07:46.274561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27958): Terminated: ok {rc=0} 23:07:46.326056 --- ParallelTerminationStrategy: PID 27961 died... 23:07:46.347451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27961): Terminated: ok {rc=0} 23:07:46.397464 --- ParallelTerminationStrategy: PID 27964 died... 23:07:46.418344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27964): Terminated: ok {rc=0} 23:07:46.511223 bus /sierra_3: Setting Powered False 23:07:47.613857 bus /sierra_3: Setting Powered False 23:07:48.729927 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 23:07:49.988741 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:49.994651 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:07:50.060032 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:07:50.087633 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:07:50.140927 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:07:50.208767 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:07:50.236195 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:07:50.786769 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 23:07:50.792480 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:50.803866 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:07:50.853364 tst handover.py: using LAC 24320 23:07:50.983020 tst handover.py: using RAC 95 23:07:51.109375 tst handover.py: using CellId 24320 23:07:51.237328 tst handover.py: using BVCI 24321 23:07:51.355571 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:07:51.403306 tst handover.py: using LAC 24321 23:07:51.528033 tst handover.py: using RAC 96 23:07:51.653211 tst handover.py: using CellId 24321 23:07:51.780220 tst handover.py: using BVCI 24322 23:07:51.897980 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:51.909538 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:51.920746 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:51.932410 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:51.943996 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:51.956136 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:07:52.072692 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:07:52.192121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:52.666344 run create_hlr_db(pid=27970): Launched 23:07:52.790125 bus /sierra_2: Setting Powered False 23:07:53.855604 run create_hlr_db(pid=27970): Terminated: ok {rc=0} 23:07:54.266177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27972): Launched 23:07:54.569056 run osmo-hlr_10.42.42.2(pid=27973): Launched 23:07:54.686360 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:55.198547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27975): Launched 23:07:55.502227 run osmo-stp_10.42.42.5(pid=27976): Launched 23:07:55.618533 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:56.140769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27978): Launched 23:07:56.445552 run osmo-msc_10.42.42.6(pid=27979): Launched 23:07:56.617983 run osmo-stp_10.42.42.5(pid=27976): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27976)] 23:07:56.747981 run osmo-stp_10.42.42.5(pid=27976): stdout: | (launched: 2022-12-09_23:07:55.446956) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:56.881576 run osmo-stp_10.42.42.5(pid=27976): stderr: | 20221209230755616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230755616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230755617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230755617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230755618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230755618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230755618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:57.018367 run osmo-stp_10.42.42.5(pid=27976): stdout: | (launched: 2022-12-09_23:07:55.446956) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:57.148353 run osmo-stp_10.42.42.5(pid=27976): stderr: | 20221209230755616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230755616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230755617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230755617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230755618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230755618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230755618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:57.304094 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27976): Process ended prematurely: osmo-stp_10.42.42.5(pid=27976) [trial-2365↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27976)] [trial-2365↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 23:07:57.313401 tst handover.py:18: Test FAILED (6.5 sec) 23:07:57.343142 run osmo-hlr_10.42.42.2(pid=27973): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27973)] 23:07:57.394783 run osmo-hlr_10.42.42.2(pid=27973): stdout: | (launched: 2022-12-09_23:07:54.513787) 23:07:57.448085 run osmo-hlr_10.42.42.2(pid=27973): stderr: | 20221209230754690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230754690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230754690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230754690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230754690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230754690 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230754703 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230754711 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230754712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230754712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:57.521915 run osmo-msc_10.42.42.6(pid=27979): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27979)] 23:07:57.573445 run osmo-msc_10.42.42.6(pid=27979): stdout: | (launched: 2022-12-09_23:07:56.389250) 23:07:57.626537 run osmo-msc_10.42.42.6(pid=27979): stderr: | 20221209230756660 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230756660 DLGLOBAL DEBUG validating counter group 0x7f8811cb3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230756660 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230756660 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230756660 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230756660 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230756662 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230756663 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230756663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230756663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:57.680101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27972): Terminating (SIGTERM) 23:07:57.723039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27975): Terminating (SIGTERM) 23:07:57.766413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27978): Terminating (SIGTERM) 23:07:57.809923 --- ParallelTerminationStrategy: PID 27972 died... 23:07:57.830325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27972): Terminated: ok {rc=0} 23:07:57.878582 --- ParallelTerminationStrategy: PID 27975 died... 23:07:57.898558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27975): Terminated: ok {rc=0} 23:07:57.946417 --- ParallelTerminationStrategy: PID 27978 died... 23:07:57.966187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27978): Terminated: ok {rc=0} 23:07:58.056592 bus /sierra_3: Setting Powered False 23:07:59.155452 bus /sierra_3: Setting Powered False 23:08:00.273939 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 23:08:01.570055 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:08:01.577560 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:08:01.641680 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:08:01.668856 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:08:01.722088 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:08:01.787656 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:08:01.814744 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:08:02.392704 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 23:08:02.399697 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:02.412115 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:02.466994 tst handover.py: using LAC 24322 23:08:02.597743 tst handover.py: using RAC 97 23:08:02.728529 tst handover.py: using CellId 24322 23:08:02.860359 tst handover.py: using BVCI 24323 23:08:02.981261 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:03.031173 tst handover.py: using LAC 24323 23:08:03.161253 tst handover.py: using RAC 98 23:08:03.291344 tst handover.py: using CellId 24323 23:08:03.421039 tst handover.py: using BVCI 24324 23:08:03.543276 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:03.555857 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:03.568157 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:03.581749 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:03.594713 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:03.608752 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:03.733518 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:03.856531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:04.353117 run create_hlr_db(pid=27995): Launched 23:08:04.518407 bus /sierra_2: Setting Powered False 23:08:05.583766 run create_hlr_db(pid=27995): Terminated: ok {rc=0} 23:08:06.033735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27999): Launched 23:08:06.359082 run osmo-hlr_10.42.42.2(pid=28000): Launched 23:08:06.600549 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:07.301748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28002): Launched 23:08:07.629718 run osmo-stp_10.42.42.5(pid=28003): Launched 23:08:07.892844 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:08.597377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28005): Launched 23:08:08.927206 run osmo-msc_10.42.42.6(pid=28006): Launched 23:08:09.272298 run osmo-stp_10.42.42.5(pid=28003): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28003)] 23:08:09.548799 run osmo-stp_10.42.42.5(pid=28003): stdout: | (launched: 2022-12-09_23:08:07.560181) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:09.828061 run osmo-stp_10.42.42.5(pid=28003): stderr: | 20221209230807941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230807941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230807942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230807942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230807944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230807944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230807944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:10.002343 run osmo-stp_10.42.42.5(pid=28003): stdout: | (launched: 2022-12-09_23:08:07.560181) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:10.128656 run osmo-stp_10.42.42.5(pid=28003): stderr: | 20221209230807941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230807941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230807942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230807942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230807944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230807944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230807944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:10.278657 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28003): Process ended prematurely: osmo-stp_10.42.42.5(pid=28003) [trial-2365↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28003)] [trial-2365↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 23:08:10.288127 tst handover.py:18: Test FAILED (7.9 sec) 23:08:10.316074 run osmo-hlr_10.42.42.2(pid=28000): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28000)] 23:08:10.366364 run osmo-hlr_10.42.42.2(pid=28000): stdout: | (launched: 2022-12-09_23:08:06.297303) 23:08:10.418252 run osmo-hlr_10.42.42.2(pid=28000): stderr: | 20221209230806639 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230806639 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230806639 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230806639 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230806639 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230806639 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230806659 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230806668 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230806668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230806668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:10.490372 run osmo-msc_10.42.42.6(pid=28006): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28006)] 23:08:10.540365 run osmo-msc_10.42.42.6(pid=28006): stdout: | (launched: 2022-12-09_23:08:08.864689) 23:08:10.591760 run osmo-msc_10.42.42.6(pid=28006): stderr: | 20221209230809462 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230809462 DLGLOBAL DEBUG validating counter group 0x7f37d5779c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230809462 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230809462 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230809462 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230809463 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230809464 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230809473 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230809473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230809473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:10.643433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27999): Terminating (SIGTERM) 23:08:10.685144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28002): Terminating (SIGTERM) 23:08:10.736558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28005): Terminating (SIGTERM) 23:08:10.791748 --- ParallelTerminationStrategy: PID 27999 died... 23:08:10.818017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27999): Terminated: ok {rc=0} 23:08:10.878026 --- ParallelTerminationStrategy: PID 28002 died... 23:08:10.901225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28002): Terminated: ok {rc=0} 23:08:10.955674 --- ParallelTerminationStrategy: PID 28005 died... 23:08:10.975401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28005): Terminated: ok {rc=0} 23:08:11.078152 bus /sierra_3: Setting Powered False 23:08:12.207987 bus /sierra_3: Setting Powered False 23:08:13.339391 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 23:08:14.617560 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:08:14.623556 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:08:14.675209 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:08:14.702790 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:08:14.754388 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:08:14.805742 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:08:14.833373 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:08:15.386849 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 23:08:15.393803 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:15.405855 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:08:15.440656 tst handover.py: using LAC 24324 23:08:15.570250 tst handover.py: using RAC 99 23:08:15.693210 tst handover.py: using CellId 24324 23:08:15.814272 tst handover.py: using BVCI 24325 23:08:15.929965 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:08:15.976908 tst handover.py: using LAC 24325 23:08:16.104801 tst handover.py: using RAC 100 23:08:16.244938 tst handover.py: using CellId 24325 23:08:16.406168 tst handover.py: using BVCI 24326 23:08:16.521986 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:16.533460 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:16.544645 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:16.556337 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:16.567834 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:16.579340 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:08:16.715007 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:08:16.854194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:17.412085 run create_hlr_db(pid=28270): Launched 23:08:17.606662 bus /sierra_2: Setting Powered False 23:08:18.673309 run create_hlr_db(pid=28270): Terminated: ok {rc=0} 23:08:19.125745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28272): Launched 23:08:19.474982 run osmo-hlr_10.42.42.2(pid=28273): Launched 23:08:19.730761 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:20.377958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28275): Launched 23:08:20.737724 run osmo-stp_10.42.42.5(pid=28276): Launched 23:08:20.983015 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:21.642531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28278): Launched 23:08:21.994896 run osmo-msc_10.42.42.6(pid=28279): Launched 23:08:22.366065 run osmo-stp_10.42.42.5(pid=28276): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28276)] 23:08:22.655185 run osmo-stp_10.42.42.5(pid=28276): stdout: | (launched: 2022-12-09_23:08:20.664676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:22.822104 run osmo-stp_10.42.42.5(pid=28276): stderr: | 20221209230820965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230820965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230820965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230820965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230820966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230820966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230820966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:22.963503 run osmo-stp_10.42.42.5(pid=28276): stdout: | (launched: 2022-12-09_23:08:20.664676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:23.098163 run osmo-stp_10.42.42.5(pid=28276): stderr: | 20221209230820965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230820965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230820965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230820965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230820966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230820966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230820966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:23.258001 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28276): Process ended prematurely: osmo-stp_10.42.42.5(pid=28276) [trial-2365↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28276)] [trial-2365↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 23:08:23.269127 tst handover.py:18: Test FAILED (7.9 sec) 23:08:23.300805 run osmo-hlr_10.42.42.2(pid=28273): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28273)] 23:08:23.354006 run osmo-hlr_10.42.42.2(pid=28273): stdout: | (launched: 2022-12-09_23:08:19.407177) 23:08:23.409172 run osmo-hlr_10.42.42.2(pid=28273): stderr: | 20221209230819716 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230819725 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230819725 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230819725 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230819725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230819725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230819745 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230819762 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230819762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230819762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:23.485957 run osmo-msc_10.42.42.6(pid=28279): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28279)] 23:08:23.538938 run osmo-msc_10.42.42.6(pid=28279): stdout: | (launched: 2022-12-09_23:08:21.928694) 23:08:23.594015 run osmo-msc_10.42.42.6(pid=28279): stderr: | 20221209230822437 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230822438 DLGLOBAL DEBUG validating counter group 0x7f2280f4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230822438 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230822438 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230822438 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230822438 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230822440 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230822440 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230822447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230822447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:23.649802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28272): Terminating (SIGTERM) 23:08:23.695926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28275): Terminating (SIGTERM) 23:08:23.742728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28278): Terminating (SIGTERM) 23:08:23.790177 --- ParallelTerminationStrategy: PID 28272 died... 23:08:23.811273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28272): Terminated: ok {rc=0} 23:08:23.863968 --- ParallelTerminationStrategy: PID 28275 died... 23:08:23.885074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28275): Terminated: ok {rc=0} 23:08:23.935716 --- ParallelTerminationStrategy: PID 28278 died... 23:08:23.956800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28278): Terminated: ok {rc=0} 23:08:24.049893 bus /sierra_3: Setting Powered False 23:08:25.152009 bus /sierra_3: Setting Powered False 23:08:26.270638 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 23:08:27.532500 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:08:27.538237 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:08:27.590776 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:08:27.618208 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:08:27.672763 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:08:27.722221 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:08:27.748316 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:08:28.302289 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 23:08:28.307962 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:28.319318 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:28.354923 tst handover.py: using LAC 24326 23:08:28.482915 tst handover.py: using RAC 101 23:08:28.614754 tst handover.py: using CellId 24326 23:08:28.740772 tst handover.py: using BVCI 24327 23:08:28.858423 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:28.908243 tst handover.py: using LAC 24327 23:08:29.035173 tst handover.py: using RAC 102 23:08:29.159723 tst handover.py: using CellId 24327 23:08:29.286493 tst handover.py: using BVCI 24328 23:08:29.403771 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:29.414970 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:29.425934 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:29.437095 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:29.448379 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:29.459677 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:29.580842 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:29.697076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:30.142391 run create_hlr_db(pid=28286): Launched 23:08:30.267801 bus /sierra_2: Setting Powered False 23:08:31.328150 run create_hlr_db(pid=28286): Terminated: ok {rc=0} 23:08:31.753757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28288): Launched 23:08:32.124852 run osmo-hlr_10.42.42.2(pid=28289): Launched 23:08:32.308504 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:32.806942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28291): Launched 23:08:33.110131 run osmo-stp_10.42.42.5(pid=28292): Launched 23:08:33.225220 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:33.745530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28294): Launched 23:08:34.051121 run osmo-msc_10.42.42.6(pid=28295): Launched 23:08:34.220645 run osmo-stp_10.42.42.5(pid=28292): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28292)] 23:08:34.351070 run osmo-stp_10.42.42.5(pid=28292): stdout: | (launched: 2022-12-09_23:08:33.054965) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:34.479312 run osmo-stp_10.42.42.5(pid=28292): stderr: | 20221209230833225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230833225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230833225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230833226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230833226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230833226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230833226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:34.605221 run osmo-stp_10.42.42.5(pid=28292): stdout: | (launched: 2022-12-09_23:08:33.054965) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:34.725348 run osmo-stp_10.42.42.5(pid=28292): stderr: | 20221209230833225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230833225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230833225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230833226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230833226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230833226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230833226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:34.869610 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28292): Process ended prematurely: osmo-stp_10.42.42.5(pid=28292) [trial-2365↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28292)] [trial-2365↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 23:08:34.878153 tst handover.py:18: Test FAILED (6.6 sec) 23:08:34.904187 run osmo-hlr_10.42.42.2(pid=28289): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28289)] 23:08:34.952143 run osmo-hlr_10.42.42.2(pid=28289): stdout: | (launched: 2022-12-09_23:08:32.057690) 23:08:35.001657 run osmo-hlr_10.42.42.2(pid=28289): stderr: | 20221209230832279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230832279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230832279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230832279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230832279 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230832279 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230832319 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230832328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230832328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230832328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:35.071004 run osmo-msc_10.42.42.6(pid=28295): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28295)] 23:08:35.118768 run osmo-msc_10.42.42.6(pid=28295): stdout: | (launched: 2022-12-09_23:08:33.995556) 23:08:35.168005 run osmo-msc_10.42.42.6(pid=28295): stderr: | 20221209230834267 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230834267 DLGLOBAL DEBUG validating counter group 0x7f5e15640c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230834267 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230834267 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230834267 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230834267 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230834269 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230834271 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230834272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230834272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:35.217611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28288): Terminating (SIGTERM) 23:08:35.257260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28291): Terminating (SIGTERM) 23:08:35.296851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28294): Terminating (SIGTERM) 23:08:35.336765 --- ParallelTerminationStrategy: PID 28288 died... 23:08:35.356077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28288): Terminated: ok {rc=0} 23:08:35.400182 --- ParallelTerminationStrategy: PID 28291 died... 23:08:35.418861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28291): Terminated: ok {rc=0} 23:08:35.462812 --- ParallelTerminationStrategy: PID 28294 died... 23:08:35.481511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28294): Terminated: ok {rc=0} 23:08:35.567730 bus /sierra_3: Setting Powered False 23:08:36.667909 bus /sierra_3: Setting Powered False 23:08:37.784245 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2365 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 23:08:39.044428 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:08:39.050190 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:08:39.113770 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:08:39.141613 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:08:39.194878 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:08:39.259051 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:08:39.286526 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:08:39.837868 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2365 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 23:08:39.843383 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:39.854602 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:39.904143 tst handover.py: using LAC 24328 23:08:40.025259 tst handover.py: using RAC 103 23:08:40.148667 tst handover.py: using CellId 24328 23:08:40.267351 tst handover.py: using BVCI 24329 23:08:40.377396 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:40.423035 tst handover.py: using LAC 24329 23:08:40.539761 tst handover.py: using RAC 104 23:08:40.661166 tst handover.py: using CellId 24329 23:08:40.777917 tst handover.py: using BVCI 24330 23:08:40.887585 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:40.898335 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:40.908937 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:40.919601 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:40.930260 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:40.940772 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:41.059544 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:41.182856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:41.656768 run create_hlr_db(pid=28300): Launched 23:08:41.781796 bus /sierra_2: Setting Powered False 23:08:42.842254 run create_hlr_db(pid=28300): Terminated: ok {rc=0} 23:08:43.241168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28302): Launched 23:08:43.544659 run osmo-hlr_10.42.42.2(pid=28303): Launched 23:08:43.662030 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:44.157676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28305): Launched 23:08:44.461791 run osmo-stp_10.42.42.5(pid=28306): Launched 23:08:44.578269 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:45.117845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28308): Launched 23:08:45.420614 run osmo-msc_10.42.42.6(pid=28309): Launched 23:08:45.590780 run osmo-stp_10.42.42.5(pid=28306): ERR: Terminated: ERROR {rc=1} [trial-2365↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28306)] 23:08:45.719340 run osmo-stp_10.42.42.5(pid=28306): stdout: | (launched: 2022-12-09_23:08:44.406523) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:45.849928 run osmo-stp_10.42.42.5(pid=28306): stderr: | 20221209230844577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230844578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230844578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230844578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230844579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230844579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230844579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:45.980318 run osmo-stp_10.42.42.5(pid=28306): stdout: | (launched: 2022-12-09_23:08:44.406523) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:46.103071 run osmo-stp_10.42.42.5(pid=28306): stderr: | 20221209230844577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209230844578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209230844578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209230844578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209230844579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209230844579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209230844579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:46.249425 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28306): Process ended prematurely: osmo-stp_10.42.42.5(pid=28306) [trial-2365↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28306)] [trial-2365↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 23:08:46.258081 tst handover.py:18: Test FAILED (6.4 sec) 23:08:46.285323 run osmo-hlr_10.42.42.2(pid=28303): ERR: Terminated: ERROR {rc=237} [trial-2365↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28303)] 23:08:46.334232 run osmo-hlr_10.42.42.2(pid=28303): stdout: | (launched: 2022-12-09_23:08:43.489609) 23:08:46.385570 run osmo-hlr_10.42.42.2(pid=28303): stderr: | 20221209230843667 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209230843667 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209230843667 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209230843667 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209230843667 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209230843667 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209230843680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209230843691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209230843691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209230843691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:46.456520 run osmo-msc_10.42.42.6(pid=28309): ERR: Terminated: ERROR {rc=2} [trial-2365↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28309)] 23:08:46.505262 run osmo-msc_10.42.42.6(pid=28309): stdout: | (launched: 2022-12-09_23:08:45.365346) 23:08:46.555590 run osmo-msc_10.42.42.6(pid=28309): stderr: | 20221209230845638 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209230845638 DLGLOBAL DEBUG validating counter group 0x7f86eb40cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209230845638 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209230845638 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209230845638 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209230845638 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209230845641 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209230845642 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209230845642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209230845642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:46.607002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28302): Terminating (SIGTERM) 23:08:46.648368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28305): Terminating (SIGTERM) 23:08:46.692251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28308): Terminating (SIGTERM) 23:08:46.733814 --- ParallelTerminationStrategy: PID 28302 died... 23:08:46.753473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28302): Terminated: ok {rc=0} 23:08:46.802812 --- ParallelTerminationStrategy: PID 28305 died... 23:08:46.823575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28305): Terminated: ok {rc=0} 23:08:46.874667 --- ParallelTerminationStrategy: PID 28308 died... 23:08:46.895373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28308): Terminated: ok {rc=0} 23:08:46.988401 bus /sierra_3: Setting Powered False 23:08:48.088022 bus /sierra_3: Setting Powered False 23:08:49.203869 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2365 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 23:08:50.472019 tst trial-2365: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365/run.2022-12-09_21-44-27/trial-2365.xml -------------------------------------------------------------------------------------------- trial-2365 FAIL -------------------------------------------------------------------------------------------- 23:08:52.398917 tst trial-2365: trial-2365: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.8 sec) Error: osmo-nitb_10.42.42.2(pid=19342): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19342) [trial-2365↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19342)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (13.8 sec) Error: osmo-stp_10.42.42.5(pid=19352): Process ended prematurely: osmo-stp_10.42.42.5(pid=19352) [trial-2365↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19352)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=19362): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19362) [trial-2365↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19362)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=19373): Process ended prematurely: osmo-stp_10.42.42.5(pid=19373) [trial-2365↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19373)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19387): Process ended prematurely: osmo-stp_10.42.42.5(pid=19387) [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19387)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19398): Process ended prematurely: osmo-stp_10.42.42.5(pid=19398) [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19398)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19412): Process ended prematurely: osmo-stp_10.42.42.5(pid=19412) [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19412)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19423): Process ended prematurely: osmo-stp_10.42.42.5(pid=19423) [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19423)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19437): Process ended prematurely: osmo-stp_10.42.42.5(pid=19437) [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19437)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19448): Process ended prematurely: osmo-stp_10.42.42.5(pid=19448) [trial-2365↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19448)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19462): Process ended prematurely: osmo-stp_10.42.42.5(pid=19462) [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19462)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19473): Process ended prematurely: osmo-stp_10.42.42.5(pid=19473) [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19473)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19487): Process ended prematurely: osmo-stp_10.42.42.5(pid=19487) [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19487)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19498): Process ended prematurely: osmo-stp_10.42.42.5(pid=19498) [trial-2365↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19498)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19512): Process ended prematurely: osmo-stp_10.42.42.5(pid=19512) [trial-2365↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19512)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19523): Process ended prematurely: osmo-stp_10.42.42.5(pid=19523) [trial-2365↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19523)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19537): Process ended prematurely: osmo-stp_10.42.42.5(pid=19537) [trial-2365↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19537)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19548): Process ended prematurely: osmo-stp_10.42.42.5(pid=19548) [trial-2365↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19548)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19563): Process ended prematurely: osmo-stp_10.42.42.5(pid=19563) [trial-2365↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19563)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19577): Process ended prematurely: osmo-stp_10.42.42.5(pid=19577) [trial-2365↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19577)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.9 sec) Error: osmo-stp_10.42.42.5(pid=19596): Process ended prematurely: osmo-stp_10.42.42.5(pid=19596) [trial-2365↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19596)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=19608): Process ended prematurely: osmo-stp_10.42.42.5(pid=19608) [trial-2365↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19608)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=19627): Process ended prematurely: osmo-stp_10.42.42.5(pid=19627) [trial-2365↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19627)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19637): Process ended prematurely: osmo-stp_10.42.42.5(pid=19637) [trial-2365↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19637)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19647): Process ended prematurely: osmo-stp_10.42.42.5(pid=19647) [trial-2365↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19647)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=19666): Process ended prematurely: osmo-stp_10.42.42.5(pid=19666) [trial-2365↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19666)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=19678): Process ended prematurely: osmo-stp_10.42.42.5(pid=19678) [trial-2365↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19678)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=19696): Process ended prematurely: osmo-stp_10.42.42.5(pid=19696) [trial-2365↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19696)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19706): Process ended prematurely: osmo-stp_10.42.42.5(pid=19706) [trial-2365↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19706)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19716): Process ended prematurely: osmo-stp_10.42.42.5(pid=19716) [trial-2365↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19716)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=19733): Process ended prematurely: osmo-stp_10.42.42.5(pid=19733) [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19733)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=19751): Process ended prematurely: osmo-stp_10.42.42.5(pid=19751) [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19751)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=19771): Process ended prematurely: osmo-stp_10.42.42.5(pid=19771) [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19771)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=19786): Process ended prematurely: osmo-stp_10.42.42.5(pid=19786) [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19786)] FAIL: ping_idle_ping.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=20056): Process ended prematurely: osmo-stp_10.42.42.5(pid=20056) [trial-2365↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20056)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=20081): Process ended prematurely: osmo-stp_10.42.42.5(pid=20081) [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20081)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=20093): Process ended prematurely: osmo-stp_10.42.42.5(pid=20093) [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20093)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=20111): Process ended prematurely: osmo-stp_10.42.42.5(pid=20111) [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20111)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20121): Process ended prematurely: osmo-stp_10.42.42.5(pid=20121) [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20121)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20131): Process ended prematurely: osmo-stp_10.42.42.5(pid=20131) [trial-2365↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20131)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20144): Process ended prematurely: osmo-stp_10.42.42.5(pid=20144) [trial-2365↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20144)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20160): Process ended prematurely: osmo-stp_10.42.42.5(pid=20160) [trial-2365↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20160)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=20169): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20169) [trial-2365↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20169)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20180): Process ended prematurely: osmo-stp_10.42.42.5(pid=20180) [trial-2365↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20180)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=20190): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20190) [trial-2365↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20190)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20211): Process ended prematurely: osmo-stp_10.42.42.5(pid=20211) [trial-2365↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20211)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20577): Process ended prematurely: osmo-stp_10.42.42.5(pid=20577) [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20577)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=20763): Process ended prematurely: osmo-stp_10.42.42.5(pid=20763) [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20763)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20778): Process ended prematurely: osmo-stp_10.42.42.5(pid=20778) [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20778)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20789): Process ended prematurely: osmo-stp_10.42.42.5(pid=20789) [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20789)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20803): Process ended prematurely: osmo-stp_10.42.42.5(pid=20803) [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20803)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20814): Process ended prematurely: osmo-stp_10.42.42.5(pid=20814) [trial-2365↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20814)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20828): Process ended prematurely: osmo-stp_10.42.42.5(pid=20828) [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20828)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20839): Process ended prematurely: osmo-stp_10.42.42.5(pid=20839) [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20839)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20856): Process ended prematurely: osmo-stp_10.42.42.5(pid=20856) [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20856)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20867): Process ended prematurely: osmo-stp_10.42.42.5(pid=20867) [trial-2365↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20867)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20881): Process ended prematurely: osmo-stp_10.42.42.5(pid=20881) [trial-2365↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20881)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20892): Process ended prematurely: osmo-stp_10.42.42.5(pid=20892) [trial-2365↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20892)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20906): Process ended prematurely: osmo-stp_10.42.42.5(pid=20906) [trial-2365↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20906)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20917): Process ended prematurely: osmo-stp_10.42.42.5(pid=20917) [trial-2365↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20917)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20931): Process ended prematurely: osmo-stp_10.42.42.5(pid=20931) [trial-2365↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20931)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20942): Process ended prematurely: osmo-stp_10.42.42.5(pid=20942) [trial-2365↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20942)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=20960): Process ended prematurely: osmo-stp_10.42.42.5(pid=20960) [trial-2365↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20960)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20972): Process ended prematurely: osmo-stp_10.42.42.5(pid=20972) [trial-2365↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20972)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=20990): Process ended prematurely: osmo-stp_10.42.42.5(pid=20990) [trial-2365↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20990)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21001): Process ended prematurely: osmo-stp_10.42.42.5(pid=21001) [trial-2365↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21001)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21011): Process ended prematurely: osmo-stp_10.42.42.5(pid=21011) [trial-2365↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21011)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21029): Process ended prematurely: osmo-stp_10.42.42.5(pid=21029) [trial-2365↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21029)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21041): Process ended prematurely: osmo-stp_10.42.42.5(pid=21041) [trial-2365↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21041)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=21059): Process ended prematurely: osmo-stp_10.42.42.5(pid=21059) [trial-2365↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21059)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21069): Process ended prematurely: osmo-stp_10.42.42.5(pid=21069) [trial-2365↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21069)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21083): Process ended prematurely: osmo-stp_10.42.42.5(pid=21083) [trial-2365↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21083)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21101): Process ended prematurely: osmo-stp_10.42.42.5(pid=21101) [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21101)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21113): Process ended prematurely: osmo-stp_10.42.42.5(pid=21113) [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21113)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=21131): Process ended prematurely: osmo-stp_10.42.42.5(pid=21131) [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21131)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21141): Process ended prematurely: osmo-stp_10.42.42.5(pid=21141) [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21141)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21151): Process ended prematurely: osmo-stp_10.42.42.5(pid=21151) [trial-2365↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21151)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=21169): Process ended prematurely: osmo-stp_10.42.42.5(pid=21169) [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21169)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=21181): Process ended prematurely: osmo-stp_10.42.42.5(pid=21181) [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21181)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=21199): Process ended prematurely: osmo-stp_10.42.42.5(pid=21199) [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21199)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21210): Process ended prematurely: osmo-stp_10.42.42.5(pid=21210) [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21210)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21220): Process ended prematurely: osmo-stp_10.42.42.5(pid=21220) [trial-2365↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21220)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21233): Process ended prematurely: osmo-stp_10.42.42.5(pid=21233) [trial-2365↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21233)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21246): Process ended prematurely: osmo-stp_10.42.42.5(pid=21246) [trial-2365↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21246)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=21254): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21254) [trial-2365↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21254)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21267): Process ended prematurely: osmo-stp_10.42.42.5(pid=21267) [trial-2365↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21267)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=21276): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21276) [trial-2365↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21276)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21286): Process ended prematurely: osmo-stp_10.42.42.5(pid=21286) [trial-2365↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21286)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21301): Process ended prematurely: osmo-stp_10.42.42.5(pid=21301) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21301)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21312): Process ended prematurely: osmo-stp_10.42.42.5(pid=21312) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21312)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21326): Process ended prematurely: osmo-stp_10.42.42.5(pid=21326) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21326)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21337): Process ended prematurely: osmo-stp_10.42.42.5(pid=21337) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21337)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21351): Process ended prematurely: osmo-stp_10.42.42.5(pid=21351) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21351)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21362): Process ended prematurely: osmo-stp_10.42.42.5(pid=21362) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21362)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21376): Process ended prematurely: osmo-stp_10.42.42.5(pid=21376) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21376)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21387): Process ended prematurely: osmo-stp_10.42.42.5(pid=21387) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21387)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21401): Process ended prematurely: osmo-stp_10.42.42.5(pid=21401) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21401)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21412): Process ended prematurely: osmo-stp_10.42.42.5(pid=21412) [trial-2365↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21412)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21426): Process ended prematurely: osmo-stp_10.42.42.5(pid=21426) [trial-2365↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21426)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21440): Process ended prematurely: osmo-stp_10.42.42.5(pid=21440) [trial-2365↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21440)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21455): Process ended prematurely: osmo-stp_10.42.42.5(pid=21455) [trial-2365↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21455)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21467): Process ended prematurely: osmo-stp_10.42.42.5(pid=21467) [trial-2365↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21467)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21481): Process ended prematurely: osmo-stp_10.42.42.5(pid=21481) [trial-2365↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21481)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21492): Process ended prematurely: osmo-stp_10.42.42.5(pid=21492) [trial-2365↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21492)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21506): Process ended prematurely: osmo-stp_10.42.42.5(pid=21506) [trial-2365↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21506)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21517): Process ended prematurely: osmo-stp_10.42.42.5(pid=21517) [trial-2365↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21517)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21531): Process ended prematurely: osmo-stp_10.42.42.5(pid=21531) [trial-2365↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21531)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21542): Process ended prematurely: osmo-stp_10.42.42.5(pid=21542) [trial-2365↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21542)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21563): Process ended prematurely: osmo-stp_10.42.42.5(pid=21563) [trial-2365↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21563)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=21575): Process ended prematurely: osmo-stp_10.42.42.5(pid=21575) [trial-2365↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21575)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=21593): Process ended prematurely: osmo-stp_10.42.42.5(pid=21593) [trial-2365↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21593)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21603): Process ended prematurely: osmo-stp_10.42.42.5(pid=21603) [trial-2365↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21603)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21614): Process ended prematurely: osmo-stp_10.42.42.5(pid=21614) [trial-2365↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21614)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=21631): Process ended prematurely: osmo-stp_10.42.42.5(pid=21631) [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21631)] FAIL: iperf3.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=21654): Process ended prematurely: osmo-stp_10.42.42.5(pid=21654) [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21654)] FAIL: iperf3m4.py (12.4 sec) Error: osmo-stp_10.42.42.5(pid=21933): Process ended prematurely: osmo-stp_10.42.42.5(pid=21933) [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21933)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21945): Process ended prematurely: osmo-stp_10.42.42.5(pid=21945) [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21945)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21955): Process ended prematurely: osmo-stp_10.42.42.5(pid=21955) [trial-2365↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21955)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=21972): Process ended prematurely: osmo-stp_10.42.42.5(pid=21972) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21972)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=21984): Process ended prematurely: osmo-stp_10.42.42.5(pid=21984) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21984)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=22002): Process ended prematurely: osmo-stp_10.42.42.5(pid=22002) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22002)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22012): Process ended prematurely: osmo-stp_10.42.42.5(pid=22012) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22012)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22023): Process ended prematurely: osmo-stp_10.42.42.5(pid=22023) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22023)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=22040): Process ended prematurely: osmo-stp_10.42.42.5(pid=22040) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22040)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=22066): Process ended prematurely: osmo-stp_10.42.42.5(pid=22066) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22066)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=22437): Process ended prematurely: osmo-stp_10.42.42.5(pid=22437) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22437)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22623): Process ended prematurely: osmo-stp_10.42.42.5(pid=22623) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22623)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22633): Process ended prematurely: osmo-stp_10.42.42.5(pid=22633) [trial-2365↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22633)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=22650): Process ended prematurely: osmo-stp_10.42.42.5(pid=22650) [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22650)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=22662): Process ended prematurely: osmo-stp_10.42.42.5(pid=22662) [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22662)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=22680): Process ended prematurely: osmo-stp_10.42.42.5(pid=22680) [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22680)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22690): Process ended prematurely: osmo-stp_10.42.42.5(pid=22690) [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22690)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22700): Process ended prematurely: osmo-stp_10.42.42.5(pid=22700) [trial-2365↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22700)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22714): Process ended prematurely: osmo-stp_10.42.42.5(pid=22714) [trial-2365↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22714)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22728): Process ended prematurely: osmo-stp_10.42.42.5(pid=22728) [trial-2365↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22728)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=22737): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22737) [trial-2365↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22737)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22747): Process ended prematurely: osmo-stp_10.42.42.5(pid=22747) [trial-2365↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22747)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=22756): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22756) [trial-2365↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22756)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=22768): Process ended prematurely: osmo-stp_10.42.42.5(pid=22768) [trial-2365↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22768)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22782): Process ended prematurely: osmo-stp_10.42.42.5(pid=22782) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22782)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22793): Process ended prematurely: osmo-stp_10.42.42.5(pid=22793) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22793)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22807): Process ended prematurely: osmo-stp_10.42.42.5(pid=22807) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22807)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22818): Process ended prematurely: osmo-stp_10.42.42.5(pid=22818) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22818)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22833): Process ended prematurely: osmo-stp_10.42.42.5(pid=22833) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22833)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22844): Process ended prematurely: osmo-stp_10.42.42.5(pid=22844) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22844)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22858): Process ended prematurely: osmo-stp_10.42.42.5(pid=22858) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22858)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22870): Process ended prematurely: osmo-stp_10.42.42.5(pid=22870) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22870)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22884): Process ended prematurely: osmo-stp_10.42.42.5(pid=22884) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22884)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22895): Process ended prematurely: osmo-stp_10.42.42.5(pid=22895) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22895)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22910): Process ended prematurely: osmo-stp_10.42.42.5(pid=22910) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22910)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22921): Process ended prematurely: osmo-stp_10.42.42.5(pid=22921) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22921)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22935): Process ended prematurely: osmo-stp_10.42.42.5(pid=22935) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22935)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22949): Process ended prematurely: osmo-stp_10.42.42.5(pid=22949) [trial-2365↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22949)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22963): Process ended prematurely: osmo-stp_10.42.42.5(pid=22963) [trial-2365↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22963)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22974): Process ended prematurely: osmo-stp_10.42.42.5(pid=22974) [trial-2365↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22974)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=22992): Process ended prematurely: osmo-stp_10.42.42.5(pid=22992) [trial-2365↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22992)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23004): Process ended prematurely: osmo-stp_10.42.42.5(pid=23004) [trial-2365↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23004)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=23022): Process ended prematurely: osmo-stp_10.42.42.5(pid=23022) [trial-2365↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23022)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23032): Process ended prematurely: osmo-stp_10.42.42.5(pid=23032) [trial-2365↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23032)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23042): Process ended prematurely: osmo-stp_10.42.42.5(pid=23042) [trial-2365↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23042)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=23060): Process ended prematurely: osmo-stp_10.42.42.5(pid=23060) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23060)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=23072): Process ended prematurely: osmo-stp_10.42.42.5(pid=23072) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23072)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=23093): Process ended prematurely: osmo-stp_10.42.42.5(pid=23093) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23093)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23103): Process ended prematurely: osmo-stp_10.42.42.5(pid=23103) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23103)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=23113): Process ended prematurely: osmo-stp_10.42.42.5(pid=23113) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23113)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=23133): Process ended prematurely: osmo-stp_10.42.42.5(pid=23133) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23133)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=23145): Process ended prematurely: osmo-stp_10.42.42.5(pid=23145) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23145)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=23163): Process ended prematurely: osmo-stp_10.42.42.5(pid=23163) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23163)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23173): Process ended prematurely: osmo-stp_10.42.42.5(pid=23173) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23173)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23183): Process ended prematurely: osmo-stp_10.42.42.5(pid=23183) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23183)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=23202): Process ended prematurely: osmo-stp_10.42.42.5(pid=23202) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23202)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23214): Process ended prematurely: osmo-stp_10.42.42.5(pid=23214) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23214)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=23232): Process ended prematurely: osmo-stp_10.42.42.5(pid=23232) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23232)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23242): Process ended prematurely: osmo-stp_10.42.42.5(pid=23242) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23242)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23252): Process ended prematurely: osmo-stp_10.42.42.5(pid=23252) [trial-2365↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23252)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23265): Process ended prematurely: osmo-stp_10.42.42.5(pid=23265) [trial-2365↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23265)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23279): Process ended prematurely: osmo-stp_10.42.42.5(pid=23279) [trial-2365↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23279)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=23290): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23290) [trial-2365↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23290)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=23300): Process ended prematurely: osmo-stp_10.42.42.5(pid=23300) [trial-2365↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23300)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=23310): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23310) [trial-2365↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23310)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=23320): Process ended prematurely: osmo-stp_10.42.42.5(pid=23320) [trial-2365↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23320)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23334): Process ended prematurely: osmo-stp_10.42.42.5(pid=23334) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23334)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23345): Process ended prematurely: osmo-stp_10.42.42.5(pid=23345) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23345)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23359): Process ended prematurely: osmo-stp_10.42.42.5(pid=23359) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23359)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23370): Process ended prematurely: osmo-stp_10.42.42.5(pid=23370) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23370)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23384): Process ended prematurely: osmo-stp_10.42.42.5(pid=23384) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23384)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23395): Process ended prematurely: osmo-stp_10.42.42.5(pid=23395) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23395)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23409): Process ended prematurely: osmo-stp_10.42.42.5(pid=23409) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23409)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23420): Process ended prematurely: osmo-stp_10.42.42.5(pid=23420) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23420)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23436): Process ended prematurely: osmo-stp_10.42.42.5(pid=23436) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23436)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23447): Process ended prematurely: osmo-stp_10.42.42.5(pid=23447) [trial-2365↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23447)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23461): Process ended prematurely: osmo-stp_10.42.42.5(pid=23461) [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23461)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23472): Process ended prematurely: osmo-stp_10.42.42.5(pid=23472) [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23472)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23486): Process ended prematurely: osmo-stp_10.42.42.5(pid=23486) [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23486)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23497): Process ended prematurely: osmo-stp_10.42.42.5(pid=23497) [trial-2365↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23497)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=23524): Process ended prematurely: osmo-stp_10.42.42.5(pid=23524) [trial-2365↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23524)] FAIL: mo_mt_call_osmux.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=23794): Process ended prematurely: osmo-stp_10.42.42.5(pid=23794) [trial-2365↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23794)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23809): Process ended prematurely: osmo-stp_10.42.42.5(pid=23809) [trial-2365↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23809)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23820): Process ended prematurely: osmo-stp_10.42.42.5(pid=23820) [trial-2365↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23820)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=23838): Process ended prematurely: osmo-stp_10.42.42.5(pid=23838) [trial-2365↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23838)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=23850): Process ended prematurely: osmo-stp_10.42.42.5(pid=23850) [trial-2365↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23850)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=23868): Process ended prematurely: osmo-stp_10.42.42.5(pid=23868) [trial-2365↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23868)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23878): Process ended prematurely: osmo-stp_10.42.42.5(pid=23878) [trial-2365↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23878)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23888): Process ended prematurely: osmo-stp_10.42.42.5(pid=23888) [trial-2365↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23888)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=23905): Process ended prematurely: osmo-stp_10.42.42.5(pid=23905) [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23905)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23920): Process ended prematurely: osmo-stp_10.42.42.5(pid=23920) [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23920)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=23938): Process ended prematurely: osmo-stp_10.42.42.5(pid=23938) [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23938)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23948): Process ended prematurely: osmo-stp_10.42.42.5(pid=23948) [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23948)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23958): Process ended prematurely: osmo-stp_10.42.42.5(pid=23958) [trial-2365↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23958)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23976): Process ended prematurely: osmo-stp_10.42.42.5(pid=23976) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23976)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=23988): Process ended prematurely: osmo-stp_10.42.42.5(pid=23988) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23988)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=24006): Process ended prematurely: osmo-stp_10.42.42.5(pid=24006) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24006)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24016): Process ended prematurely: osmo-stp_10.42.42.5(pid=24016) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24016)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24026): Process ended prematurely: osmo-stp_10.42.42.5(pid=24026) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24026)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=24046): Process ended prematurely: osmo-stp_10.42.42.5(pid=24046) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24046)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=24058): Process ended prematurely: osmo-stp_10.42.42.5(pid=24058) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24058)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=24076): Process ended prematurely: osmo-stp_10.42.42.5(pid=24076) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24076)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24088): Process ended prematurely: osmo-stp_10.42.42.5(pid=24088) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24088)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24098): Process ended prematurely: osmo-stp_10.42.42.5(pid=24098) [trial-2365↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24098)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=24115): Process ended prematurely: osmo-stp_10.42.42.5(pid=24115) [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24115)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=24127): Process ended prematurely: osmo-stp_10.42.42.5(pid=24127) [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24127)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=24145): Process ended prematurely: osmo-stp_10.42.42.5(pid=24145) [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24145)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24155): Process ended prematurely: osmo-stp_10.42.42.5(pid=24155) [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24155)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=24166): Process ended prematurely: osmo-stp_10.42.42.5(pid=24166) [trial-2365↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24166)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24179): Process ended prematurely: osmo-stp_10.42.42.5(pid=24179) [trial-2365↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24179)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24192): Process ended prematurely: osmo-stp_10.42.42.5(pid=24192) [trial-2365↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24192)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=24201): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24201) [trial-2365↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24201)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=24211): Process ended prematurely: osmo-stp_10.42.42.5(pid=24211) [trial-2365↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24211)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=24220): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24220) [trial-2365↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24220)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=24230): Process ended prematurely: osmo-stp_10.42.42.5(pid=24230) [trial-2365↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24230)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24244): Process ended prematurely: osmo-stp_10.42.42.5(pid=24244) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24244)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24258): Process ended prematurely: osmo-stp_10.42.42.5(pid=24258) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24258)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24272): Process ended prematurely: osmo-stp_10.42.42.5(pid=24272) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24272)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24283): Process ended prematurely: osmo-stp_10.42.42.5(pid=24283) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24283)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24297): Process ended prematurely: osmo-stp_10.42.42.5(pid=24297) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24297)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24308): Process ended prematurely: osmo-stp_10.42.42.5(pid=24308) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24308)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24322): Process ended prematurely: osmo-stp_10.42.42.5(pid=24322) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24322)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24333): Process ended prematurely: osmo-stp_10.42.42.5(pid=24333) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24333)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24347): Process ended prematurely: osmo-stp_10.42.42.5(pid=24347) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24347)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24358): Process ended prematurely: osmo-stp_10.42.42.5(pid=24358) [trial-2365↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24358)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24374): Process ended prematurely: osmo-stp_10.42.42.5(pid=24374) [trial-2365↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24374)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24385): Process ended prematurely: osmo-stp_10.42.42.5(pid=24385) [trial-2365↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24385)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=24399): Process ended prematurely: osmo-stp_10.42.42.5(pid=24399) [trial-2365↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24399)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24410): Process ended prematurely: osmo-stp_10.42.42.5(pid=24410) [trial-2365↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24410)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24424): Process ended prematurely: osmo-stp_10.42.42.5(pid=24424) [trial-2365↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24424)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24435): Process ended prematurely: osmo-stp_10.42.42.5(pid=24435) [trial-2365↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24435)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=24454): Process ended prematurely: osmo-stp_10.42.42.5(pid=24454) [trial-2365↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24454)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=24467): Process ended prematurely: osmo-stp_10.42.42.5(pid=24467) [trial-2365↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24467)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=24485): Process ended prematurely: osmo-stp_10.42.42.5(pid=24485) [trial-2365↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24485)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24495): Process ended prematurely: osmo-stp_10.42.42.5(pid=24495) [trial-2365↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24495)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24505): Process ended prematurely: osmo-stp_10.42.42.5(pid=24505) [trial-2365↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24505)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=24522): Process ended prematurely: osmo-stp_10.42.42.5(pid=24522) [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24522)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=24535): Process ended prematurely: osmo-stp_10.42.42.5(pid=24535) [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24535)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=24554): Process ended prematurely: osmo-stp_10.42.42.5(pid=24554) [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24554)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=24564): Process ended prematurely: osmo-stp_10.42.42.5(pid=24564) [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24564)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24574): Process ended prematurely: osmo-stp_10.42.42.5(pid=24574) [trial-2365↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24574)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=24591): Process ended prematurely: osmo-stp_10.42.42.5(pid=24591) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24591)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=24606): Process ended prematurely: osmo-stp_10.42.42.5(pid=24606) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24606)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=24624): Process ended prematurely: osmo-stp_10.42.42.5(pid=24624) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24624)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24634): Process ended prematurely: osmo-stp_10.42.42.5(pid=24634) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24634)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24644): Process ended prematurely: osmo-stp_10.42.42.5(pid=24644) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24644)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=24663): Process ended prematurely: osmo-stp_10.42.42.5(pid=24663) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24663)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=24675): Process ended prematurely: osmo-stp_10.42.42.5(pid=24675) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24675)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=24693): Process ended prematurely: osmo-stp_10.42.42.5(pid=24693) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24693)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24711): Process ended prematurely: osmo-stp_10.42.42.5(pid=24711) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24711)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24721): Process ended prematurely: osmo-stp_10.42.42.5(pid=24721) [trial-2365↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24721)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24734): Process ended prematurely: osmo-stp_10.42.42.5(pid=24734) [trial-2365↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24734)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24747): Process ended prematurely: osmo-stp_10.42.42.5(pid=24747) [trial-2365↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24747)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=24756): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24756) [trial-2365↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24756)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24766): Process ended prematurely: osmo-stp_10.42.42.5(pid=24766) [trial-2365↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24766)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=24775): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24775) [trial-2365↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24775)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24785): Process ended prematurely: osmo-stp_10.42.42.5(pid=24785) [trial-2365↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24785)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24799): Process ended prematurely: osmo-stp_10.42.42.5(pid=24799) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24799)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24810): Process ended prematurely: osmo-stp_10.42.42.5(pid=24810) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24810)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24837): Process ended prematurely: osmo-stp_10.42.42.5(pid=24837) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24837)] FAIL: mo_mt_call_osmux.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=25106): Process ended prematurely: osmo-stp_10.42.42.5(pid=25106) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25106)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25121): Process ended prematurely: osmo-stp_10.42.42.5(pid=25121) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25121)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25132): Process ended prematurely: osmo-stp_10.42.42.5(pid=25132) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25132)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25146): Process ended prematurely: osmo-stp_10.42.42.5(pid=25146) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25146)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25157): Process ended prematurely: osmo-stp_10.42.42.5(pid=25157) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25157)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25175): Process ended prematurely: osmo-stp_10.42.42.5(pid=25175) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25175)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25186): Process ended prematurely: osmo-stp_10.42.42.5(pid=25186) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25186)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25200): Process ended prematurely: osmo-stp_10.42.42.5(pid=25200) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25200)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25211): Process ended prematurely: osmo-stp_10.42.42.5(pid=25211) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25211)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25225): Process ended prematurely: osmo-stp_10.42.42.5(pid=25225) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25225)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25239): Process ended prematurely: osmo-stp_10.42.42.5(pid=25239) [trial-2365↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25239)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25253): Process ended prematurely: osmo-stp_10.42.42.5(pid=25253) [trial-2365↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25253)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25265): Process ended prematurely: osmo-stp_10.42.42.5(pid=25265) [trial-2365↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25265)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=25283): Process ended prematurely: osmo-stp_10.42.42.5(pid=25283) [trial-2365↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25283)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=25295): Process ended prematurely: osmo-stp_10.42.42.5(pid=25295) [trial-2365↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25295)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=25313): Process ended prematurely: osmo-stp_10.42.42.5(pid=25313) [trial-2365↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25313)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25323): Process ended prematurely: osmo-stp_10.42.42.5(pid=25323) [trial-2365↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25323)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25333): Process ended prematurely: osmo-stp_10.42.42.5(pid=25333) [trial-2365↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25333)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=25352): Process ended prematurely: osmo-stp_10.42.42.5(pid=25352) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25352)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=25366): Process ended prematurely: osmo-stp_10.42.42.5(pid=25366) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25366)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=25384): Process ended prematurely: osmo-stp_10.42.42.5(pid=25384) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25384)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25394): Process ended prematurely: osmo-stp_10.42.42.5(pid=25394) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25394)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25404): Process ended prematurely: osmo-stp_10.42.42.5(pid=25404) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25404)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=25421): Process ended prematurely: osmo-stp_10.42.42.5(pid=25421) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25421)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=25433): Process ended prematurely: osmo-stp_10.42.42.5(pid=25433) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25433)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=25452): Process ended prematurely: osmo-stp_10.42.42.5(pid=25452) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25452)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25462): Process ended prematurely: osmo-stp_10.42.42.5(pid=25462) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25462)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25472): Process ended prematurely: osmo-stp_10.42.42.5(pid=25472) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25472)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=25490): Process ended prematurely: osmo-stp_10.42.42.5(pid=25490) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25490)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=25502): Process ended prematurely: osmo-stp_10.42.42.5(pid=25502) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25502)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=25520): Process ended prematurely: osmo-stp_10.42.42.5(pid=25520) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25520)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25532): Process ended prematurely: osmo-stp_10.42.42.5(pid=25532) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25532)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25542): Process ended prematurely: osmo-stp_10.42.42.5(pid=25542) [trial-2365↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25542)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25555): Process ended prematurely: osmo-stp_10.42.42.5(pid=25555) [trial-2365↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25555)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25568): Process ended prematurely: osmo-stp_10.42.42.5(pid=25568) [trial-2365↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25568)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=25582): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25582) [trial-2365↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25582)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25592): Process ended prematurely: osmo-stp_10.42.42.5(pid=25592) [trial-2365↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25592)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=25601): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25601) [trial-2365↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25601)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25611): Process ended prematurely: osmo-stp_10.42.42.5(pid=25611) [trial-2365↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25611)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25625): Process ended prematurely: osmo-stp_10.42.42.5(pid=25625) [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25625)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25636): Process ended prematurely: osmo-stp_10.42.42.5(pid=25636) [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25636)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25650): Process ended prematurely: osmo-stp_10.42.42.5(pid=25650) [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25650)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25661): Process ended prematurely: osmo-stp_10.42.42.5(pid=25661) [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25661)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25676): Process ended prematurely: osmo-stp_10.42.42.5(pid=25676) [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25676)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25687): Process ended prematurely: osmo-stp_10.42.42.5(pid=25687) [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25687)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25701): Process ended prematurely: osmo-stp_10.42.42.5(pid=25701) [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25701)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25712): Process ended prematurely: osmo-stp_10.42.42.5(pid=25712) [trial-2365↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25712)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25726): Process ended prematurely: osmo-stp_10.42.42.5(pid=25726) [trial-2365↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25726)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25737): Process ended prematurely: osmo-stp_10.42.42.5(pid=25737) [trial-2365↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25737)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25751): Process ended prematurely: osmo-stp_10.42.42.5(pid=25751) [trial-2365↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25751)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25764): Process ended prematurely: osmo-stp_10.42.42.5(pid=25764) [trial-2365↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25764)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=25782): Process ended prematurely: osmo-stp_10.42.42.5(pid=25782) [trial-2365↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25782)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=25794): Process ended prematurely: osmo-stp_10.42.42.5(pid=25794) [trial-2365↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25794)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=25812): Process ended prematurely: osmo-stp_10.42.42.5(pid=25812) [trial-2365↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25812)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25822): Process ended prematurely: osmo-stp_10.42.42.5(pid=25822) [trial-2365↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25822)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25832): Process ended prematurely: osmo-stp_10.42.42.5(pid=25832) [trial-2365↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25832)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=25849): Process ended prematurely: osmo-stp_10.42.42.5(pid=25849) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25849)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=25863): Process ended prematurely: osmo-stp_10.42.42.5(pid=25863) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25863)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=25881): Process ended prematurely: osmo-stp_10.42.42.5(pid=25881) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25881)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25892): Process ended prematurely: osmo-stp_10.42.42.5(pid=25892) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25892)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25902): Process ended prematurely: osmo-stp_10.42.42.5(pid=25902) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25902)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=25920): Process ended prematurely: osmo-stp_10.42.42.5(pid=25920) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25920)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=25943): Process ended prematurely: osmo-stp_10.42.42.5(pid=25943) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25943)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=26312): Process ended prematurely: osmo-stp_10.42.42.5(pid=26312) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26312)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26498): Process ended prematurely: osmo-stp_10.42.42.5(pid=26498) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26498)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26508): Process ended prematurely: osmo-stp_10.42.42.5(pid=26508) [trial-2365↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26508)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26521): Process ended prematurely: osmo-stp_10.42.42.5(pid=26521) [trial-2365↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26521)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26534): Process ended prematurely: osmo-stp_10.42.42.5(pid=26534) [trial-2365↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26534)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=26545): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26545) [trial-2365↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26545)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=26555): Process ended prematurely: osmo-stp_10.42.42.5(pid=26555) [trial-2365↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26555)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26569): Process ended prematurely: osmo-stp_10.42.42.5(pid=26569) [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26569)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26580): Process ended prematurely: osmo-stp_10.42.42.5(pid=26580) [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26580)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26594): Process ended prematurely: osmo-stp_10.42.42.5(pid=26594) [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26594)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26605): Process ended prematurely: osmo-stp_10.42.42.5(pid=26605) [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26605)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26620): Process ended prematurely: osmo-stp_10.42.42.5(pid=26620) [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26620)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26631): Process ended prematurely: osmo-stp_10.42.42.5(pid=26631) [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26631)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26645): Process ended prematurely: osmo-stp_10.42.42.5(pid=26645) [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26645)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26656): Process ended prematurely: osmo-stp_10.42.42.5(pid=26656) [trial-2365↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26656)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26670): Process ended prematurely: osmo-stp_10.42.42.5(pid=26670) [trial-2365↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26670)] FAIL: mo_mt_call_osmux.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=26692): Process ended prematurely: osmo-stp_10.42.42.5(pid=26692) [trial-2365↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26692)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26967): Process ended prematurely: osmo-stp_10.42.42.5(pid=26967) [trial-2365↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26967)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26978): Process ended prematurely: osmo-stp_10.42.42.5(pid=26978) [trial-2365↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26978)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26992): Process ended prematurely: osmo-stp_10.42.42.5(pid=26992) [trial-2365↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26992)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27003): Process ended prematurely: osmo-stp_10.42.42.5(pid=27003) [trial-2365↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27003)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=27021): Process ended prematurely: osmo-stp_10.42.42.5(pid=27021) [trial-2365↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27021)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=27033): Process ended prematurely: osmo-stp_10.42.42.5(pid=27033) [trial-2365↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27033)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=27051): Process ended prematurely: osmo-stp_10.42.42.5(pid=27051) [trial-2365↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27051)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27062): Process ended prematurely: osmo-stp_10.42.42.5(pid=27062) [trial-2365↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27062)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27072): Process ended prematurely: osmo-stp_10.42.42.5(pid=27072) [trial-2365↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27072)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=27094): Process ended prematurely: osmo-stp_10.42.42.5(pid=27094) [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27094)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=27106): Process ended prematurely: osmo-stp_10.42.42.5(pid=27106) [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27106)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=27124): Process ended prematurely: osmo-stp_10.42.42.5(pid=27124) [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27124)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27134): Process ended prematurely: osmo-stp_10.42.42.5(pid=27134) [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27134)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27144): Process ended prematurely: osmo-stp_10.42.42.5(pid=27144) [trial-2365↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27144)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=27161): Process ended prematurely: osmo-stp_10.42.42.5(pid=27161) [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27161)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=27173): Process ended prematurely: osmo-stp_10.42.42.5(pid=27173) [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27173)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=27191): Process ended prematurely: osmo-stp_10.42.42.5(pid=27191) [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27191)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27201): Process ended prematurely: osmo-stp_10.42.42.5(pid=27201) [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27201)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27211): Process ended prematurely: osmo-stp_10.42.42.5(pid=27211) [trial-2365↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27211)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=27230): Process ended prematurely: osmo-stp_10.42.42.5(pid=27230) [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27230)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=27242): Process ended prematurely: osmo-stp_10.42.42.5(pid=27242) [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27242)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=27260): Process ended prematurely: osmo-stp_10.42.42.5(pid=27260) [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27260)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27271): Process ended prematurely: osmo-stp_10.42.42.5(pid=27271) [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27271)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27281): Process ended prematurely: osmo-stp_10.42.42.5(pid=27281) [trial-2365↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27281)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27294): Process ended prematurely: osmo-stp_10.42.42.5(pid=27294) [trial-2365↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27294)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=27303): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27303) [trial-2365↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27303)] FAIL: esme_connect_policy_closed.py (2.0 sec) Error: osmo-nitb_10.42.42.2(pid=27305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27305) [trial-2365↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27305)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=27307): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27307) [trial-2365↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27307)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=27309): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27309) [trial-2365↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27309)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=27318): Process ended prematurely: osmo-hlr_10.42.42.2(pid=27318) [trial-2365↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27318)] FAIL: esme_connect_policy_closed.py (5.8 sec) Error: osmo-hlr_10.42.42.2(pid=27329): Process ended prematurely: osmo-hlr_10.42.42.2(pid=27329) [trial-2365↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27329)] FAIL: esme_ms_sms_storeforward.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27341): Process ended prematurely: osmo-stp_10.42.42.5(pid=27341) [trial-2365↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27341)] FAIL: esme_ms_sms_transaction.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=27352): Process ended prematurely: osmo-stp_10.42.42.5(pid=27352) [trial-2365↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27352)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27366): Process ended prematurely: osmo-stp_10.42.42.5(pid=27366) [trial-2365↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27366)] FAIL: register_a5_0_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27377): Process ended prematurely: osmo-stp_10.42.42.5(pid=27377) [trial-2365↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27377)] FAIL: register_a5_1_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27388): Process ended prematurely: osmo-stp_10.42.42.5(pid=27388) [trial-2365↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27388)] FAIL: register_a5_3_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27399): Process ended prematurely: osmo-stp_10.42.42.5(pid=27399) [trial-2365↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27399)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.1 sec) Error: srsepc(pid=27419): Process ended prematurely: srsepc(pid=27419) [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27419)] FAIL: iperf3_bidir.py (18.8 sec) Error: srsepc(pid=27439): Process ended prematurely: srsepc(pid=27439) [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27439)] FAIL: iperf3_dl.py (18.6 sec) Error: srsepc(pid=27455): Process ended prematurely: srsepc(pid=27455) [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27455)] FAIL: iperf3_ul.py (18.9 sec) Error: srsepc(pid=27471): Process ended prematurely: srsepc(pid=27471) [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27471)] FAIL: ping.py (18.3 sec) Error: srsepc(pid=27487): Process ended prematurely: srsepc(pid=27487) [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27487)] FAIL: rrc_idle_mo_ping.py (18.0 sec) Error: srsepc(pid=27503): Process ended prematurely: srsepc(pid=27503) [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27503)] FAIL: rrc_idle_mt_ping.py (18.3 sec) Error: srsepc(pid=27519): Process ended prematurely: srsepc(pid=27519) [trial-2365↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27519)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27533): Process ended prematurely: osmo-stp_10.42.42.5(pid=27533) [trial-2365↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27533)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27548): Process ended prematurely: osmo-stp_10.42.42.5(pid=27548) [trial-2365↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27548)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27563): Process ended prematurely: osmo-stp_10.42.42.5(pid=27563) [trial-2365↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27563)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27577): Process ended prematurely: osmo-stp_10.42.42.5(pid=27577) [trial-2365↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27577)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27591): Process ended prematurely: osmo-stp_10.42.42.5(pid=27591) [trial-2365↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27591)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27605): Process ended prematurely: osmo-stp_10.42.42.5(pid=27605) [trial-2365↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27605)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27620): Process ended prematurely: osmo-stp_10.42.42.5(pid=27620) [trial-2365↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27620)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27634): Process ended prematurely: osmo-stp_10.42.42.5(pid=27634) [trial-2365↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27634)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27648): Process ended prematurely: osmo-stp_10.42.42.5(pid=27648) [trial-2365↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27648)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27662): Process ended prematurely: osmo-stp_10.42.42.5(pid=27662) [trial-2365↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27662)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27676): Process ended prematurely: osmo-stp_10.42.42.5(pid=27676) [trial-2365↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27676)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27691): Process ended prematurely: osmo-stp_10.42.42.5(pid=27691) [trial-2365↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27691)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27705): Process ended prematurely: osmo-stp_10.42.42.5(pid=27705) [trial-2365↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27705)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27719): Process ended prematurely: osmo-stp_10.42.42.5(pid=27719) [trial-2365↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27719)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27733): Process ended prematurely: osmo-stp_10.42.42.5(pid=27733) [trial-2365↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27733)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27747): Process ended prematurely: osmo-stp_10.42.42.5(pid=27747) [trial-2365↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27747)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=27762): Process ended prematurely: osmo-stp_10.42.42.5(pid=27762) [trial-2365↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27762)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27779): Process ended prematurely: osmo-stp_10.42.42.5(pid=27779) [trial-2365↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27779)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27793): Process ended prematurely: osmo-stp_10.42.42.5(pid=27793) [trial-2365↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27793)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27807): Process ended prematurely: osmo-stp_10.42.42.5(pid=27807) [trial-2365↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27807)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=27821): Process ended prematurely: osmo-stp_10.42.42.5(pid=27821) [trial-2365↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27821)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27835): Process ended prematurely: osmo-stp_10.42.42.5(pid=27835) [trial-2365↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27835)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27849): Process ended prematurely: osmo-stp_10.42.42.5(pid=27849) [trial-2365↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27849)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27863): Process ended prematurely: osmo-stp_10.42.42.5(pid=27863) [trial-2365↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27863)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27877): Process ended prematurely: osmo-stp_10.42.42.5(pid=27877) [trial-2365↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27877)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=27891): Process ended prematurely: osmo-stp_10.42.42.5(pid=27891) [trial-2365↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27891)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27905): Process ended prematurely: osmo-stp_10.42.42.5(pid=27905) [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27905)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27919): Process ended prematurely: osmo-stp_10.42.42.5(pid=27919) [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27919)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27933): Process ended prematurely: osmo-stp_10.42.42.5(pid=27933) [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27933)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27948): Process ended prematurely: osmo-stp_10.42.42.5(pid=27948) [trial-2365↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27948)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27962): Process ended prematurely: osmo-stp_10.42.42.5(pid=27962) [trial-2365↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27962)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27976): Process ended prematurely: osmo-stp_10.42.42.5(pid=27976) [trial-2365↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27976)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=28003): Process ended prematurely: osmo-stp_10.42.42.5(pid=28003) [trial-2365↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28003)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=28276): Process ended prematurely: osmo-stp_10.42.42.5(pid=28276) [trial-2365↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28276)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28292): Process ended prematurely: osmo-stp_10.42.42.5(pid=28292) [trial-2365↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28292)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28306): Process ended prematurely: osmo-stp_10.42.42.5(pid=28306) [trial-2365↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28306)] + rm -rf trial-2365/inst + cd trial-2365 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-09 21:44:16 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365-run.tgz run.2022-12-09_21-44-27 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2365-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17654.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6679.tgz osmo-hlr.build-8699.tgz osmo-hnbgw.build-2949.tgz osmo-mgw.build-8944.tgz osmo-msc.build-29262.tgz osmo-nitb.build-12967.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30039.tgz osmo-stp.build-9239.tgz osmo-trx.build-4675.tgz osmocom-bb.build-4699.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE