Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8948 originally caused by: Started by upstream project "master-osmo-mgw" build number 9180 originally caused by: Started by upstream project "master-libosmo-netif" build number 6958 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17660 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7507 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6681 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8948 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2957 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29271 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5152 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30049 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4678 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12971 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9243 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5191 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3909 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins3144632021898651002.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-10 17:09:55 + trial_dir_prefix=trial- + rm -rf trial-2376 trial-2376-bin.tgz trial-2376-run.tgz + trial_dir=trial-2377 + mkdir -p trial-2377 + mv open5gs.build-8.tgz osmo-bsc.build-17660.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6681.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2957.tgz osmo-mgw.build-8948.tgz osmo-msc.build-29271.tgz osmo-nitb.build-12971.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30049.tgz osmo-stp.build-9243.tgz osmo-trx.build-4678.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz trial-2377 + cat open5gs.build-8.md5 osmo-bsc.build-17660.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6681.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2957.md5 osmo-mgw.build-8948.md5 osmo-msc.build-29271.md5 osmo-nitb.build-12971.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30049.md5 osmo-stp.build-9243.md5 osmo-trx.build-4678.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17660.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6681.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2957.md5 osmo-mgw.build-8948.md5 osmo-msc.build-29271.md5 osmo-nitb.build-12971.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30049.md5 osmo-stp.build-9243.md5 osmo-trx.build-4678.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2377 combinations: None trial: 'trial-2377' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2377 -------------------------------------------------------------------------------------------- 17:10:07.385901 tst trial-2377: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/log --------------------------------------------------------------------- trial-2377 nitb_sms:sysmo --------------------------------------------------------------------- 17:12:16.484874 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:12:16.488745 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 17:12:16.513484 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 17:12:16.521364 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 17:12:16.578197 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 17:12:16.600751 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 17:12:16.609455 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 17:12:17.155429 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 17:12:17.161398 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 17:12:17.173497 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 17:12:17.558302 tst mo_mt_sms.py: using LAC 29401 17:12:17.794793 tst mo_mt_sms.py: using RAC 76 17:12:17.914345 tst mo_mt_sms.py: using CellId 29401 17:12:18.029302 tst mo_mt_sms.py: using BVCI 29402 17:12:18.134497 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 17:12:18.319316 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 17:12:18.439278 tst mo_mt_sms.py:9: start nitb and bts... 17:12:18.653934 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:12:21.006459 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27706): Launched 17:12:21.330299 run osmo-nitb_10.42.42.2(pid=27707): Launched 17:12:21.504876 run osmo-nitb_10.42.42.2(pid=27707): ERR: Terminated: ERROR {rc=2} [trial-2377↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27707)] 17:12:21.637250 run osmo-nitb_10.42.42.2(pid=27707): stdout: | (launched: 2022-12-10_17:12:21.270362) 17:12:21.770634 run osmo-nitb_10.42.42.2(pid=27707): stderr: | (launched: 2022-12-10_17:12:21.318167) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:12:21.904128 run osmo-nitb_10.42.42.2(pid=27707): stdout: | (launched: 2022-12-10_17:12:21.270362) 17:12:22.031143 run osmo-nitb_10.42.42.2(pid=27707): stderr: | (launched: 2022-12-10_17:12:21.318167) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:12:22.183394 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=27707): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27707) [trial-2377↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27707)] [trial-2377↪nitb_sms:sysmo↪mo_mt_sms.py:11] 17:12:22.192089 tst mo_mt_sms.py:11: Test FAILED (5.0 sec) 17:12:22.199052 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27706): Terminating (SIGTERM) 17:12:22.410606 --- ParallelTerminationStrategy: PID 27706 died... 17:12:22.432446 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27706): Terminated: ok {rc=0} 17:12:22.521803 bus /sierra_3: Setting Powered False 17:12:23.619826 bus /sierra_3: Setting Powered False 17:12:24.739748 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 sms:sysmo --------------------------------------------------------------------- 17:12:25.922590 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:12:25.927383 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 17:12:25.949261 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 17:12:25.976343 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 17:12:26.030008 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 17:12:26.050610 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 17:12:26.076800 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 17:12:26.624174 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 sms:sysmo mo_mt_sms.py ---------------------------------------------- 17:12:26.629122 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:26.639662 tst sms:sysmo: Using 1 x bts (candidates: 1) 17:12:26.676814 tst mo_mt_sms.py: using LAC 29402 17:12:26.795202 tst mo_mt_sms.py: using RAC 77 17:12:26.911117 tst mo_mt_sms.py: using CellId 29402 17:12:27.026424 tst mo_mt_sms.py: using BVCI 29403 17:12:27.135877 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:27.146498 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:27.156998 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:27.167428 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:27.177949 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:27.188274 tst sms:sysmo: Using 1 x modem (candidates: 2) 17:12:27.305398 tst sms:sysmo: Using 1 x modem (candidates: 2) 17:12:27.424568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:12:29.184272 run create_hlr_db(pid=27712): Launched 17:12:29.310318 bus /sierra_2: Setting Powered False 17:12:30.374452 run create_hlr_db(pid=27712): Terminated: ok {rc=0} 17:12:30.824823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27714): Launched 17:12:31.180654 run osmo-hlr_10.42.42.2(pid=27715): Launched 17:12:31.336718 run osmo-stp_10.42.42.5: Starting osmo-stp 17:12:34.300262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27717): Launched 17:12:34.625524 run osmo-stp_10.42.42.5(pid=27718): Launched 17:12:34.748575 run osmo-msc_10.42.42.6: Starting osmo-msc 17:12:40.214562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27725): Launched 17:12:40.536775 run osmo-msc_10.42.42.6(pid=27726): Launched 17:12:40.716705 run osmo-stp_10.42.42.5(pid=27718): ERR: Terminated: ERROR {rc=1} [trial-2377↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27718)] 17:12:40.852534 run osmo-stp_10.42.42.5(pid=27718): stdout: | (launched: 2022-12-10_17:12:34.564893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:40.989229 run osmo-stp_10.42.42.5(pid=27718): stderr: | 20221210171234759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171234760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171234760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171234761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171234761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171234761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171234761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:41.124754 run osmo-stp_10.42.42.5(pid=27718): stdout: | (launched: 2022-12-10_17:12:34.564893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:41.252805 run osmo-stp_10.42.42.5(pid=27718): stderr: | 20221210171234759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171234760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171234760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171234761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171234761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171234761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171234761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:41.405882 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=27718): Process ended prematurely: osmo-stp_10.42.42.5(pid=27718) [trial-2377↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27718)] [trial-2377↪sms:sysmo↪mo_mt_sms.py:16] 17:12:41.414828 tst mo_mt_sms.py:16: Test FAILED (14.8 sec) 17:12:41.442850 run osmo-hlr_10.42.42.2(pid=27715): ERR: Terminated: ERROR {rc=237} [trial-2377↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27715)] 17:12:41.493978 run osmo-hlr_10.42.42.2(pid=27715): stdout: | (launched: 2022-12-10_17:12:31.119962) 17:12:41.546804 run osmo-hlr_10.42.42.2(pid=27715): stderr: | 20221210171231560 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171231560 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171231560 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171231560 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171231561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171231561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171231588 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171231620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171231620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171231620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:12:41.620260 run osmo-msc_10.42.42.6(pid=27726): ERR: Terminated: ERROR {rc=2} [trial-2377↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27726)] 17:12:41.671048 run osmo-msc_10.42.42.6(pid=27726): stdout: | (launched: 2022-12-10_17:12:40.476036) 17:12:41.723408 run osmo-msc_10.42.42.6(pid=27726): stderr: | 20221210171240800 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171240801 DLGLOBAL DEBUG validating counter group 0x7f2306a46c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171240801 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171240801 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171240801 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171240801 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171240803 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171240803 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171240803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171240803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:12:41.776199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27714): Terminating (SIGTERM) 17:12:41.818736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27717): Terminating (SIGTERM) 17:12:41.861285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27725): Terminating (SIGTERM) 17:12:41.903731 --- ParallelTerminationStrategy: PID 27714 died... 17:12:41.923743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27714): Terminated: ok {rc=0} 17:12:41.970784 --- ParallelTerminationStrategy: PID 27717 died... 17:12:41.990389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27717): Terminated: ok {rc=0} 17:12:42.037265 --- ParallelTerminationStrategy: PID 27725 died... 17:12:42.056791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27725): Terminated: ok {rc=0} 17:12:42.145297 bus /sierra_3: Setting Powered False 17:12:43.244244 bus /sierra_3: Setting Powered False 17:12:44.358937 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 nitb_ussd:sysmo --------------------------------------------------------------------- 17:12:45.578279 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:12:45.582563 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 17:12:45.603520 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 17:12:45.610340 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 17:12:45.643921 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 17:12:45.665023 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 17:12:45.671678 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 17:12:46.191032 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2377 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 17:12:46.196936 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 17:12:46.208702 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 17:12:46.245654 tst assert_extension.py: using LAC 29403 17:12:46.365857 tst assert_extension.py: using RAC 78 17:12:46.485101 tst assert_extension.py: using CellId 29403 17:12:46.642660 tst assert_extension.py: using BVCI 29404 17:12:46.786911 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 17:12:46.912219 tst assert_extension.py:10: start nitb and bts... 17:12:47.152413 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:12:47.813424 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27731): Launched 17:12:48.138576 run osmo-nitb_10.42.42.2(pid=27732): Launched 17:12:48.317707 run osmo-nitb_10.42.42.2(pid=27732): ERR: Terminated: ERROR {rc=2} [trial-2377↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27732)] 17:12:48.461629 run osmo-nitb_10.42.42.2(pid=27732): stdout: | (launched: 2022-12-10_17:12:48.077984) 17:12:48.608039 run osmo-nitb_10.42.42.2(pid=27732): stderr: | (launched: 2022-12-10_17:12:48.126157) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:12:48.753367 run osmo-nitb_10.42.42.2(pid=27732): stdout: | (launched: 2022-12-10_17:12:48.077984) 17:12:48.892729 run osmo-nitb_10.42.42.2(pid=27732): stderr: | (launched: 2022-12-10_17:12:48.126157) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f2803594268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27732): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27732) [trial-2377↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27732)] 17:12:49.261434 tst osmo-nitb_10.42.42.2(pid=27732): stdout: | (launched: 2022-12-10_17:12:48.077984) 17:12:49.391116 tst osmo-nitb_10.42.42.2(pid=27732): stderr: | (launched: 2022-12-10_17:12:48.126157) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:12:49.544573 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=27732): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27732) [trial-2377↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27732)] [trial-2377↪nitb_ussd:sysmo↪assert_extension.py:12] 17:12:49.553556 tst assert_extension.py:12: Test FAILED (3.3 sec) 17:12:49.560558 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27731): Terminating (SIGTERM) 17:12:49.771769 --- ParallelTerminationStrategy: PID 27731 died... 17:12:49.793180 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27731): Terminated: ok {rc=0} 17:12:49.881832 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 ussd:sysmo --------------------------------------------------------------------- 17:12:51.044231 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:12:51.048516 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 17:12:51.070354 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 17:12:51.097501 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 17:12:51.131422 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 17:12:51.152455 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 17:12:51.178928 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 17:12:51.708127 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2377 ussd:sysmo assert_extension.py ---------------------------------------------- 17:12:51.713539 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:51.724310 tst ussd:sysmo: Using 1 x bts (candidates: 1) 17:12:51.758905 tst assert_extension.py: using LAC 29404 17:12:51.876457 tst assert_extension.py: using RAC 79 17:12:51.997644 tst assert_extension.py: using CellId 29404 17:12:52.114677 tst assert_extension.py: using BVCI 29405 17:12:52.223418 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:52.234269 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:52.244885 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:52.255593 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:52.266478 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:52.277202 tst ussd:sysmo: Using 1 x modem (candidates: 1) 17:12:52.392235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:12:52.864211 run create_hlr_db(pid=27736): Launched 17:12:52.988734 bus /sierra_2: Setting Powered False 17:12:54.048648 run create_hlr_db(pid=27736): Terminated: ok {rc=0} 17:12:54.471517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27738): Launched 17:12:54.776145 run osmo-hlr_10.42.42.2(pid=27739): Launched 17:12:54.892470 run osmo-stp_10.42.42.5: Starting osmo-stp 17:12:55.421354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27741): Launched 17:12:55.725516 run osmo-stp_10.42.42.5(pid=27742): Launched 17:12:55.841515 run osmo-msc_10.42.42.6: Starting osmo-msc 17:12:56.386812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27744): Launched 17:12:56.692326 run osmo-msc_10.42.42.6(pid=27745): Launched 17:12:56.861349 run osmo-stp_10.42.42.5(pid=27742): ERR: Terminated: ERROR {rc=1} [trial-2377↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27742)] 17:12:56.989499 run osmo-stp_10.42.42.5(pid=27742): stdout: | (launched: 2022-12-10_17:12:55.668462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:57.117759 run osmo-stp_10.42.42.5(pid=27742): stderr: | 20221210171255841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171255841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171255842 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171255842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171255842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171255842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171255842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:57.243705 run osmo-stp_10.42.42.5(pid=27742): stdout: | (launched: 2022-12-10_17:12:55.668462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:57.363473 run osmo-stp_10.42.42.5(pid=27742): stderr: | 20221210171255841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171255841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171255842 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171255842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171255842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171255842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171255842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:57.507096 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=27742): Process ended prematurely: osmo-stp_10.42.42.5(pid=27742) [trial-2377↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27742)] [trial-2377↪ussd:sysmo↪assert_extension.py:17] 17:12:57.515336 tst assert_extension.py:17: Test FAILED (5.8 sec) 17:12:57.541356 run osmo-hlr_10.42.42.2(pid=27739): ERR: Terminated: ERROR {rc=237} [trial-2377↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27739)] 17:12:57.589508 run osmo-hlr_10.42.42.2(pid=27739): stdout: | (launched: 2022-12-10_17:12:54.718890) 17:12:57.638903 run osmo-hlr_10.42.42.2(pid=27739): stderr: | 20221210171254895 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171254895 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171254895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171254895 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171254895 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171254895 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171254941 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171254952 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171254952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171254952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:12:57.707685 run osmo-msc_10.42.42.6(pid=27745): ERR: Terminated: ERROR {rc=2} [trial-2377↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27745)] 17:12:57.755585 run osmo-msc_10.42.42.6(pid=27745): stdout: | (launched: 2022-12-10_17:12:56.634589) 17:12:57.804900 run osmo-msc_10.42.42.6(pid=27745): stderr: | 20221210171256910 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171256910 DLGLOBAL DEBUG validating counter group 0x7f54c72e0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171256910 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171256910 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171256910 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171256911 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171256912 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171256913 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171256913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171256913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:12:57.854760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27738): Terminating (SIGTERM) 17:12:57.894497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27741): Terminating (SIGTERM) 17:12:57.934236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27744): Terminating (SIGTERM) 17:12:57.973987 --- ParallelTerminationStrategy: PID 27738 died... 17:12:57.992807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27738): Terminated: ok {rc=0} 17:12:58.036461 --- ParallelTerminationStrategy: PID 27741 died... 17:12:58.055002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27741): Terminated: ok {rc=0} 17:12:58.098948 --- ParallelTerminationStrategy: PID 27744 died... 17:12:58.117451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27744): Terminated: ok {rc=0} 17:12:58.201789 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:12:59.402675 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:12:59.410255 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:12:59.431180 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:12:59.458227 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:12:59.512048 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:12:59.534060 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:12:59.562673 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:13:00.111923 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:13:00.167212 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:00.178992 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:13:00.241430 tst mo_mt_call.py: using LAC 29405 17:13:00.370466 tst mo_mt_call.py: using RAC 80 17:13:00.544456 tst mo_mt_call.py: using CellId 29405 17:13:00.668141 tst mo_mt_call.py: using BVCI 29406 17:13:00.782396 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:00.793631 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:00.804671 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:00.815732 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:00.826866 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:00.840497 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:13:00.965887 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:13:01.089909 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:01.632763 run create_hlr_db(pid=27750): Launched 17:13:01.793716 bus /sierra_2: Setting Powered False 17:13:02.855125 run create_hlr_db(pid=27750): Terminated: ok {rc=0} 17:13:03.300357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27752): Launched 17:13:03.611023 run osmo-hlr_10.42.42.2(pid=27753): Launched 17:13:03.728672 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:04.258727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27755): Launched 17:13:04.570164 run osmo-stp_10.42.42.5(pid=27756): Launched 17:13:04.685655 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:05.242288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27758): Launched 17:13:05.550709 run osmo-msc_10.42.42.6(pid=27759): Launched 17:13:05.848564 run osmo-stp_10.42.42.5(pid=27756): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27756)] 17:13:05.976520 run osmo-stp_10.42.42.5(pid=27756): stdout: | (launched: 2022-12-10_17:13:04.511531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:06.105038 run osmo-stp_10.42.42.5(pid=27756): stderr: | 20221210171304688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171304688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171304688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171304689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171304689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171304689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171304689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:06.232400 run osmo-stp_10.42.42.5(pid=27756): stdout: | (launched: 2022-12-10_17:13:04.511531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:06.354480 run osmo-stp_10.42.42.5(pid=27756): stderr: | 20221210171304688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171304688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171304688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171304689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171304689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171304689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171304689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:06.500179 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27756): Process ended prematurely: osmo-stp_10.42.42.5(pid=27756) [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27756)] [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:13:06.509072 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:13:06.535212 run osmo-hlr_10.42.42.2(pid=27753): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27753)] 17:13:06.582747 run osmo-hlr_10.42.42.2(pid=27753): stdout: | (launched: 2022-12-10_17:13:03.552906) 17:13:06.632315 run osmo-hlr_10.42.42.2(pid=27753): stderr: | 20221210171303730 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171303730 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171303730 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171303730 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171303731 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171303731 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171303770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171303781 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171303781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171303781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:06.700861 run osmo-msc_10.42.42.6(pid=27759): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27759)] 17:13:06.748898 run osmo-msc_10.42.42.6(pid=27759): stdout: | (launched: 2022-12-10_17:13:05.492298) 17:13:06.798273 run osmo-msc_10.42.42.6(pid=27759): stderr: | 20221210171305776 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171305777 DLGLOBAL DEBUG validating counter group 0x7f5ff3996c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171305777 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171305777 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171305777 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171305777 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171305779 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171305779 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171305779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171305779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:06.848053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27752): Terminating (SIGTERM) 17:13:06.887828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27755): Terminating (SIGTERM) 17:13:06.927292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27758): Terminating (SIGTERM) 17:13:06.967146 --- ParallelTerminationStrategy: PID 27752 died... 17:13:06.986019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27752): Terminated: ok {rc=0} 17:13:07.030250 --- ParallelTerminationStrategy: PID 27755 died... 17:13:07.048677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27755): Terminated: ok {rc=0} 17:13:07.092376 --- ParallelTerminationStrategy: PID 27758 died... 17:13:07.111038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27758): Terminated: ok {rc=0} 17:13:07.194465 bus /sierra_3: Setting Powered False 17:13:08.292534 bus /sierra_3: Setting Powered False 17:13:09.409504 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:13:10.559887 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:10.572270 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:13:10.630382 tst mo_mt_call_osmux.py: using LAC 29406 17:13:10.761172 tst mo_mt_call_osmux.py: using RAC 81 17:13:10.889774 tst mo_mt_call_osmux.py: using CellId 29406 17:13:11.068247 tst mo_mt_call_osmux.py: using BVCI 29407 17:13:11.213145 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:11.226223 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:11.237188 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:11.247942 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:11.258894 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:11.269829 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:13:11.388551 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:13:11.512518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:11.993208 run create_hlr_db(pid=27761): Launched 17:13:12.121717 bus /sierra_2: Setting Powered False 17:13:13.182823 run create_hlr_db(pid=27761): Terminated: ok {rc=0} 17:13:13.632394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27763): Launched 17:13:13.963877 run osmo-hlr_10.42.42.2(pid=27764): Launched 17:13:14.089655 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:14.657350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27766): Launched 17:13:14.988332 run osmo-stp_10.42.42.5(pid=27767): Launched 17:13:15.113918 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:15.711053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27769): Launched 17:13:16.058893 run osmo-msc_10.42.42.6(pid=27770): Launched 17:13:16.392559 run osmo-stp_10.42.42.5(pid=27767): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27767)] 17:13:16.613335 run osmo-stp_10.42.42.5(pid=27767): stdout: | (launched: 2022-12-10_17:13:14.926461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:16.779259 run osmo-stp_10.42.42.5(pid=27767): stderr: | 20221210171315123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171315123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171315123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171315124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171315124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171315124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171315124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:16.987555 run osmo-stp_10.42.42.5(pid=27767): stdout: | (launched: 2022-12-10_17:13:14.926461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:17.119052 run osmo-stp_10.42.42.5(pid=27767): stderr: | 20221210171315123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171315123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171315123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171315124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171315124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171315124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171315124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:17.269606 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27767): Process ended prematurely: osmo-stp_10.42.42.5(pid=27767) [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27767)] [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:13:17.279527 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 17:13:17.306333 run osmo-hlr_10.42.42.2(pid=27764): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27764)] 17:13:17.355584 run osmo-hlr_10.42.42.2(pid=27764): stdout: | (launched: 2022-12-10_17:13:13.902154) 17:13:17.405843 run osmo-hlr_10.42.42.2(pid=27764): stderr: | 20221210171314102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171314103 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171314103 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171314103 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171314103 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171314103 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171314147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171314157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171314158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171314158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:17.476195 run osmo-msc_10.42.42.6(pid=27770): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27770)] 17:13:17.525514 run osmo-msc_10.42.42.6(pid=27770): stdout: | (launched: 2022-12-10_17:13:15.997387) 17:13:17.575782 run osmo-msc_10.42.42.6(pid=27770): stderr: | 20221210171316610 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171316610 DLGLOBAL DEBUG validating counter group 0x7fb0c08a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171316610 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171316610 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171316610 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171316611 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171316612 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171316617 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171316617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171316617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:17.626075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27763): Terminating (SIGTERM) 17:13:17.666278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27766): Terminating (SIGTERM) 17:13:17.706462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27769): Terminating (SIGTERM) 17:13:17.746666 --- ParallelTerminationStrategy: PID 27763 died... 17:13:17.765954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27763): Terminated: ok {rc=0} 17:13:17.810424 --- ParallelTerminationStrategy: PID 27766 died... 17:13:17.829208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27766): Terminated: ok {rc=0} 17:13:17.874098 --- ParallelTerminationStrategy: PID 27769 died... 17:13:17.892850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27769): Terminated: ok {rc=0} 17:13:17.978862 bus /sierra_3: Setting Powered False 17:13:19.080181 bus /sierra_3: Setting Powered False 17:13:20.197424 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:13:21.433837 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:13:21.439960 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:13:21.461827 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:13:21.489306 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:13:21.543496 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:13:21.564608 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:13:21.591999 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:13:22.145623 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:13:22.195369 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:22.206614 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:13:22.264138 tst mo_mt_call.py: using LAC 29407 17:13:22.391469 tst mo_mt_call.py: using RAC 82 17:13:22.512267 tst mo_mt_call.py: using CellId 29407 17:13:22.631677 tst mo_mt_call.py: using BVCI 29408 17:13:22.743478 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:22.754596 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:22.765402 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:22.776689 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:22.788137 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:22.799522 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:13:22.920564 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:13:23.040513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:23.554312 run create_hlr_db(pid=27775): Launched 17:13:23.680475 bus /sierra_2: Setting Powered False 17:13:24.745589 run create_hlr_db(pid=27775): Terminated: ok {rc=0} 17:13:25.204721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27777): Launched 17:13:25.537523 run osmo-hlr_10.42.42.2(pid=27778): Launched 17:13:25.664046 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:26.232439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27780): Launched 17:13:26.563138 run osmo-stp_10.42.42.5(pid=27781): Launched 17:13:26.692203 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:27.291986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27783): Launched 17:13:27.609264 run osmo-msc_10.42.42.6(pid=27784): Launched 17:13:27.781959 run osmo-stp_10.42.42.5(pid=27781): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27781)] 17:13:27.912752 run osmo-stp_10.42.42.5(pid=27781): stdout: | (launched: 2022-12-10_17:13:26.500395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:28.043753 run osmo-stp_10.42.42.5(pid=27781): stderr: | 20221210171326698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171326698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171326698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171326699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171326699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171326699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171326699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:28.172228 run osmo-stp_10.42.42.5(pid=27781): stdout: | (launched: 2022-12-10_17:13:26.500395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:28.294722 run osmo-stp_10.42.42.5(pid=27781): stderr: | 20221210171326698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171326698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171326698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171326699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171326699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171326699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171326699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:28.441673 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27781): Process ended prematurely: osmo-stp_10.42.42.5(pid=27781) [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27781)] [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:13:28.450552 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:13:28.476788 run osmo-hlr_10.42.42.2(pid=27778): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27778)] 17:13:28.525098 run osmo-hlr_10.42.42.2(pid=27778): stdout: | (launched: 2022-12-10_17:13:25.475313) 17:13:28.574734 run osmo-hlr_10.42.42.2(pid=27778): stderr: | 20221210171325678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171325678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171325678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171325678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171325678 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171325678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171325694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171325704 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171325704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171325704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:28.643770 run osmo-msc_10.42.42.6(pid=27784): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27784)] 17:13:28.691963 run osmo-msc_10.42.42.6(pid=27784): stdout: | (launched: 2022-12-10_17:13:27.550384) 17:13:28.741658 run osmo-msc_10.42.42.6(pid=27784): stderr: | 20221210171327827 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171327828 DLGLOBAL DEBUG validating counter group 0x7f4b80cc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171327828 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171327828 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171327828 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171327828 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171327830 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171327830 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171327830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171327831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:28.791590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27777): Terminating (SIGTERM) 17:13:28.831295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27780): Terminating (SIGTERM) 17:13:28.870922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27783): Terminating (SIGTERM) 17:13:28.911525 --- ParallelTerminationStrategy: PID 27777 died... 17:13:28.930831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27777): Terminated: ok {rc=0} 17:13:28.975130 --- ParallelTerminationStrategy: PID 27780 died... 17:13:28.993798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27780): Terminated: ok {rc=0} 17:13:29.037873 --- ParallelTerminationStrategy: PID 27783 died... 17:13:29.056445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27783): Terminated: ok {rc=0} 17:13:29.140159 bus /sierra_3: Setting Powered False 17:13:30.238399 bus /sierra_3: Setting Powered False 17:13:31.369878 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:13:32.515252 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:32.527063 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:13:32.583760 tst mo_mt_call_osmux.py: using LAC 29408 17:13:32.706496 tst mo_mt_call_osmux.py: using RAC 83 17:13:32.829377 tst mo_mt_call_osmux.py: using CellId 29408 17:13:32.955686 tst mo_mt_call_osmux.py: using BVCI 29409 17:13:33.068629 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:33.079970 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:33.090930 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:33.101920 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:33.112801 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:33.123797 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:13:33.242705 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:13:33.363848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:33.878267 run create_hlr_db(pid=27786): Launched 17:13:34.004093 bus /sierra_2: Setting Powered False 17:13:35.069336 run create_hlr_db(pid=27786): Terminated: ok {rc=0} 17:13:35.511423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27788): Launched 17:13:35.822375 run osmo-hlr_10.42.42.2(pid=27789): Launched 17:13:35.939828 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:36.477090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27791): Launched 17:13:36.786946 run osmo-stp_10.42.42.5(pid=27792): Launched 17:13:36.904062 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:37.466543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27794): Launched 17:13:37.776749 run osmo-msc_10.42.42.6(pid=27795): Launched 17:13:37.948630 run osmo-stp_10.42.42.5(pid=27792): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27792)] 17:13:38.083448 run osmo-stp_10.42.42.5(pid=27792): stdout: | (launched: 2022-12-10_17:13:36.728192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:38.214040 run osmo-stp_10.42.42.5(pid=27792): stderr: | 20221210171336904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171336904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171336904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171336904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171336905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171336905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171336905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:38.342351 run osmo-stp_10.42.42.5(pid=27792): stdout: | (launched: 2022-12-10_17:13:36.728192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:38.464428 run osmo-stp_10.42.42.5(pid=27792): stderr: | 20221210171336904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171336904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171336904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171336904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171336905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171336905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171336905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:38.611174 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27792): Process ended prematurely: osmo-stp_10.42.42.5(pid=27792) [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27792)] [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:13:38.619954 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:13:38.646336 run osmo-hlr_10.42.42.2(pid=27789): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27789)] 17:13:38.694427 run osmo-hlr_10.42.42.2(pid=27789): stdout: | (launched: 2022-12-10_17:13:35.764006) 17:13:38.744150 run osmo-hlr_10.42.42.2(pid=27789): stderr: | 20221210171335943 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171335943 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171335943 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171335943 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171335943 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171335943 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171335956 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171335964 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171335964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171335964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:38.813693 run osmo-msc_10.42.42.6(pid=27795): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27795)] 17:13:38.862035 run osmo-msc_10.42.42.6(pid=27795): stdout: | (launched: 2022-12-10_17:13:37.718222) 17:13:38.911831 run osmo-msc_10.42.42.6(pid=27795): stderr: | 20221210171337993 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171337994 DLGLOBAL DEBUG validating counter group 0x7fab7922bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171337994 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171337994 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171337994 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171337994 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171337996 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171337996 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171337996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171337996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:38.961774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27788): Terminating (SIGTERM) 17:13:39.002166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27791): Terminating (SIGTERM) 17:13:39.042163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27794): Terminating (SIGTERM) 17:13:39.082434 --- ParallelTerminationStrategy: PID 27788 died... 17:13:39.101566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27788): Terminated: ok {rc=0} 17:13:39.145646 --- ParallelTerminationStrategy: PID 27791 died... 17:13:39.164241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27791): Terminated: ok {rc=0} 17:13:39.208207 --- ParallelTerminationStrategy: PID 27794 died... 17:13:39.226906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27794): Terminated: ok {rc=0} 17:13:39.310327 bus /sierra_3: Setting Powered False 17:13:40.406809 bus /sierra_3: Setting Powered False 17:13:41.522102 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:13:42.756613 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:13:42.763305 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:13:42.784096 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:13:42.810717 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:13:42.864016 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:13:42.884935 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:13:42.911709 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:13:43.460229 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:13:43.509422 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:43.520422 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:13:43.575981 tst mo_mt_call.py: using LAC 29409 17:13:43.698428 tst mo_mt_call.py: using RAC 84 17:13:43.820867 tst mo_mt_call.py: using CellId 29409 17:13:43.943150 tst mo_mt_call.py: using BVCI 29410 17:13:44.056479 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:44.067696 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:44.078588 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:44.089399 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:44.100155 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:44.111093 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:13:44.225325 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:13:44.340300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:44.822495 run create_hlr_db(pid=27802): Launched 17:13:44.947980 bus /sierra_2: Setting Powered False 17:13:46.011471 run create_hlr_db(pid=27802): Terminated: ok {rc=0} 17:13:46.483411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27804): Launched 17:13:46.857558 run osmo-hlr_10.42.42.2(pid=27805): Launched 17:13:47.102658 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:47.669811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27807): Launched 17:13:48.001660 run osmo-stp_10.42.42.5(pid=27808): Launched 17:13:48.127562 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:48.722533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27810): Launched 17:13:49.052692 run osmo-msc_10.42.42.6(pid=27811): Launched 17:13:49.235504 run osmo-stp_10.42.42.5(pid=27808): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27808)] 17:13:49.374335 run osmo-stp_10.42.42.5(pid=27808): stdout: | (launched: 2022-12-10_17:13:47.939819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:49.513388 run osmo-stp_10.42.42.5(pid=27808): stderr: | 20221210171348136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171348136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171348136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171348137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171348137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171348137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171348137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:49.651793 run osmo-stp_10.42.42.5(pid=27808): stdout: | (launched: 2022-12-10_17:13:47.939819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:49.782836 run osmo-stp_10.42.42.5(pid=27808): stderr: | 20221210171348136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171348136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171348136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171348137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171348137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171348137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171348137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:49.939261 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27808): Process ended prematurely: osmo-stp_10.42.42.5(pid=27808) [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27808)] [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:13:49.948727 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 17:13:49.977835 run osmo-hlr_10.42.42.2(pid=27805): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27805)] 17:13:50.028731 run osmo-hlr_10.42.42.2(pid=27805): stdout: | (launched: 2022-12-10_17:13:46.793996) 17:13:50.081134 run osmo-hlr_10.42.42.2(pid=27805): stderr: | 20221210171347046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171347046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171347046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171347046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171347046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171347046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171347083 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171347096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171347096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171347096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:50.153671 run osmo-msc_10.42.42.6(pid=27811): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27811)] 17:13:50.204149 run osmo-msc_10.42.42.6(pid=27811): stdout: | (launched: 2022-12-10_17:13:48.990863) 17:13:50.256132 run osmo-msc_10.42.42.6(pid=27811): stderr: | 20221210171349315 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171349315 DLGLOBAL DEBUG validating counter group 0x7f521cc13c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171349315 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171349315 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171349316 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171349316 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171349318 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171349318 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171349318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171349318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:50.308541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27804): Terminating (SIGTERM) 17:13:50.350534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27807): Terminating (SIGTERM) 17:13:50.392491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27810): Terminating (SIGTERM) 17:13:50.434784 --- ParallelTerminationStrategy: PID 27804 died... 17:13:50.454634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27804): Terminated: ok {rc=0} 17:13:50.501508 --- ParallelTerminationStrategy: PID 27807 died... 17:13:50.521413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27807): Terminated: ok {rc=0} 17:13:50.568433 --- ParallelTerminationStrategy: PID 27810 died... 17:13:50.587968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27810): Terminated: ok {rc=0} 17:13:50.677001 bus /sierra_3: Setting Powered False 17:13:51.776439 bus /sierra_3: Setting Powered False 17:13:52.893162 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:13:54.045335 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:54.057809 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:13:54.117153 tst mo_mt_call_osmux.py: using LAC 29410 17:13:54.247559 tst mo_mt_call_osmux.py: using RAC 85 17:13:54.376046 tst mo_mt_call_osmux.py: using CellId 29410 17:13:54.507282 tst mo_mt_call_osmux.py: using BVCI 29411 17:13:54.628556 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:54.640223 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:54.651751 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:54.663419 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:54.675104 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:54.686795 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:13:54.806279 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:13:54.922900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:55.406396 run create_hlr_db(pid=27813): Launched 17:13:55.532773 bus /sierra_2: Setting Powered False 17:13:56.593935 run create_hlr_db(pid=27813): Terminated: ok {rc=0} 17:13:57.022838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27815): Launched 17:13:57.333593 run osmo-hlr_10.42.42.2(pid=27816): Launched 17:13:57.450131 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:57.998186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27818): Launched 17:13:58.306859 run osmo-stp_10.42.42.5(pid=27819): Launched 17:13:58.423043 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:58.980359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27821): Launched 17:13:59.291436 run osmo-msc_10.42.42.6(pid=27822): Launched 17:13:59.464490 run osmo-stp_10.42.42.5(pid=27819): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27819)] 17:13:59.594377 run osmo-stp_10.42.42.5(pid=27819): stdout: | (launched: 2022-12-10_17:13:58.248594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:59.724524 run osmo-stp_10.42.42.5(pid=27819): stderr: | 20221210171358421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171358421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171358421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171358422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171358422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171358422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171358422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:59.852857 run osmo-stp_10.42.42.5(pid=27819): stdout: | (launched: 2022-12-10_17:13:58.248594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:59.975507 run osmo-stp_10.42.42.5(pid=27819): stderr: | 20221210171358421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171358421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171358421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171358422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171358422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171358422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171358422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:00.122156 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27819): Process ended prematurely: osmo-stp_10.42.42.5(pid=27819) [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27819)] [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:14:00.131105 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:14:00.157290 run osmo-hlr_10.42.42.2(pid=27816): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27816)] 17:14:00.204913 run osmo-hlr_10.42.42.2(pid=27816): stdout: | (launched: 2022-12-10_17:13:57.274786) 17:14:00.254467 run osmo-hlr_10.42.42.2(pid=27816): stderr: | 20221210171357453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171357454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171357454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171357454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171357454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171357454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171357466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171357476 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171357476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171357476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:00.323260 run osmo-msc_10.42.42.6(pid=27822): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27822)] 17:14:00.370948 run osmo-msc_10.42.42.6(pid=27822): stdout: | (launched: 2022-12-10_17:13:59.232414) 17:14:00.420386 run osmo-msc_10.42.42.6(pid=27822): stderr: | 20221210171359507 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171359507 DLGLOBAL DEBUG validating counter group 0x7fa3e115dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171359507 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171359507 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171359507 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171359507 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171359509 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171359509 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171359510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171359510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:00.470062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27815): Terminating (SIGTERM) 17:14:00.509741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27818): Terminating (SIGTERM) 17:14:00.549245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27821): Terminating (SIGTERM) 17:14:00.588879 --- ParallelTerminationStrategy: PID 27815 died... 17:14:00.607922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27815): Terminated: ok {rc=0} 17:14:00.651686 --- ParallelTerminationStrategy: PID 27818 died... 17:14:00.670177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27818): Terminated: ok {rc=0} 17:14:00.713831 --- ParallelTerminationStrategy: PID 27821 died... 17:14:00.732330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27821): Terminated: ok {rc=0} 17:14:00.817237 bus /sierra_3: Setting Powered False 17:14:01.920456 bus /sierra_3: Setting Powered False 17:14:03.047870 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:14:04.287591 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:14:04.294916 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:14:04.315619 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:14:04.343780 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:14:04.395332 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:14:04.416010 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:14:04.442038 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:14:04.993644 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:14:05.042444 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:05.053568 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:14:05.109935 tst mo_mt_call.py: using LAC 29411 17:14:05.231779 tst mo_mt_call.py: using RAC 86 17:14:05.354267 tst mo_mt_call.py: using CellId 29411 17:14:05.476429 tst mo_mt_call.py: using BVCI 29412 17:14:05.589414 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:05.600417 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:05.611271 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:05.622057 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:05.632709 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:05.643561 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:14:05.762284 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:14:05.880579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:06.359749 run create_hlr_db(pid=27829): Launched 17:14:06.486390 bus /sierra_2: Setting Powered False 17:14:07.546918 run create_hlr_db(pid=27829): Terminated: ok {rc=0} 17:14:07.996274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27831): Launched 17:14:08.326610 run osmo-hlr_10.42.42.2(pid=27832): Launched 17:14:08.451716 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:09.020682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27834): Launched 17:14:09.351067 run osmo-stp_10.42.42.5(pid=27835): Launched 17:14:09.475886 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:10.074288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27837): Launched 17:14:10.406642 run osmo-msc_10.42.42.6(pid=27838): Launched 17:14:10.592715 run osmo-stp_10.42.42.5(pid=27835): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27835)] 17:14:10.730837 run osmo-stp_10.42.42.5(pid=27835): stdout: | (launched: 2022-12-10_17:14:09.289267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:10.869867 run osmo-stp_10.42.42.5(pid=27835): stderr: | 20221210171409485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171409485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171409485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171409486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171409486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171409486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171409486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:11.006710 run osmo-stp_10.42.42.5(pid=27835): stdout: | (launched: 2022-12-10_17:14:09.289267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:11.137263 run osmo-stp_10.42.42.5(pid=27835): stderr: | 20221210171409485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171409485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171409485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171409486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171409486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171409486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171409486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:11.293571 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27835): Process ended prematurely: osmo-stp_10.42.42.5(pid=27835) [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27835)] [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:14:11.303073 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:14:11.331477 run osmo-hlr_10.42.42.2(pid=27832): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27832)] 17:14:11.382015 run osmo-hlr_10.42.42.2(pid=27832): stdout: | (launched: 2022-12-10_17:14:08.264695) 17:14:11.434425 run osmo-hlr_10.42.42.2(pid=27832): stderr: | 20221210171408465 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171408465 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171408465 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171408465 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171408465 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171408465 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171408478 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171408486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171408486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171408486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:11.507321 run osmo-msc_10.42.42.6(pid=27838): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27838)] 17:14:11.558550 run osmo-msc_10.42.42.6(pid=27838): stdout: | (launched: 2022-12-10_17:14:10.344696) 17:14:11.611071 run osmo-msc_10.42.42.6(pid=27838): stderr: | 20221210171410668 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171410668 DLGLOBAL DEBUG validating counter group 0x7f5019762c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171410669 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171410669 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171410669 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171410669 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171410671 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171410671 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171410671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171410671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:11.663854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27831): Terminating (SIGTERM) 17:14:11.706074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27834): Terminating (SIGTERM) 17:14:11.748275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27837): Terminating (SIGTERM) 17:14:11.790769 --- ParallelTerminationStrategy: PID 27831 died... 17:14:11.810800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27831): Terminated: ok {rc=0} 17:14:11.858205 --- ParallelTerminationStrategy: PID 27834 died... 17:14:11.877857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27834): Terminated: ok {rc=0} 17:14:11.924423 --- ParallelTerminationStrategy: PID 27837 died... 17:14:11.944070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27837): Terminated: ok {rc=0} 17:14:12.033416 bus /sierra_3: Setting Powered False 17:14:13.133652 bus /sierra_3: Setting Powered False 17:14:14.250429 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:14:15.395292 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:15.407250 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:14:15.463965 tst mo_mt_call_osmux.py: using LAC 29412 17:14:15.587034 tst mo_mt_call_osmux.py: using RAC 87 17:14:15.709858 tst mo_mt_call_osmux.py: using CellId 29412 17:14:15.832441 tst mo_mt_call_osmux.py: using BVCI 29413 17:14:15.971334 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:15.983038 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:15.994448 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:16.005762 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:16.017104 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:16.028425 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:14:16.167546 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:14:16.285712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:16.779482 run create_hlr_db(pid=27840): Launched 17:14:16.942686 bus /sierra_2: Setting Powered False 17:14:18.004128 run create_hlr_db(pid=27840): Terminated: ok {rc=0} 17:14:18.435643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27842): Launched 17:14:18.747157 run osmo-hlr_10.42.42.2(pid=27843): Launched 17:14:18.864593 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:19.398426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27845): Launched 17:14:19.708702 run osmo-stp_10.42.42.5(pid=27846): Launched 17:14:19.825910 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:20.383587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27848): Launched 17:14:20.694334 run osmo-msc_10.42.42.6(pid=27849): Launched 17:14:20.865453 run osmo-stp_10.42.42.5(pid=27846): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27846)] 17:14:20.995439 run osmo-stp_10.42.42.5(pid=27846): stdout: | (launched: 2022-12-10_17:14:19.650001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:21.125453 run osmo-stp_10.42.42.5(pid=27846): stderr: | 20221210171419823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171419823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171419823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171419823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171419824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171419824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171419824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:21.253552 run osmo-stp_10.42.42.5(pid=27846): stdout: | (launched: 2022-12-10_17:14:19.650001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:21.376319 run osmo-stp_10.42.42.5(pid=27846): stderr: | 20221210171419823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171419823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171419823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171419823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171419824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171419824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171419824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:21.522558 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27846): Process ended prematurely: osmo-stp_10.42.42.5(pid=27846) [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27846)] [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:14:21.531446 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:14:21.557740 run osmo-hlr_10.42.42.2(pid=27843): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27843)] 17:14:21.605636 run osmo-hlr_10.42.42.2(pid=27843): stdout: | (launched: 2022-12-10_17:14:18.687987) 17:14:21.655528 run osmo-hlr_10.42.42.2(pid=27843): stderr: | 20221210171418867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171418867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171418867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171418867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171418867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171418868 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171418882 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171418892 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171418892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171418892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:21.724630 run osmo-msc_10.42.42.6(pid=27849): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27849)] 17:14:21.772371 run osmo-msc_10.42.42.6(pid=27849): stdout: | (launched: 2022-12-10_17:14:20.635584) 17:14:21.821918 run osmo-msc_10.42.42.6(pid=27849): stderr: | 20221210171420910 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171420910 DLGLOBAL DEBUG validating counter group 0x7fbc7de55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171420910 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171420910 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171420910 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171420911 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171420912 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171420913 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171420913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171420913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:21.871446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27842): Terminating (SIGTERM) 17:14:21.911411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27845): Terminating (SIGTERM) 17:14:21.950729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27848): Terminating (SIGTERM) 17:14:21.990341 --- ParallelTerminationStrategy: PID 27842 died... 17:14:22.009399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27842): Terminated: ok {rc=0} 17:14:22.053267 --- ParallelTerminationStrategy: PID 27845 died... 17:14:22.071725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27845): Terminated: ok {rc=0} 17:14:22.115542 --- ParallelTerminationStrategy: PID 27848 died... 17:14:22.133980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27848): Terminated: ok {rc=0} 17:14:22.219361 bus /sierra_3: Setting Powered False 17:14:23.320140 bus /sierra_3: Setting Powered False 17:14:24.436276 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:14:25.675561 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:14:25.682613 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:14:25.705480 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:14:25.734306 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:14:25.788227 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:14:25.809848 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:14:25.837945 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:14:26.388716 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:14:26.442182 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:26.453888 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:14:26.517556 tst mo_mt_call.py: using LAC 29413 17:14:26.650033 tst mo_mt_call.py: using RAC 88 17:14:26.777929 tst mo_mt_call.py: using CellId 29413 17:14:26.905452 tst mo_mt_call.py: using BVCI 29414 17:14:27.018787 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:27.030163 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:27.041159 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:27.052133 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:27.063309 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:27.074442 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:14:27.188353 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:14:27.308580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:27.794531 run create_hlr_db(pid=27854): Launched 17:14:27.920801 bus /sierra_2: Setting Powered False 17:14:28.982027 run create_hlr_db(pid=27854): Terminated: ok {rc=0} 17:14:29.414425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27856): Launched 17:14:29.726165 run osmo-hlr_10.42.42.2(pid=27857): Launched 17:14:29.842712 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:30.375647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27859): Launched 17:14:30.687801 run osmo-stp_10.42.42.5(pid=27860): Launched 17:14:30.805368 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:31.433715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27862): Launched 17:14:31.764705 run osmo-msc_10.42.42.6(pid=27863): Launched 17:14:32.101338 run osmo-stp_10.42.42.5(pid=27860): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27860)] 17:14:32.318443 run osmo-stp_10.42.42.5(pid=27860): stdout: | (launched: 2022-12-10_17:14:30.628742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:32.450058 run osmo-stp_10.42.42.5(pid=27860): stderr: | 20221210171430801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171430801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171430801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171430802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171430802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171430802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171430802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:32.579805 run osmo-stp_10.42.42.5(pid=27860): stdout: | (launched: 2022-12-10_17:14:30.628742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:32.703544 run osmo-stp_10.42.42.5(pid=27860): stderr: | 20221210171430801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171430801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171430801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171430802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171430802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171430802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171430802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:32.851709 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27860): Process ended prematurely: osmo-stp_10.42.42.5(pid=27860) [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27860)] [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:14:32.860569 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 17:14:32.887116 run osmo-hlr_10.42.42.2(pid=27857): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27857)] 17:14:32.935287 run osmo-hlr_10.42.42.2(pid=27857): stdout: | (launched: 2022-12-10_17:14:29.666999) 17:14:32.985086 run osmo-hlr_10.42.42.2(pid=27857): stderr: | 20221210171429847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171429847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171429847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171429847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171429847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171429848 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171429867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171429878 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171429878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171429879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:33.054142 run osmo-msc_10.42.42.6(pid=27863): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27863)] 17:14:33.102226 run osmo-msc_10.42.42.6(pid=27863): stdout: | (launched: 2022-12-10_17:14:31.700541) 17:14:33.152360 run osmo-msc_10.42.42.6(pid=27863): stderr: | 20221210171432232 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171432232 DLGLOBAL DEBUG validating counter group 0x7f16eed49c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171432232 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171432232 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171432232 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171432232 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171432234 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171432235 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171432235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171432235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:33.202337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27856): Terminating (SIGTERM) 17:14:33.242484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27859): Terminating (SIGTERM) 17:14:33.282696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27862): Terminating (SIGTERM) 17:14:33.323025 --- ParallelTerminationStrategy: PID 27856 died... 17:14:33.342296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27856): Terminated: ok {rc=0} 17:14:33.386821 --- ParallelTerminationStrategy: PID 27859 died... 17:14:33.405643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27859): Terminated: ok {rc=0} 17:14:33.450961 --- ParallelTerminationStrategy: PID 27862 died... 17:14:33.469714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27862): Terminated: ok {rc=0} 17:14:33.556365 bus /sierra_3: Setting Powered False 17:14:34.657283 bus /sierra_3: Setting Powered False 17:14:35.776125 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:14:36.924862 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:36.936762 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:14:36.993436 tst mo_mt_call_osmux.py: using LAC 29414 17:14:37.124916 tst mo_mt_call_osmux.py: using RAC 89 17:14:37.248668 tst mo_mt_call_osmux.py: using CellId 29414 17:14:37.371844 tst mo_mt_call_osmux.py: using BVCI 29415 17:14:37.485093 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:37.496395 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:37.507493 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:37.518401 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:37.529252 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:37.540120 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:14:37.660746 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:14:37.782501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:38.263862 run create_hlr_db(pid=27865): Launched 17:14:38.389817 bus /sierra_2: Setting Powered False 17:14:39.451177 run create_hlr_db(pid=27865): Terminated: ok {rc=0} 17:14:39.900416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27867): Launched 17:14:40.231789 run osmo-hlr_10.42.42.2(pid=27868): Launched 17:14:40.357454 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:40.924507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27870): Launched 17:14:41.255105 run osmo-stp_10.42.42.5(pid=27871): Launched 17:14:41.380852 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:41.977798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27873): Launched 17:14:42.308417 run osmo-msc_10.42.42.6(pid=27874): Launched 17:14:42.491086 run osmo-stp_10.42.42.5(pid=27871): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27871)] 17:14:42.630517 run osmo-stp_10.42.42.5(pid=27871): stdout: | (launched: 2022-12-10_17:14:41.193409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:42.769731 run osmo-stp_10.42.42.5(pid=27871): stderr: | 20221210171441390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171441390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171441390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171441391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171441391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171441391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171441391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:42.907886 run osmo-stp_10.42.42.5(pid=27871): stdout: | (launched: 2022-12-10_17:14:41.193409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:43.039130 run osmo-stp_10.42.42.5(pid=27871): stderr: | 20221210171441390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171441390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171441390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171441391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171441391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171441391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171441391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:43.196004 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27871): Process ended prematurely: osmo-stp_10.42.42.5(pid=27871) [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27871)] [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:14:43.206006 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:14:43.234576 run osmo-hlr_10.42.42.2(pid=27868): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27868)] 17:14:43.285249 run osmo-hlr_10.42.42.2(pid=27868): stdout: | (launched: 2022-12-10_17:14:40.170040) 17:14:43.337638 run osmo-hlr_10.42.42.2(pid=27868): stderr: | 20221210171440370 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171440370 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171440370 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171440370 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171440370 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171440370 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171440383 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171440393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171440393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171440394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:43.410169 run osmo-msc_10.42.42.6(pid=27874): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27874)] 17:14:43.460681 run osmo-msc_10.42.42.6(pid=27874): stdout: | (launched: 2022-12-10_17:14:42.246602) 17:14:43.513140 run osmo-msc_10.42.42.6(pid=27874): stderr: | 20221210171442571 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171442571 DLGLOBAL DEBUG validating counter group 0x7fa45848fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171442571 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171442572 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171442572 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171442572 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171442574 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171442574 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171442574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171442574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:43.566518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27867): Terminating (SIGTERM) 17:14:43.608745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27870): Terminating (SIGTERM) 17:14:43.650852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27873): Terminating (SIGTERM) 17:14:43.693168 --- ParallelTerminationStrategy: PID 27867 died... 17:14:43.713114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27867): Terminated: ok {rc=0} 17:14:43.759810 --- ParallelTerminationStrategy: PID 27870 died... 17:14:43.779451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27870): Terminated: ok {rc=0} 17:14:43.826677 --- ParallelTerminationStrategy: PID 27873 died... 17:14:43.846234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27873): Terminated: ok {rc=0} 17:14:43.934502 bus /sierra_3: Setting Powered False 17:14:45.032899 bus /sierra_3: Setting Powered False 17:14:46.148223 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:14:47.391908 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:14:47.399242 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:14:47.420073 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:14:47.446728 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:14:47.499088 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:14:47.520477 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:14:47.547426 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:14:48.098104 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:14:48.147088 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:48.158328 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:14:48.215156 tst mo_mt_call.py: using LAC 29415 17:14:48.336886 tst mo_mt_call.py: using RAC 90 17:14:48.458371 tst mo_mt_call.py: using CellId 29415 17:14:48.579935 tst mo_mt_call.py: using BVCI 29416 17:14:48.691474 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:48.702647 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:48.713607 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:48.724512 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:48.735454 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:48.746495 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:14:48.863619 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:14:48.979738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:49.462250 run create_hlr_db(pid=27879): Launched 17:14:49.588455 bus /sierra_2: Setting Powered False 17:14:50.649858 run create_hlr_db(pid=27879): Terminated: ok {rc=0} 17:14:51.100307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27881): Launched 17:14:51.432141 run osmo-hlr_10.42.42.2(pid=27882): Launched 17:14:51.559186 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:52.130948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27884): Launched 17:14:52.461596 run osmo-stp_10.42.42.5(pid=27885): Launched 17:14:52.587661 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:53.184713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27887): Launched 17:14:53.516370 run osmo-msc_10.42.42.6(pid=27888): Launched 17:14:53.703660 run osmo-stp_10.42.42.5(pid=27885): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27885)] 17:14:53.843831 run osmo-stp_10.42.42.5(pid=27885): stdout: | (launched: 2022-12-10_17:14:52.399630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:53.983710 run osmo-stp_10.42.42.5(pid=27885): stderr: | 20221210171452596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171452596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171452596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171452597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171452597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171452597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171452597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:54.122481 run osmo-stp_10.42.42.5(pid=27885): stdout: | (launched: 2022-12-10_17:14:52.399630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:54.254049 run osmo-stp_10.42.42.5(pid=27885): stderr: | 20221210171452596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171452596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171452596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171452597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171452597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171452597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171452597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:54.411339 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27885): Process ended prematurely: osmo-stp_10.42.42.5(pid=27885) [trial-2377↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27885)] [trial-2377↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:14:54.421134 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:14:54.449602 run osmo-hlr_10.42.42.2(pid=27882): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27882)] 17:14:54.501148 run osmo-hlr_10.42.42.2(pid=27882): stdout: | (launched: 2022-12-10_17:14:51.370157) 17:14:54.553955 run osmo-hlr_10.42.42.2(pid=27882): stderr: | 20221210171451573 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171451573 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171451573 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171451573 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171451573 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171451573 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171451585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171451593 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171451594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171451594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:54.627044 run osmo-msc_10.42.42.6(pid=27888): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27888)] 17:14:54.677941 run osmo-msc_10.42.42.6(pid=27888): stdout: | (launched: 2022-12-10_17:14:53.454409) 17:14:54.730494 run osmo-msc_10.42.42.6(pid=27888): stderr: | 20221210171453782 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171453782 DLGLOBAL DEBUG validating counter group 0x7f89f7f40c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171453782 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171453782 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171453782 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171453783 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171453784 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171453785 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171453785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171453785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:54.783297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27881): Terminating (SIGTERM) 17:14:54.825748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27884): Terminating (SIGTERM) 17:14:54.868394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27887): Terminating (SIGTERM) 17:14:54.910976 --- ParallelTerminationStrategy: PID 27881 died... 17:14:54.931111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27881): Terminated: ok {rc=0} 17:14:54.978475 --- ParallelTerminationStrategy: PID 27884 died... 17:14:54.998357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27884): Terminated: ok {rc=0} 17:14:55.045615 --- ParallelTerminationStrategy: PID 27887 died... 17:14:55.065409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27887): Terminated: ok {rc=0} 17:14:55.153487 bus /sierra_3: Setting Powered False 17:14:56.253402 bus /sierra_3: Setting Powered False 17:14:57.370528 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:14:58.519514 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:58.531649 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:14:58.589610 tst mo_mt_call_osmux.py: using LAC 29416 17:14:58.712330 tst mo_mt_call_osmux.py: using RAC 91 17:14:58.837028 tst mo_mt_call_osmux.py: using CellId 29416 17:14:58.960115 tst mo_mt_call_osmux.py: using BVCI 29417 17:14:59.073585 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:59.084779 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:59.095817 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:59.106722 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:59.117746 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:59.128785 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:14:59.247986 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:14:59.366053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:59.848431 run create_hlr_db(pid=27890): Launched 17:14:59.973423 bus /sierra_2: Setting Powered False 17:15:01.048168 run create_hlr_db(pid=27890): Terminated: ok {rc=0} 17:15:01.559676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27895): Launched 17:15:01.911482 run osmo-hlr_10.42.42.2(pid=27896): Launched 17:15:02.151582 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:02.811316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27898): Launched 17:15:03.142766 run osmo-stp_10.42.42.5(pid=27899): Launched 17:15:03.268071 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:03.865903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27901): Launched 17:15:04.198489 run osmo-msc_10.42.42.6(pid=27902): Launched 17:15:04.383582 run osmo-stp_10.42.42.5(pid=27899): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27899)] 17:15:04.522512 run osmo-stp_10.42.42.5(pid=27899): stdout: | (launched: 2022-12-10_17:15:03.080721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:04.662189 run osmo-stp_10.42.42.5(pid=27899): stderr: | 20221210171503276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171503276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171503278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171503278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171503279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171503279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171503279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:04.801089 run osmo-stp_10.42.42.5(pid=27899): stdout: | (launched: 2022-12-10_17:15:03.080721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:04.931639 run osmo-stp_10.42.42.5(pid=27899): stderr: | 20221210171503276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171503276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171503278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171503278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171503279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171503279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171503279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:05.088162 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27899): Process ended prematurely: osmo-stp_10.42.42.5(pid=27899) [trial-2377↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27899)] [trial-2377↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:15:05.098213 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 17:15:05.126428 run osmo-hlr_10.42.42.2(pid=27896): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27896)] 17:15:05.177256 run osmo-hlr_10.42.42.2(pid=27896): stdout: | (launched: 2022-12-10_17:15:01.846014) 17:15:05.229334 run osmo-hlr_10.42.42.2(pid=27896): stderr: | 20221210171502096 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171502096 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171502096 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171502098 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171502098 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171502098 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171502114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171502138 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171502140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171502140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:05.301756 run osmo-msc_10.42.42.6(pid=27902): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27902)] 17:15:05.352459 run osmo-msc_10.42.42.6(pid=27902): stdout: | (launched: 2022-12-10_17:15:04.136511) 17:15:05.404290 run osmo-msc_10.42.42.6(pid=27902): stderr: | 20221210171504463 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171504463 DLGLOBAL DEBUG validating counter group 0x7f107048ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171504463 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171504463 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171504464 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171504464 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171504465 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171504466 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171504466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171504466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:05.456571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27895): Terminating (SIGTERM) 17:15:05.498856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27898): Terminating (SIGTERM) 17:15:05.541045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27901): Terminating (SIGTERM) 17:15:05.583814 --- ParallelTerminationStrategy: PID 27895 died... 17:15:05.603785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27895): Terminated: ok {rc=0} 17:15:05.650866 --- ParallelTerminationStrategy: PID 27898 died... 17:15:05.670358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27898): Terminated: ok {rc=0} 17:15:05.717155 --- ParallelTerminationStrategy: PID 27901 died... 17:15:05.736621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27901): Terminated: ok {rc=0} 17:15:05.824283 bus /sierra_3: Setting Powered False 17:15:06.922128 bus /sierra_3: Setting Powered False 17:15:08.036803 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:15:09.271335 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:15:09.276849 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:15:09.298370 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:15:09.325072 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:15:09.378503 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:15:09.400352 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:15:09.426563 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:15:09.973583 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:15:10.022382 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:10.033400 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:15:10.090438 tst mo_mt_call.py: using LAC 29417 17:15:10.213317 tst mo_mt_call.py: using RAC 92 17:15:10.333994 tst mo_mt_call.py: using CellId 29417 17:15:10.454737 tst mo_mt_call.py: using BVCI 29418 17:15:10.568420 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:10.579598 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:10.590354 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:10.601029 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:10.611685 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:10.622477 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:15:10.741182 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:15:10.864163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:11.379118 run create_hlr_db(pid=27907): Launched 17:15:11.505730 bus /sierra_2: Setting Powered False 17:15:12.570859 run create_hlr_db(pid=27907): Terminated: ok {rc=0} 17:15:13.013176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27909): Launched 17:15:13.324243 run osmo-hlr_10.42.42.2(pid=27910): Launched 17:15:13.443045 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:13.997634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27912): Launched 17:15:14.309778 run osmo-stp_10.42.42.5(pid=27913): Launched 17:15:14.427538 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:14.989958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27915): Launched 17:15:15.301475 run osmo-msc_10.42.42.6(pid=27916): Launched 17:15:15.474795 run osmo-stp_10.42.42.5(pid=27913): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27913)] 17:15:15.606095 run osmo-stp_10.42.42.5(pid=27913): stdout: | (launched: 2022-12-10_17:15:14.250671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:15.736730 run osmo-stp_10.42.42.5(pid=27913): stderr: | 20221210171514424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171514424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171514424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171514425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171514427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171514427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171514427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:15.897198 run osmo-stp_10.42.42.5(pid=27913): stdout: | (launched: 2022-12-10_17:15:14.250671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:16.033163 run osmo-stp_10.42.42.5(pid=27913): stderr: | 20221210171514424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171514424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171514424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171514425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171514427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171514427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171514427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:16.196132 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27913): Process ended prematurely: osmo-stp_10.42.42.5(pid=27913) [trial-2377↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27913)] [trial-2377↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:15:16.206758 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:15:16.237967 run osmo-hlr_10.42.42.2(pid=27910): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27910)] 17:15:16.292223 run osmo-hlr_10.42.42.2(pid=27910): stdout: | (launched: 2022-12-10_17:15:13.265695) 17:15:16.346863 run osmo-hlr_10.42.42.2(pid=27910): stderr: | 20221210171513442 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171513442 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171513442 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171513442 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171513442 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171513442 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171513454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171513462 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171513462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171513463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:16.422892 run osmo-msc_10.42.42.6(pid=27916): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27916)] 17:15:16.476410 run osmo-msc_10.42.42.6(pid=27916): stdout: | (launched: 2022-12-10_17:15:15.242930) 17:15:16.532578 run osmo-msc_10.42.42.6(pid=27916): stderr: | 20221210171515521 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171515521 DLGLOBAL DEBUG validating counter group 0x7f2dad09ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171515521 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171515521 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171515521 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171515522 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171515523 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171515524 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171515524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171515524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:16.588281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27909): Terminating (SIGTERM) 17:15:16.633258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27912): Terminating (SIGTERM) 17:15:16.680503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27915): Terminating (SIGTERM) 17:15:16.728245 --- ParallelTerminationStrategy: PID 27909 died... 17:15:16.749327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27909): Terminated: ok {rc=0} 17:15:16.800163 --- ParallelTerminationStrategy: PID 27912 died... 17:15:16.820465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27912): Terminated: ok {rc=0} 17:15:16.870449 --- ParallelTerminationStrategy: PID 27915 died... 17:15:16.891978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27915): Terminated: ok {rc=0} 17:15:16.984419 bus /sierra_3: Setting Powered False 17:15:18.085152 bus /sierra_3: Setting Powered False 17:15:19.200753 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:15:20.351743 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:20.364125 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:15:20.424215 tst mo_mt_call_osmux.py: using LAC 29418 17:15:20.554761 tst mo_mt_call_osmux.py: using RAC 93 17:15:20.685183 tst mo_mt_call_osmux.py: using CellId 29418 17:15:20.813756 tst mo_mt_call_osmux.py: using BVCI 29419 17:15:20.925752 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:20.936808 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:20.947601 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:20.958471 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:20.969389 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:20.980353 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:15:21.099980 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:15:21.220734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:21.733979 run create_hlr_db(pid=27918): Launched 17:15:21.860236 bus /sierra_2: Setting Powered False 17:15:22.924838 run create_hlr_db(pid=27918): Terminated: ok {rc=0} 17:15:23.367453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27920): Launched 17:15:23.678918 run osmo-hlr_10.42.42.2(pid=27921): Launched 17:15:23.796475 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:24.331162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27923): Launched 17:15:24.641374 run osmo-stp_10.42.42.5(pid=27924): Launched 17:15:24.758638 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:25.319128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27926): Launched 17:15:25.628748 run osmo-msc_10.42.42.6(pid=27927): Launched 17:15:25.800459 run osmo-stp_10.42.42.5(pid=27924): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27924)] 17:15:25.931361 run osmo-stp_10.42.42.5(pid=27924): stdout: | (launched: 2022-12-10_17:15:24.583023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:26.061461 run osmo-stp_10.42.42.5(pid=27924): stderr: | 20221210171524757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171524757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171524757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171524758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171524758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171524758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171524758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:26.189419 run osmo-stp_10.42.42.5(pid=27924): stdout: | (launched: 2022-12-10_17:15:24.583023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:26.311524 run osmo-stp_10.42.42.5(pid=27924): stderr: | 20221210171524757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171524757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171524757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171524758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171524758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171524758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171524758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:26.458383 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27924): Process ended prematurely: osmo-stp_10.42.42.5(pid=27924) [trial-2377↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27924)] [trial-2377↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:15:26.467271 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:15:26.493751 run osmo-hlr_10.42.42.2(pid=27921): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27921)] 17:15:26.541971 run osmo-hlr_10.42.42.2(pid=27921): stdout: | (launched: 2022-12-10_17:15:23.620397) 17:15:26.592206 run osmo-hlr_10.42.42.2(pid=27921): stderr: | 20221210171523799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171523799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171523799 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171523799 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171523799 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171523799 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171523811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171523820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171523820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171523820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:26.661448 run osmo-msc_10.42.42.6(pid=27927): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27927)] 17:15:26.709092 run osmo-msc_10.42.42.6(pid=27927): stdout: | (launched: 2022-12-10_17:15:25.570304) 17:15:26.758280 run osmo-msc_10.42.42.6(pid=27927): stderr: | 20221210171525847 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171525848 DLGLOBAL DEBUG validating counter group 0x7fc5d1099c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171525848 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171525848 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171525848 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171525848 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171525850 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171525850 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171525850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171525850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:26.807724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27920): Terminating (SIGTERM) 17:15:26.847438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27923): Terminating (SIGTERM) 17:15:26.886775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27926): Terminating (SIGTERM) 17:15:26.926411 --- ParallelTerminationStrategy: PID 27920 died... 17:15:26.945347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27920): Terminated: ok {rc=0} 17:15:26.989251 --- ParallelTerminationStrategy: PID 27923 died... 17:15:27.007893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27923): Terminated: ok {rc=0} 17:15:27.051754 --- ParallelTerminationStrategy: PID 27926 died... 17:15:27.070332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27926): Terminated: ok {rc=0} 17:15:27.156539 bus /sierra_3: Setting Powered False 17:15:28.255597 bus /sierra_3: Setting Powered False 17:15:29.368709 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 emergency:sysmo --------------------------------------------------------------------- 17:15:30.602640 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:15:30.607366 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 17:15:30.630478 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 17:15:30.660109 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 17:15:30.745168 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 17:15:30.766580 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 17:15:30.795435 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 17:15:31.381748 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2377 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 17:15:31.389957 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:31.406168 tst emergency:sysmo: Using 1 x bts (candidates: 1) 17:15:31.447561 tst emergency_mo_mt_call.py: using LAC 29419 17:15:31.570489 tst emergency_mo_mt_call.py: using RAC 94 17:15:31.700926 tst emergency_mo_mt_call.py: using CellId 29419 17:15:31.873613 tst emergency_mo_mt_call.py: using BVCI 29420 17:15:31.987759 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:31.998837 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:32.009863 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:32.020871 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:32.031941 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:32.044066 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:32.160817 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:32.278182 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:32.753699 run create_hlr_db(pid=27932): Launched 17:15:32.877735 bus /sierra_2: Setting Powered False 17:15:33.938789 run create_hlr_db(pid=27932): Terminated: ok {rc=0} 17:15:34.385532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27934): Launched 17:15:34.713248 run osmo-hlr_10.42.42.2(pid=27935): Launched 17:15:34.835522 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:35.399109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27937): Launched 17:15:35.725521 run osmo-stp_10.42.42.5(pid=27938): Launched 17:15:35.858807 tst emergency_mo_mt_call.py: using MSISDN 7817 17:15:36.030531 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:36.615130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27940): Launched 17:15:36.941803 run osmo-msc_10.42.42.6(pid=27941): Launched 17:15:37.123081 run osmo-stp_10.42.42.5(pid=27938): ERR: Terminated: ERROR {rc=1} [trial-2377↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27938)] 17:15:37.260151 run osmo-stp_10.42.42.5(pid=27938): stdout: | (launched: 2022-12-10_17:15:35.664244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:37.398102 run osmo-stp_10.42.42.5(pid=27938): stderr: | 20221210171535859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171535859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171535859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171535859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171535860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171535860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171535860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:37.534869 run osmo-stp_10.42.42.5(pid=27938): stdout: | (launched: 2022-12-10_17:15:35.664244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:37.664607 run osmo-stp_10.42.42.5(pid=27938): stderr: | 20221210171535859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171535859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171535859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171535859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171535860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171535860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171535860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:37.819390 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=27938): Process ended prematurely: osmo-stp_10.42.42.5(pid=27938) [trial-2377↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27938)] [trial-2377↪emergency:sysmo↪emergency_mo_mt_call.py:19] 17:15:37.828437 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 17:15:37.856799 run osmo-hlr_10.42.42.2(pid=27935): ERR: Terminated: ERROR {rc=237} [trial-2377↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27935)] 17:15:37.907927 run osmo-hlr_10.42.42.2(pid=27935): stdout: | (launched: 2022-12-10_17:15:34.651959) 17:15:37.960813 run osmo-hlr_10.42.42.2(pid=27935): stderr: | 20221210171534852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171534852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171534852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171534852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171534852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171534852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171534864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171534873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171534873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171534873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:38.033986 run osmo-msc_10.42.42.6(pid=27941): ERR: Terminated: ERROR {rc=2} [trial-2377↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27941)] 17:15:38.084859 run osmo-msc_10.42.42.6(pid=27941): stdout: | (launched: 2022-12-10_17:15:36.880333) 17:15:38.137422 run osmo-msc_10.42.42.6(pid=27941): stderr: | 20221210171537204 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171537204 DLGLOBAL DEBUG validating counter group 0x7f92d1fdec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171537204 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171537204 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171537205 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171537205 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171537207 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171537207 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171537207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171537207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:38.190532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27934): Terminating (SIGTERM) 17:15:38.233182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27937): Terminating (SIGTERM) 17:15:38.275663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27940): Terminating (SIGTERM) 17:15:38.319177 --- ParallelTerminationStrategy: PID 27934 died... 17:15:38.339434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27934): Terminated: ok {rc=0} 17:15:38.386740 --- ParallelTerminationStrategy: PID 27937 died... 17:15:38.406530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27937): Terminated: ok {rc=0} 17:15:38.453772 --- ParallelTerminationStrategy: PID 27940 died... 17:15:38.473608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27940): Terminated: ok {rc=0} 17:15:38.563123 bus /sierra_3: Setting Powered False 17:15:39.663634 bus /sierra_3: Setting Powered False 17:15:40.781797 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 17:15:41.870941 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:41.883703 tst emergency:sysmo: Using 1 x bts (candidates: 1) 17:15:41.923780 tst emergency_preemptive_call.py: using LAC 29420 17:15:42.056535 tst emergency_preemptive_call.py: using RAC 95 17:15:42.196558 tst emergency_preemptive_call.py: using CellId 29420 17:15:42.324201 tst emergency_preemptive_call.py: using BVCI 29421 17:15:42.443054 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:42.454564 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:42.465694 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:42.476816 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:42.488067 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:42.499203 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:42.619631 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:42.738208 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:42.854371 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:42.966879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:43.438143 run create_hlr_db(pid=27943): Launched 17:15:43.562041 bus /sierra_2: Setting Powered False 17:15:44.622797 run create_hlr_db(pid=27943): Terminated: ok {rc=0} 17:15:45.066402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27945): Launched 17:15:45.393886 run osmo-hlr_10.42.42.2(pid=27946): Launched 17:15:45.517279 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:46.125272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27948): Launched 17:15:46.456931 run osmo-stp_10.42.42.5(pid=27949): Launched 17:15:46.660341 tst emergency_preemptive_call.py: using MSISDN 7818 17:15:46.947599 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:47.540410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27951): Launched 17:15:47.846010 run osmo-msc_10.42.42.6(pid=27952): Launched 17:15:48.022635 run osmo-stp_10.42.42.5(pid=27949): ERR: Terminated: ERROR {rc=1} [trial-2377↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27949)] 17:15:48.151301 run osmo-stp_10.42.42.5(pid=27949): stdout: | (launched: 2022-12-10_17:15:46.394277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:48.280139 run osmo-stp_10.42.42.5(pid=27949): stderr: | 20221210171546739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171546739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171546740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171546740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171546740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171546750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171546750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:48.406966 run osmo-stp_10.42.42.5(pid=27949): stdout: | (launched: 2022-12-10_17:15:46.394277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:48.527337 run osmo-stp_10.42.42.5(pid=27949): stderr: | 20221210171546739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171546739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171546740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171546740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171546740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171546750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171546750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:48.671399 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=27949): Process ended prematurely: osmo-stp_10.42.42.5(pid=27949) [trial-2377↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27949)] [trial-2377↪emergency:sysmo↪emergency_preemptive_call.py:32] 17:15:48.679718 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 17:15:48.705559 run osmo-hlr_10.42.42.2(pid=27946): ERR: Terminated: ERROR {rc=237} [trial-2377↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27946)] 17:15:48.752914 run osmo-hlr_10.42.42.2(pid=27946): stdout: | (launched: 2022-12-10_17:15:45.332254) 17:15:48.802132 run osmo-hlr_10.42.42.2(pid=27946): stderr: | 20221210171545535 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171545535 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171545535 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171545535 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171545535 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171545535 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171545547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171545555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171545555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171545555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:48.871183 run osmo-msc_10.42.42.6(pid=27952): ERR: Terminated: ERROR {rc=2} [trial-2377↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27952)] 17:15:48.918910 run osmo-msc_10.42.42.6(pid=27952): stdout: | (launched: 2022-12-10_17:15:47.787746) 17:15:48.968094 run osmo-msc_10.42.42.6(pid=27952): stderr: | 20221210171548062 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210171548062 DLGLOBAL DEBUG validating counter group 0x7f1460d81c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210171548062 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210171548062 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210171548063 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210171548063 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210171548065 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210171548065 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210171548065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210171548065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:49.017792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27945): Terminating (SIGTERM) 17:15:49.057245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27948): Terminating (SIGTERM) 17:15:49.096614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27951): Terminating (SIGTERM) 17:15:49.136207 --- ParallelTerminationStrategy: PID 27945 died... 17:15:49.155191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27945): Terminated: ok {rc=0} 17:15:49.198897 --- ParallelTerminationStrategy: PID 27948 died... 17:15:49.217398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27948): Terminated: ok {rc=0} 17:15:49.261296 --- ParallelTerminationStrategy: PID 27951 died... 17:15:49.279686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27951): Terminated: ok {rc=0} 17:15:49.365099 bus /sierra_9: Setting Powered False 17:15:50.467377 bus /sierra_9: Setting Powered False 17:15:51.583928 bus /sierra_8: Setting Powered False 17:15:52.680202 bus /sierra_8: Setting Powered False 17:15:53.796814 bus /sierra_3: Setting Powered False 17:15:54.894839 bus /sierra_3: Setting Powered False 17:15:56.010601 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:sysmo --------------------------------------------------------------------- 17:15:57.270766 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:15:57.275591 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 17:15:57.297472 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 17:15:57.338549 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 17:15:57.427857 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 17:15:57.449231 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 17:15:57.489007 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 17:15:58.079132 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 17:15:58.134802 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.145916 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:15:58.181898 tst cs_paging_gprs_active.py: using LAC 29421 17:15:58.313614 tst cs_paging_gprs_active.py: using RAC 96 17:15:58.444355 tst cs_paging_gprs_active.py: using CellId 29421 17:15:58.573348 tst cs_paging_gprs_active.py: using BVCI 29422 17:15:58.694450 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.705728 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.716635 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.728025 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.739324 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.750708 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.761961 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.773196 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.784572 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:15:58.900507 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:15:59.021114 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:15:59.244360 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:15:59.578423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27958): Launched 17:15:59.868058 run iperf3-srv_10.42.42.10(pid=27959): Launched 17:15:59.994649 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:16:00.218487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:00.551754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27960): Launched 17:16:00.851338 run iperf3-srv_10.42.42.10(pid=27961): Launched 17:16:00.999747 tst cs_paging_gprs_active.py:38: start network... 17:16:01.228761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:01.732502 run create_hlr_db(pid=27962): Launched 17:16:01.895908 bus /sierra_2: Setting Powered False 17:16:02.956761 run create_hlr_db(pid=27962): Terminated: ok {rc=0} 17:16:03.390273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27964): Launched 17:16:03.702168 run osmo-hlr_10.42.42.2(pid=27965): Launched 17:16:03.819303 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:04.369459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27967): Launched 17:16:04.681598 run osmo-stp_10.42.42.5(pid=27968): Launched 17:16:04.799077 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:06.318623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27970): Launched 17:16:06.437210 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:06.700853 run patchelf(pid=27971): Launched 17:16:06.874667 run osmo-stp_10.42.42.5(pid=27968): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27968)] 17:16:07.005319 run osmo-stp_10.42.42.5(pid=27968): stdout: | (launched: 2022-12-10_17:16:04.622615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:07.137878 run osmo-stp_10.42.42.5(pid=27968): stderr: | 20221210171604798 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171604798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171604799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171604799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171604799 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171604800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171604800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:07.270110 run osmo-stp_10.42.42.5(pid=27968): stdout: | (launched: 2022-12-10_17:16:04.622615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:07.397330 run osmo-stp_10.42.42.5(pid=27968): stderr: | 20221210171604798 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171604798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171604799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171604799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171604799 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171604800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171604800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:07.547753 run patchelf(pid=27971): Terminating (SIGINT) 17:16:07.721160 run patchelf(pid=27971): Terminated: ok {rc=0} 17:16:07.846194 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27968): Process ended prematurely: osmo-stp_10.42.42.5(pid=27968) [trial-2377↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27968)] [trial-2377↪gprs:sysmo↪cs_paging_gprs_active.py:38] 17:16:07.855439 tst cs_paging_gprs_active.py:38: Test FAILED (9.8 sec) 17:16:07.882650 run osmo-hlr_10.42.42.2(pid=27965): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27965)] 17:16:07.930447 run osmo-hlr_10.42.42.2(pid=27965): stdout: | (launched: 2022-12-10_17:16:03.642824) 17:16:07.980031 run osmo-hlr_10.42.42.2(pid=27965): stderr: | 20221210171603822 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171603822 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171603822 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171603822 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171603822 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171603822 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171603834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171603845 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171603845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171603845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:08.030136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27958): Terminating (SIGTERM) 17:16:08.070398 run iperf3-srv_10.42.42.10(pid=27959): Terminating (SIGTERM) 17:16:08.110549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27960): Terminating (SIGTERM) 17:16:08.150686 run iperf3-srv_10.42.42.10(pid=27961): Terminating (SIGTERM) 17:16:08.191216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27964): Terminating (SIGTERM) 17:16:08.231598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27967): Terminating (SIGTERM) 17:16:08.271542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27970): Terminating (SIGTERM) 17:16:08.311982 --- ParallelTerminationStrategy: PID 27958 died... 17:16:08.331336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27958): Terminated: ok {rc=0} 17:16:08.376203 --- ParallelTerminationStrategy: PID 27959 died... 17:16:08.395095 run iperf3-srv_10.42.42.10(pid=27959): Terminated {rc=256} 17:16:08.439323 --- ParallelTerminationStrategy: PID 27960 died... 17:16:08.458183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27960): Terminated: ok {rc=0} 17:16:08.502600 --- ParallelTerminationStrategy: PID 27961 died... 17:16:08.521411 run iperf3-srv_10.42.42.10(pid=27961): Terminated {rc=256} 17:16:08.565608 --- ParallelTerminationStrategy: PID 27964 died... 17:16:08.584279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27964): Terminated: ok {rc=0} 17:16:08.628190 --- ParallelTerminationStrategy: PID 27967 died... 17:16:08.646937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27967): Terminated: ok {rc=0} 17:16:08.691124 --- ParallelTerminationStrategy: PID 27970 died... 17:16:08.709987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27970): Terminated: ok {rc=0} 17:16:08.796759 bus /gobi_0: Setting Powered False 17:16:09.896569 bus /gobi_0: Setting Powered False 17:16:11.010837 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:sysmo iperf3.py ---------------------------------------------- 17:16:12.163176 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.175140 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:16:12.217808 tst iperf3.py: using LAC 29422 17:16:12.348878 tst iperf3.py: using RAC 97 17:16:12.479679 tst iperf3.py: using CellId 29422 17:16:12.608910 tst iperf3.py: using BVCI 29423 17:16:12.730995 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.742069 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.753072 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.764167 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.775164 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.786350 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.797566 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.808570 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.819865 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:12.939930 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:16:13.163121 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:13.495437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27972): Launched 17:16:13.784172 run iperf3-srv_10.42.42.10(pid=27973): Launched 17:16:13.907693 tst iperf3.py:8: start network... 17:16:14.129657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:14.643530 run create_hlr_db(pid=27974): Launched 17:16:14.768898 bus /gobi_6: Setting Powered False 17:16:15.837281 run create_hlr_db(pid=27974): Terminated: ok {rc=0} 17:16:16.323722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27976): Launched 17:16:16.673227 run osmo-hlr_10.42.42.2(pid=27977): Launched 17:16:16.921294 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:17.566843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27979): Launched 17:16:17.898907 run osmo-stp_10.42.42.5(pid=27980): Launched 17:16:18.025079 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:18.595934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27982): Launched 17:16:18.724372 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:19.005069 run patchelf(pid=27983): Launched 17:16:19.188075 run osmo-stp_10.42.42.5(pid=27980): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27980)] 17:16:19.327526 run osmo-stp_10.42.42.5(pid=27980): stdout: | (launched: 2022-12-10_17:16:17.836768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:19.468304 run osmo-stp_10.42.42.5(pid=27980): stderr: | 20221210171618029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171618029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171618029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171618030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171618030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171618030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171618030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:19.609188 run osmo-stp_10.42.42.5(pid=27980): stdout: | (launched: 2022-12-10_17:16:17.836768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:19.744828 run osmo-stp_10.42.42.5(pid=27980): stderr: | 20221210171618029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171618029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171618029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171618030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171618030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171618030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171618030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:19.904627 run patchelf(pid=27983): Terminating (SIGINT) 17:16:20.089095 run patchelf(pid=27983): Terminated: ok {rc=0} 17:16:20.221971 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27980): Process ended prematurely: osmo-stp_10.42.42.5(pid=27980) [trial-2377↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27980)] [trial-2377↪gprs:sysmo↪iperf3.py:8] 17:16:20.232044 tst iperf3.py:8: Test FAILED (8.1 sec) 17:16:20.261234 run osmo-hlr_10.42.42.2(pid=27977): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27977)] 17:16:20.312308 run osmo-hlr_10.42.42.2(pid=27977): stdout: | (launched: 2022-12-10_17:16:16.608351) 17:16:20.365078 run osmo-hlr_10.42.42.2(pid=27977): stderr: | 20221210171616926 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171616926 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171616926 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171616926 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171616926 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171616926 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171616942 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171616950 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171616951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171616951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:20.417950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27972): Terminating (SIGTERM) 17:16:20.460077 run iperf3-srv_10.42.42.10(pid=27973): Terminating (SIGTERM) 17:16:20.502280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27976): Terminating (SIGTERM) 17:16:20.544645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27979): Terminating (SIGTERM) 17:16:20.586741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27982): Terminating (SIGTERM) 17:16:20.629565 --- ParallelTerminationStrategy: PID 27972 died... 17:16:20.649901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27972): Terminated: ok {rc=0} 17:16:20.697184 --- ParallelTerminationStrategy: PID 27973 died... 17:16:20.717048 run iperf3-srv_10.42.42.10(pid=27973): Terminated {rc=256} 17:16:20.764268 --- ParallelTerminationStrategy: PID 27976 died... 17:16:20.784104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27976): Terminated: ok {rc=0} 17:16:20.831252 --- ParallelTerminationStrategy: PID 27979 died... 17:16:20.851031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27979): Terminated: ok {rc=0} 17:16:20.897946 --- ParallelTerminationStrategy: PID 27982 died... 17:16:20.917756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27982): Terminated: ok {rc=0} 17:16:21.006569 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:sysmo iperf3m4.py ---------------------------------------------- 17:16:22.160690 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.172636 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:16:22.210729 tst iperf3m4.py: using LAC 29423 17:16:22.341083 tst iperf3m4.py: using RAC 98 17:16:22.472252 tst iperf3m4.py: using CellId 29423 17:16:22.595685 tst iperf3m4.py: using BVCI 29424 17:16:22.710820 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.721822 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.732331 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.743499 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.754489 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.765365 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.776450 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.787361 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.798441 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:22.917225 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:23.041411 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:23.159604 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:23.275210 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:16:23.483393 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:23.796510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27984): Launched 17:16:24.068689 run iperf3-srv_10.42.42.10(pid=27985): Launched 17:16:24.185254 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:16:24.393278 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:24.706874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27986): Launched 17:16:24.979251 run iperf3-srv_10.42.42.10(pid=27987): Launched 17:16:25.095132 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:16:25.302628 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:25.615442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27988): Launched 17:16:25.887161 run iperf3-srv_10.42.42.10(pid=27989): Launched 17:16:26.003081 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:16:26.209740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:26.523059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27990): Launched 17:16:26.811337 run iperf3-srv_10.42.42.10(pid=27991): Launched 17:16:26.935738 tst iperf3m4.py:8: start network... 17:16:27.158013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:27.672574 run create_hlr_db(pid=27992): Launched 17:16:27.798512 bus /gobi_6: Setting Powered False 17:16:28.863359 run create_hlr_db(pid=27992): Terminated: ok {rc=0} 17:16:29.321625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27994): Launched 17:16:29.654666 run osmo-hlr_10.42.42.2(pid=27995): Launched 17:16:29.780557 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:30.353607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27997): Launched 17:16:30.685998 run osmo-stp_10.42.42.5(pid=27998): Launched 17:16:30.813595 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:31.467600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28000): Launched 17:16:31.607478 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:31.900460 run patchelf(pid=28001): Launched 17:16:32.126144 run osmo-stp_10.42.42.5(pid=27998): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27998)] 17:16:32.260839 run osmo-stp_10.42.42.5(pid=27998): stdout: | (launched: 2022-12-10_17:16:30.623452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:32.393945 run osmo-stp_10.42.42.5(pid=27998): stderr: | 20221210171630817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171630818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171630818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171630818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171630820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171630821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171630821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:32.526503 run osmo-stp_10.42.42.5(pid=27998): stdout: | (launched: 2022-12-10_17:16:30.623452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:32.653272 run osmo-stp_10.42.42.5(pid=27998): stderr: | 20221210171630817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171630818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171630818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171630818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171630820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171630821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171630821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:32.803033 run patchelf(pid=28001): Terminating (SIGINT) 17:16:32.976121 run patchelf(pid=28001): Terminated: ok {rc=0} 17:16:33.100641 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27998): Process ended prematurely: osmo-stp_10.42.42.5(pid=27998) [trial-2377↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27998)] [trial-2377↪gprs:sysmo↪iperf3m4.py:8] 17:16:33.110137 tst iperf3m4.py:8: Test FAILED (11.0 sec) 17:16:33.137733 run osmo-hlr_10.42.42.2(pid=27995): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27995)] 17:16:33.186119 run osmo-hlr_10.42.42.2(pid=27995): stdout: | (launched: 2022-12-10_17:16:29.591627) 17:16:33.236156 run osmo-hlr_10.42.42.2(pid=27995): stderr: | 20221210171629794 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171629794 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171629794 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171629794 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171629794 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171629794 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171629811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171629821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171629821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171629821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:33.286788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27984): Terminating (SIGTERM) 17:16:33.327174 run iperf3-srv_10.42.42.10(pid=27985): Terminating (SIGTERM) 17:16:33.367555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27986): Terminating (SIGTERM) 17:16:33.408028 run iperf3-srv_10.42.42.10(pid=27987): Terminating (SIGTERM) 17:16:33.448348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27988): Terminating (SIGTERM) 17:16:33.488680 run iperf3-srv_10.42.42.10(pid=27989): Terminating (SIGTERM) 17:16:33.528919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27990): Terminating (SIGTERM) 17:16:33.569306 run iperf3-srv_10.42.42.10(pid=27991): Terminating (SIGTERM) 17:16:33.609448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27994): Terminating (SIGTERM) 17:16:33.650584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27997): Terminating (SIGTERM) 17:16:33.691096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28000): Terminating (SIGTERM) 17:16:33.731782 --- ParallelTerminationStrategy: PID 27984 died... 17:16:33.750831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27984): Terminated: ok {rc=0} 17:16:33.796337 --- ParallelTerminationStrategy: PID 27985 died... 17:16:33.815322 run iperf3-srv_10.42.42.10(pid=27985): Terminated {rc=256} 17:16:33.860044 --- ParallelTerminationStrategy: PID 27986 died... 17:16:33.878967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27986): Terminated: ok {rc=0} 17:16:33.923529 --- ParallelTerminationStrategy: PID 27987 died... 17:16:33.942442 run iperf3-srv_10.42.42.10(pid=27987): Terminated {rc=256} 17:16:33.987515 --- ParallelTerminationStrategy: PID 27988 died... 17:16:34.006433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27988): Terminated: ok {rc=0} 17:16:34.051050 --- ParallelTerminationStrategy: PID 27989 died... 17:16:34.070010 run iperf3-srv_10.42.42.10(pid=27989): Terminated {rc=256} 17:16:34.114473 --- ParallelTerminationStrategy: PID 27990 died... 17:16:34.133384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27990): Terminated: ok {rc=0} 17:16:34.177803 --- ParallelTerminationStrategy: PID 27991 died... 17:16:34.196454 run iperf3-srv_10.42.42.10(pid=27991): Terminated {rc=256} 17:16:34.240752 --- ParallelTerminationStrategy: PID 27994 died... 17:16:34.259750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27994): Terminated: ok {rc=0} 17:16:34.303856 --- ParallelTerminationStrategy: PID 27997 died... 17:16:34.322680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27997): Terminated: ok {rc=0} 17:16:34.367001 --- ParallelTerminationStrategy: PID 28000 died... 17:16:34.386215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28000): Terminated: ok {rc=0} 17:16:34.471447 bus /gobi_4: Setting Powered False 17:16:35.570877 bus /gobi_4: Setting Powered False 17:16:36.687062 bus /gobi_1: Setting Powered False 17:16:37.786618 bus /gobi_1: Setting Powered False 17:16:38.901174 bus /gobi_0: Setting Powered False 17:16:40.000221 bus /gobi_0: Setting Powered False 17:16:41.119462 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:sysmo ping.py ---------------------------------------------- 17:16:42.222827 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.234322 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:16:42.270974 tst ping.py: using LAC 29424 17:16:42.395813 tst ping.py: using RAC 99 17:16:42.515279 tst ping.py: using CellId 29424 17:16:42.634358 tst ping.py: using BVCI 29425 17:16:42.744940 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.755678 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.766340 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.776718 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.787072 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.797420 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.807864 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.818322 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:42.930719 tst ping.py:19: start network... 17:16:43.133184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:43.606011 run create_hlr_db(pid=28002): Launched 17:16:43.729422 bus /gobi_6: Setting Powered False 17:16:44.789874 run create_hlr_db(pid=28002): Terminated: ok {rc=0} 17:16:45.234787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28004): Launched 17:16:45.561568 run osmo-hlr_10.42.42.2(pid=28005): Launched 17:16:45.687076 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:46.274591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28007): Launched 17:16:46.619458 run osmo-stp_10.42.42.5(pid=28008): Launched 17:16:46.850711 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:47.488871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28010): Launched 17:16:47.613338 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:47.889605 run patchelf(pid=28011): Launched 17:16:48.070687 run osmo-stp_10.42.42.5(pid=28008): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28008)] 17:16:48.208611 run osmo-stp_10.42.42.5(pid=28008): stdout: | (launched: 2022-12-10_17:16:46.555185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:48.347651 run osmo-stp_10.42.42.5(pid=28008): stderr: | 20221210171646858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171646858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171646859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171646859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171646860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171646860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171646860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:48.487071 run osmo-stp_10.42.42.5(pid=28008): stdout: | (launched: 2022-12-10_17:16:46.555185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:48.620654 run osmo-stp_10.42.42.5(pid=28008): stderr: | 20221210171646858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171646858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171646859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171646859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171646860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171646860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171646860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:48.778482 run patchelf(pid=28011): Terminating (SIGINT) 17:16:48.959644 run patchelf(pid=28011): Terminated: ok {rc=0} 17:16:49.090636 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28008): Process ended prematurely: osmo-stp_10.42.42.5(pid=28008) [trial-2377↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28008)] [trial-2377↪gprs:sysmo↪ping.py:22] 17:16:49.099930 tst ping.py:22: Test FAILED (6.9 sec) 17:16:49.128633 run osmo-hlr_10.42.42.2(pid=28005): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28005)] 17:16:49.179392 run osmo-hlr_10.42.42.2(pid=28005): stdout: | (launched: 2022-12-10_17:16:45.500252) 17:16:49.231987 run osmo-hlr_10.42.42.2(pid=28005): stderr: | 20221210171645702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171645702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171645702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171645702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171645702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171645702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171645714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171645724 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171645724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171645724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:49.285254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28004): Terminating (SIGTERM) 17:16:49.327832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28007): Terminating (SIGTERM) 17:16:49.370524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28010): Terminating (SIGTERM) 17:16:49.413289 --- ParallelTerminationStrategy: PID 28004 died... 17:16:49.433428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28004): Terminated: ok {rc=0} 17:16:49.480693 --- ParallelTerminationStrategy: PID 28007 died... 17:16:49.500504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28007): Terminated: ok {rc=0} 17:16:49.547367 --- ParallelTerminationStrategy: PID 28010 died... 17:16:49.567050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28010): Terminated: ok {rc=0} 17:16:49.656409 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 17:16:50.745847 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:50.758267 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:16:50.796112 tst ping_idle_ping.py: using LAC 29425 17:16:50.924901 tst ping_idle_ping.py: using RAC 100 17:16:51.050908 tst ping_idle_ping.py: using CellId 29425 17:16:51.178363 tst ping_idle_ping.py: using BVCI 29426 17:16:51.297301 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:51.308391 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:51.319442 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:51.330538 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:51.341649 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:51.352584 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:51.363807 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:51.375129 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:51.502789 tst ping_idle_ping.py:24: start network... 17:16:51.722780 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:52.227995 run create_hlr_db(pid=28012): Launched 17:16:52.351445 bus /gobi_6: Setting Powered False 17:16:53.411483 run create_hlr_db(pid=28012): Terminated: ok {rc=0} 17:16:53.867753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28014): Launched 17:16:54.193803 run osmo-hlr_10.42.42.2(pid=28015): Launched 17:16:54.317496 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:54.879845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28017): Launched 17:16:55.205843 run osmo-stp_10.42.42.5(pid=28018): Launched 17:16:55.329188 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:55.891730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28020): Launched 17:16:56.008819 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:56.267906 run patchelf(pid=28021): Launched 17:16:56.436938 run osmo-stp_10.42.42.5(pid=28018): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28018)] 17:16:56.566999 run osmo-stp_10.42.42.5(pid=28018): stdout: | (launched: 2022-12-10_17:16:55.144524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:56.698784 run osmo-stp_10.42.42.5(pid=28018): stderr: | 20221210171655339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171655339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171655340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171655340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171655341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171655341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171655341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:56.829718 run osmo-stp_10.42.42.5(pid=28018): stdout: | (launched: 2022-12-10_17:16:55.144524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:56.954875 run osmo-stp_10.42.42.5(pid=28018): stderr: | 20221210171655339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171655339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171655340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171655340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171655341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171655341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171655341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:57.103061 run patchelf(pid=28021): Terminating (SIGINT) 17:16:57.273130 run patchelf(pid=28021): Terminated: ok {rc=0} 17:16:57.396010 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28018): Process ended prematurely: osmo-stp_10.42.42.5(pid=28018) [trial-2377↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28018)] [trial-2377↪gprs:sysmo↪ping_idle_ping.py:27] 17:16:57.404685 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:16:57.431110 run osmo-hlr_10.42.42.2(pid=28015): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28015)] 17:16:57.478587 run osmo-hlr_10.42.42.2(pid=28015): stdout: | (launched: 2022-12-10_17:16:54.132549) 17:16:57.527834 run osmo-hlr_10.42.42.2(pid=28015): stderr: | 20221210171654334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171654334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171654334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171654334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171654334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171654334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171654347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171654355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171654355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171654356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:57.577433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28014): Terminating (SIGTERM) 17:16:57.617770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28017): Terminating (SIGTERM) 17:16:57.657541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28020): Terminating (SIGTERM) 17:16:57.697408 --- ParallelTerminationStrategy: PID 28014 died... 17:16:57.716130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28014): Terminated: ok {rc=0} 17:16:57.760004 --- ParallelTerminationStrategy: PID 28017 died... 17:16:57.778705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28017): Terminated: ok {rc=0} 17:16:57.822589 --- ParallelTerminationStrategy: PID 28020 died... 17:16:57.841173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28020): Terminated: ok {rc=0} 17:16:57.927020 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 17:16:59.212667 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:16:59.218432 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:16:59.239764 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:16:59.278229 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:16:59.369316 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:16:59.390442 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:16:59.428260 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:17:00.016399 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:17:00.066305 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.077329 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:17:00.115977 tst cs_paging_gprs_active.py: using LAC 29426 17:17:00.236719 tst cs_paging_gprs_active.py: using RAC 101 17:17:00.358128 tst cs_paging_gprs_active.py: using CellId 29426 17:17:00.480643 tst cs_paging_gprs_active.py: using BVCI 29427 17:17:00.594126 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.605232 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.615911 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.626671 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.637230 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.647690 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.658412 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.668858 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.679710 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:00.798933 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:00.942689 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:17:01.163514 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:01.492372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28026): Launched 17:17:01.797791 run iperf3-srv_10.42.42.10(pid=28030): Launched 17:17:01.932655 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:17:02.145824 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:02.462243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28031): Launched 17:17:02.756208 run iperf3-srv_10.42.42.10(pid=28032): Launched 17:17:02.872648 tst cs_paging_gprs_active.py:38: start network... 17:17:03.079982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:03.565143 run create_hlr_db(pid=28033): Launched 17:17:03.697951 bus /gobi_6: Setting Powered False 17:17:04.763183 run create_hlr_db(pid=28033): Terminated: ok {rc=0} 17:17:05.226891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28035): Launched 17:17:05.562039 run osmo-hlr_10.42.42.2(pid=28036): Launched 17:17:05.690127 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:06.266923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28038): Launched 17:17:06.601649 run osmo-stp_10.42.42.5(pid=28039): Launched 17:17:06.730673 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:07.304644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28041): Launched 17:17:07.431381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:07.714108 run patchelf(pid=28042): Launched 17:17:07.898292 run osmo-stp_10.42.42.5(pid=28039): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28039)] 17:17:08.038178 run osmo-stp_10.42.42.5(pid=28039): stdout: | (launched: 2022-12-10_17:17:06.538877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:08.179934 run osmo-stp_10.42.42.5(pid=28039): stderr: | 20221210171706736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171706736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171706736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171706737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171706740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171706740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171706740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:08.321614 run osmo-stp_10.42.42.5(pid=28039): stdout: | (launched: 2022-12-10_17:17:06.538877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:08.457862 run osmo-stp_10.42.42.5(pid=28039): stderr: | 20221210171706736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171706736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171706736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171706737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171706740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171706740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171706740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:08.619119 run patchelf(pid=28042): Terminating (SIGINT) 17:17:08.804667 run patchelf(pid=28042): Terminated: ok {rc=0} 17:17:08.938196 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28039): Process ended prematurely: osmo-stp_10.42.42.5(pid=28039) [trial-2377↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28039)] [trial-2377↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:17:08.948364 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:17:08.978120 run osmo-hlr_10.42.42.2(pid=28036): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28036)] 17:17:09.029205 run osmo-hlr_10.42.42.2(pid=28036): stdout: | (launched: 2022-12-10_17:17:05.499249) 17:17:09.082068 run osmo-hlr_10.42.42.2(pid=28036): stderr: | 20221210171705701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171705701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171705701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171705701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171705701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171705702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171705718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171705728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171705728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171705728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:09.135212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28026): Terminating (SIGTERM) 17:17:09.177852 run iperf3-srv_10.42.42.10(pid=28030): Terminating (SIGTERM) 17:17:09.220499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28031): Terminating (SIGTERM) 17:17:09.263289 run iperf3-srv_10.42.42.10(pid=28032): Terminating (SIGTERM) 17:17:09.305822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28035): Terminating (SIGTERM) 17:17:09.348709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28038): Terminating (SIGTERM) 17:17:09.391445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28041): Terminating (SIGTERM) 17:17:09.434206 --- ParallelTerminationStrategy: PID 28026 died... 17:17:09.454384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28026): Terminated: ok {rc=0} 17:17:09.501637 --- ParallelTerminationStrategy: PID 28030 died... 17:17:09.521262 run iperf3-srv_10.42.42.10(pid=28030): Terminated {rc=256} 17:17:09.568235 --- ParallelTerminationStrategy: PID 28031 died... 17:17:09.588032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28031): Terminated: ok {rc=0} 17:17:09.635249 --- ParallelTerminationStrategy: PID 28032 died... 17:17:09.654752 run iperf3-srv_10.42.42.10(pid=28032): Terminated {rc=256} 17:17:09.701608 --- ParallelTerminationStrategy: PID 28035 died... 17:17:09.721186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28035): Terminated: ok {rc=0} 17:17:09.767891 --- ParallelTerminationStrategy: PID 28038 died... 17:17:09.787566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28038): Terminated: ok {rc=0} 17:17:09.834592 --- ParallelTerminationStrategy: PID 28041 died... 17:17:09.854290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28041): Terminated: ok {rc=0} 17:17:09.943087 bus /gobi_0: Setting Powered False 17:17:11.043115 bus /gobi_0: Setting Powered False 17:17:12.161591 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:17:13.309367 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.320908 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:17:13.359147 tst iperf3.py: using LAC 29427 17:17:13.482704 tst iperf3.py: using RAC 102 17:17:13.606246 tst iperf3.py: using CellId 29427 17:17:13.729456 tst iperf3.py: using BVCI 29428 17:17:13.843547 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.854537 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.865428 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.876076 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.886675 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.897560 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.908298 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.918877 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.929727 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:14.052527 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:17:14.276518 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:14.610328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28043): Launched 17:17:14.901480 run iperf3-srv_10.42.42.10(pid=28044): Launched 17:17:15.025663 tst iperf3.py:8: start network... 17:17:15.247916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:15.762332 run create_hlr_db(pid=28045): Launched 17:17:15.896254 bus /gobi_6: Setting Powered False 17:17:16.957297 run create_hlr_db(pid=28045): Terminated: ok {rc=0} 17:17:17.423509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28047): Launched 17:17:17.735743 run osmo-hlr_10.42.42.2(pid=28048): Launched 17:17:17.852402 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:18.386443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28050): Launched 17:17:18.697055 run osmo-stp_10.42.42.5(pid=28051): Launched 17:17:18.815215 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:19.350510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28053): Launched 17:17:19.470359 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:19.732594 run patchelf(pid=28054): Launched 17:17:19.903527 run osmo-stp_10.42.42.5(pid=28051): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28051)] 17:17:20.033884 run osmo-stp_10.42.42.5(pid=28051): stdout: | (launched: 2022-12-10_17:17:18.637998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:20.165933 run osmo-stp_10.42.42.5(pid=28051): stderr: | 20221210171718811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171718811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171718811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171718812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171718812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171718812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171718812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:20.298425 run osmo-stp_10.42.42.5(pid=28051): stdout: | (launched: 2022-12-10_17:17:18.637998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:20.424644 run osmo-stp_10.42.42.5(pid=28051): stderr: | 20221210171718811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171718811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171718811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171718812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171718812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171718812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171718812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:20.574128 run patchelf(pid=28054): Terminating (SIGINT) 17:17:20.747307 run patchelf(pid=28054): Terminated: ok {rc=0} 17:17:20.871886 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28051): Process ended prematurely: osmo-stp_10.42.42.5(pid=28051) [trial-2377↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28051)] [trial-2377↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 17:17:20.881293 tst iperf3.py:8: Test FAILED (7.6 sec) 17:17:20.908274 run osmo-hlr_10.42.42.2(pid=28048): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28048)] 17:17:20.956054 run osmo-hlr_10.42.42.2(pid=28048): stdout: | (launched: 2022-12-10_17:17:17.676678) 17:17:21.005363 run osmo-hlr_10.42.42.2(pid=28048): stderr: | 20221210171717858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171717858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171717858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171717858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171717858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171717858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171717870 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171717880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171717881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171717881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:21.055155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28043): Terminating (SIGTERM) 17:17:21.094812 run iperf3-srv_10.42.42.10(pid=28044): Terminating (SIGTERM) 17:17:21.134395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28047): Terminating (SIGTERM) 17:17:21.173987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28050): Terminating (SIGTERM) 17:17:21.213660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28053): Terminating (SIGTERM) 17:17:21.253430 --- ParallelTerminationStrategy: PID 28043 died... 17:17:21.272673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28043): Terminated: ok {rc=0} 17:17:21.316921 --- ParallelTerminationStrategy: PID 28044 died... 17:17:21.335629 run iperf3-srv_10.42.42.10(pid=28044): Terminated {rc=256} 17:17:21.379120 --- ParallelTerminationStrategy: PID 28047 died... 17:17:21.397758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28047): Terminated: ok {rc=0} 17:17:21.441417 --- ParallelTerminationStrategy: PID 28050 died... 17:17:21.460097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28050): Terminated: ok {rc=0} 17:17:21.503836 --- ParallelTerminationStrategy: PID 28053 died... 17:17:21.522492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28053): Terminated: ok {rc=0} 17:17:21.607911 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:17:22.757117 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:22.769077 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:17:22.807202 tst iperf3m4.py: using LAC 29428 17:17:22.928393 tst iperf3m4.py: using RAC 103 17:17:23.050817 tst iperf3m4.py: using CellId 29428 17:17:23.173462 tst iperf3m4.py: using BVCI 29429 17:17:23.285583 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.296301 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.307117 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.317829 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.328421 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.339098 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.350027 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.360537 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.371344 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:23.487709 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:23.611462 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:23.732697 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:23.852198 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:17:24.076478 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:24.412444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28055): Launched 17:17:24.705224 run iperf3-srv_10.42.42.10(pid=28056): Launched 17:17:24.829975 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:17:25.053213 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:25.387829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28057): Launched 17:17:25.677548 run iperf3-srv_10.42.42.10(pid=28058): Launched 17:17:25.802326 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:17:26.025376 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:26.359642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28059): Launched 17:17:26.649587 run iperf3-srv_10.42.42.10(pid=28060): Launched 17:17:26.773756 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:17:26.996204 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:27.329641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28061): Launched 17:17:27.619156 run iperf3-srv_10.42.42.10(pid=28062): Launched 17:17:27.743766 tst iperf3m4.py:8: start network... 17:17:27.966222 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:28.480877 run create_hlr_db(pid=28063): Launched 17:17:28.606684 bus /gobi_6: Setting Powered False 17:17:29.671952 run create_hlr_db(pid=28063): Terminated: ok {rc=0} 17:17:30.114933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28065): Launched 17:17:30.426493 run osmo-hlr_10.42.42.2(pid=28066): Launched 17:17:30.543811 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:31.126404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28068): Launched 17:17:31.481402 run osmo-stp_10.42.42.5(pid=28069): Launched 17:17:31.773228 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:32.346700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28071): Launched 17:17:32.474847 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:32.757162 run patchelf(pid=28072): Launched 17:17:32.941391 run osmo-stp_10.42.42.5(pid=28069): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28069)] 17:17:33.081246 run osmo-stp_10.42.42.5(pid=28069): stdout: | (launched: 2022-12-10_17:17:31.418123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:33.222882 run osmo-stp_10.42.42.5(pid=28069): stderr: | 20221210171731627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171731627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171731627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171731628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171731628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171731628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171731628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:33.364667 run osmo-stp_10.42.42.5(pid=28069): stdout: | (launched: 2022-12-10_17:17:31.418123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:33.500046 run osmo-stp_10.42.42.5(pid=28069): stderr: | 20221210171731627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171731627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171731627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171731628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171731628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171731628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171731628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:33.661214 run patchelf(pid=28072): Terminating (SIGINT) 17:17:33.846042 run patchelf(pid=28072): Terminated: ok {rc=0} 17:17:33.979145 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28069): Process ended prematurely: osmo-stp_10.42.42.5(pid=28069) [trial-2377↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28069)] [trial-2377↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 17:17:33.989397 tst iperf3m4.py:8: Test FAILED (11.3 sec) 17:17:34.019050 run osmo-hlr_10.42.42.2(pid=28066): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28066)] 17:17:34.070425 run osmo-hlr_10.42.42.2(pid=28066): stdout: | (launched: 2022-12-10_17:17:30.367708) 17:17:34.123330 run osmo-hlr_10.42.42.2(pid=28066): stderr: | 20221210171730548 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171730549 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171730549 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171730549 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171730549 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171730549 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171730563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171730574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171730575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171730575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:34.176459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28055): Terminating (SIGTERM) 17:17:34.218711 run iperf3-srv_10.42.42.10(pid=28056): Terminating (SIGTERM) 17:17:34.261109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28057): Terminating (SIGTERM) 17:17:34.303416 run iperf3-srv_10.42.42.10(pid=28058): Terminating (SIGTERM) 17:17:34.346066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28059): Terminating (SIGTERM) 17:17:34.388486 run iperf3-srv_10.42.42.10(pid=28060): Terminating (SIGTERM) 17:17:34.431203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28061): Terminating (SIGTERM) 17:17:34.473706 run iperf3-srv_10.42.42.10(pid=28062): Terminating (SIGTERM) 17:17:34.515869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28065): Terminating (SIGTERM) 17:17:34.558572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28068): Terminating (SIGTERM) 17:17:34.600803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28071): Terminating (SIGTERM) 17:17:34.643990 --- ParallelTerminationStrategy: PID 28055 died... 17:17:34.663729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28055): Terminated: ok {rc=0} 17:17:34.710834 --- ParallelTerminationStrategy: PID 28056 died... 17:17:34.730482 run iperf3-srv_10.42.42.10(pid=28056): Terminated {rc=256} 17:17:34.777281 --- ParallelTerminationStrategy: PID 28057 died... 17:17:34.796835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28057): Terminated: ok {rc=0} 17:17:34.843498 --- ParallelTerminationStrategy: PID 28058 died... 17:17:34.863088 run iperf3-srv_10.42.42.10(pid=28058): Terminated {rc=256} 17:17:34.909982 --- ParallelTerminationStrategy: PID 28059 died... 17:17:34.929546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28059): Terminated: ok {rc=0} 17:17:34.976787 --- ParallelTerminationStrategy: PID 28060 died... 17:17:34.996815 run iperf3-srv_10.42.42.10(pid=28060): Terminated {rc=256} 17:17:35.043724 --- ParallelTerminationStrategy: PID 28061 died... 17:17:35.063438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28061): Terminated: ok {rc=0} 17:17:35.110314 --- ParallelTerminationStrategy: PID 28062 died... 17:17:35.130003 run iperf3-srv_10.42.42.10(pid=28062): Terminated {rc=256} 17:17:35.177078 --- ParallelTerminationStrategy: PID 28065 died... 17:17:35.196707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28065): Terminated: ok {rc=0} 17:17:35.243790 --- ParallelTerminationStrategy: PID 28068 died... 17:17:35.263577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28068): Terminated: ok {rc=0} 17:17:35.311054 --- ParallelTerminationStrategy: PID 28071 died... 17:17:35.330871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28071): Terminated: ok {rc=0} 17:17:35.419671 bus /gobi_4: Setting Powered False 17:17:36.519628 bus /gobi_4: Setting Powered False 17:17:37.639175 bus /gobi_1: Setting Powered False 17:17:38.739349 bus /gobi_1: Setting Powered False 17:17:39.854045 bus /gobi_0: Setting Powered False 17:17:40.953256 bus /gobi_0: Setting Powered False 17:17:42.069901 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 17:17:43.173803 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.185932 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:17:43.229299 tst ping.py: using LAC 29429 17:17:43.356374 tst ping.py: using RAC 104 17:17:43.480624 tst ping.py: using CellId 29429 17:17:43.605675 tst ping.py: using BVCI 29430 17:17:43.723709 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.735152 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.746486 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.757939 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.769195 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.780458 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.792080 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.803444 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:43.923835 tst ping.py:19: start network... 17:17:44.142647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:44.647079 run create_hlr_db(pid=28073): Launched 17:17:44.770795 bus /gobi_6: Setting Powered False 17:17:45.835469 run create_hlr_db(pid=28073): Terminated: ok {rc=0} 17:17:46.305284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28075): Launched 17:17:46.649625 run osmo-hlr_10.42.42.2(pid=28076): Launched 17:17:46.898064 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:47.594047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28078): Launched 17:17:47.922363 run osmo-stp_10.42.42.5(pid=28079): Launched 17:17:48.046417 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:48.609021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28081): Launched 17:17:48.733592 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:49.009726 run patchelf(pid=28082): Launched 17:17:49.190997 run osmo-stp_10.42.42.5(pid=28079): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28079)] 17:17:49.328697 run osmo-stp_10.42.42.5(pid=28079): stdout: | (launched: 2022-12-10_17:17:47.860840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:49.467715 run osmo-stp_10.42.42.5(pid=28079): stderr: | 20221210171748054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171748054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171748054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171748055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171748057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171748057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171748057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:49.607056 run osmo-stp_10.42.42.5(pid=28079): stdout: | (launched: 2022-12-10_17:17:47.860840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:49.740754 run osmo-stp_10.42.42.5(pid=28079): stderr: | 20221210171748054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171748054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171748054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171748055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171748057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171748057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171748057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:49.898473 run patchelf(pid=28082): Terminating (SIGINT) 17:17:50.079645 run patchelf(pid=28082): Terminated: ok {rc=0} 17:17:50.210623 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28079): Process ended prematurely: osmo-stp_10.42.42.5(pid=28079) [trial-2377↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28079)] [trial-2377↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 17:17:50.220042 tst ping.py:22: Test FAILED (7.0 sec) 17:17:50.248923 run osmo-hlr_10.42.42.2(pid=28076): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28076)] 17:17:50.299868 run osmo-hlr_10.42.42.2(pid=28076): stdout: | (launched: 2022-12-10_17:17:46.586028) 17:17:50.352534 run osmo-hlr_10.42.42.2(pid=28076): stderr: | 20221210171746895 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171746895 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171746895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171746896 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171746896 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171746896 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171746913 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171746931 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171746931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171746931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:50.405673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28075): Terminating (SIGTERM) 17:17:50.448307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28078): Terminating (SIGTERM) 17:17:50.490836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28081): Terminating (SIGTERM) 17:17:50.533698 --- ParallelTerminationStrategy: PID 28075 died... 17:17:50.554038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28075): Terminated: ok {rc=0} 17:17:50.601550 --- ParallelTerminationStrategy: PID 28078 died... 17:17:50.621347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28078): Terminated: ok {rc=0} 17:17:50.668700 --- ParallelTerminationStrategy: PID 28081 died... 17:17:50.688645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28081): Terminated: ok {rc=0} 17:17:50.778220 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:17:51.867839 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:51.880520 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:17:51.929481 tst ping_idle_ping.py: using LAC 29430 17:17:52.057846 tst ping_idle_ping.py: using RAC 105 17:17:52.184448 tst ping_idle_ping.py: using CellId 29430 17:17:52.313764 tst ping_idle_ping.py: using BVCI 29431 17:17:52.432718 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:52.444049 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:52.455187 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:52.466898 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:52.479669 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:52.491571 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:52.502743 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:52.514678 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:52.640374 tst ping_idle_ping.py:24: start network... 17:17:52.847331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:53.322347 run create_hlr_db(pid=28083): Launched 17:17:53.451725 bus /gobi_6: Setting Powered False 17:17:54.515363 run create_hlr_db(pid=28083): Terminated: ok {rc=0} 17:17:54.970180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28085): Launched 17:17:55.298983 run osmo-hlr_10.42.42.2(pid=28086): Launched 17:17:55.423423 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:55.987439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28088): Launched 17:17:56.314312 run osmo-stp_10.42.42.5(pid=28089): Launched 17:17:56.438706 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:57.003153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28091): Launched 17:17:57.128812 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:57.405474 run patchelf(pid=28092): Launched 17:17:57.586406 run osmo-stp_10.42.42.5(pid=28089): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28089)] 17:17:57.724761 run osmo-stp_10.42.42.5(pid=28089): stdout: | (launched: 2022-12-10_17:17:56.252648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:57.863838 run osmo-stp_10.42.42.5(pid=28089): stderr: | 20221210171756447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171756447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171756447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171756448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171756448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171756448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171756448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:58.003198 run osmo-stp_10.42.42.5(pid=28089): stdout: | (launched: 2022-12-10_17:17:56.252648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:58.136425 run osmo-stp_10.42.42.5(pid=28089): stderr: | 20221210171756447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171756447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171756447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171756448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171756448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171756448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171756448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:58.294610 run patchelf(pid=28092): Terminating (SIGINT) 17:17:58.476137 run patchelf(pid=28092): Terminated: ok {rc=0} 17:17:58.607252 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28089): Process ended prematurely: osmo-stp_10.42.42.5(pid=28089) [trial-2377↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28089)] [trial-2377↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 17:17:58.616694 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:17:58.645791 run osmo-hlr_10.42.42.2(pid=28086): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28086)] 17:17:58.697406 run osmo-hlr_10.42.42.2(pid=28086): stdout: | (launched: 2022-12-10_17:17:55.237385) 17:17:58.749689 run osmo-hlr_10.42.42.2(pid=28086): stderr: | 20221210171755438 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171755438 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171755438 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171755439 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171755439 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171755439 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171755455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171755465 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171755465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171755466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:58.802406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28085): Terminating (SIGTERM) 17:17:58.844675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28088): Terminating (SIGTERM) 17:17:58.887021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28091): Terminating (SIGTERM) 17:17:58.929645 --- ParallelTerminationStrategy: PID 28085 died... 17:17:58.949528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28085): Terminated: ok {rc=0} 17:17:58.996834 --- ParallelTerminationStrategy: PID 28088 died... 17:17:59.016646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28088): Terminated: ok {rc=0} 17:17:59.064147 --- ParallelTerminationStrategy: PID 28091 died... 17:17:59.084056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28091): Terminated: ok {rc=0} 17:17:59.173111 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:18:00.458572 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:18:00.464914 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:18:00.486082 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:18:00.524368 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:18:00.613645 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:18:00.635846 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:18:00.676634 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:18:01.309845 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:18:01.367901 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.380362 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:01.446373 tst cs_paging_gprs_active.py: using LAC 29431 17:18:01.582569 tst cs_paging_gprs_active.py: using RAC 106 17:18:01.746376 tst cs_paging_gprs_active.py: using CellId 29431 17:18:01.873296 tst cs_paging_gprs_active.py: using BVCI 29432 17:18:02.036444 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:02.051297 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:02.067843 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:02.084133 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:02.095573 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:02.107093 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:02.118791 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:02.130190 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:02.141830 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:02.274624 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:02.395168 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:18:02.603737 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:02.916535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28097): Launched 17:18:03.189462 run iperf3-srv_10.42.42.10(pid=28098): Launched 17:18:03.306203 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:18:03.513522 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:03.826737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28099): Launched 17:18:04.097981 run iperf3-srv_10.42.42.10(pid=28100): Launched 17:18:04.214627 tst cs_paging_gprs_active.py:38: start network... 17:18:04.422012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:04.906031 run create_hlr_db(pid=28101): Launched 17:18:05.032293 bus /gobi_6: Setting Powered False 17:18:06.094394 run create_hlr_db(pid=28101): Terminated: ok {rc=0} 17:18:06.548224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28103): Launched 17:18:06.882966 run osmo-hlr_10.42.42.2(pid=28104): Launched 17:18:07.009701 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:07.587036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28106): Launched 17:18:07.921317 run osmo-stp_10.42.42.5(pid=28107): Launched 17:18:08.048117 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:08.623116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28109): Launched 17:18:08.750212 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:09.031686 run patchelf(pid=28110): Launched 17:18:09.215509 run osmo-stp_10.42.42.5(pid=28107): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28107)] 17:18:09.355291 run osmo-stp_10.42.42.5(pid=28107): stdout: | (launched: 2022-12-10_17:18:07.858959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:09.496369 run osmo-stp_10.42.42.5(pid=28107): stderr: | 20221210171808053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171808053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171808054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171808054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171808054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171808054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171808054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:09.637737 run osmo-stp_10.42.42.5(pid=28107): stdout: | (launched: 2022-12-10_17:18:07.858959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:09.773692 run osmo-stp_10.42.42.5(pid=28107): stderr: | 20221210171808053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171808053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171808054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171808054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171808054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171808054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171808054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:09.934521 run patchelf(pid=28110): Terminating (SIGINT) 17:18:10.118946 run patchelf(pid=28110): Terminated: ok {rc=0} 17:18:10.251862 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28107): Process ended prematurely: osmo-stp_10.42.42.5(pid=28107) [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28107)] [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:18:10.261932 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:18:10.291248 run osmo-hlr_10.42.42.2(pid=28104): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28104)] 17:18:10.341853 run osmo-hlr_10.42.42.2(pid=28104): stdout: | (launched: 2022-12-10_17:18:06.819946) 17:18:10.394167 run osmo-hlr_10.42.42.2(pid=28104): stderr: | 20221210171807021 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171807021 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171807022 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171807022 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171807022 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171807022 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171807038 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171807047 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171807047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171807047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:10.446943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28097): Terminating (SIGTERM) 17:18:10.489222 run iperf3-srv_10.42.42.10(pid=28098): Terminating (SIGTERM) 17:18:10.531392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28099): Terminating (SIGTERM) 17:18:10.573663 run iperf3-srv_10.42.42.10(pid=28100): Terminating (SIGTERM) 17:18:10.615897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28103): Terminating (SIGTERM) 17:18:10.658572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28106): Terminating (SIGTERM) 17:18:10.700751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28109): Terminating (SIGTERM) 17:18:10.743632 --- ParallelTerminationStrategy: PID 28097 died... 17:18:10.763701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28097): Terminated: ok {rc=0} 17:18:10.810447 --- ParallelTerminationStrategy: PID 28098 died... 17:18:10.829839 run iperf3-srv_10.42.42.10(pid=28098): Terminated {rc=256} 17:18:10.876290 --- ParallelTerminationStrategy: PID 28099 died... 17:18:10.895831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28099): Terminated: ok {rc=0} 17:18:10.942176 --- ParallelTerminationStrategy: PID 28100 died... 17:18:10.961623 run iperf3-srv_10.42.42.10(pid=28100): Terminated {rc=256} 17:18:11.007950 --- ParallelTerminationStrategy: PID 28103 died... 17:18:11.027532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28103): Terminated: ok {rc=0} 17:18:11.074310 --- ParallelTerminationStrategy: PID 28106 died... 17:18:11.094005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28106): Terminated: ok {rc=0} 17:18:11.140657 --- ParallelTerminationStrategy: PID 28109 died... 17:18:11.160784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28109): Terminated: ok {rc=0} 17:18:11.250119 bus /gobi_0: Setting Powered False 17:18:12.349708 bus /gobi_0: Setting Powered False 17:18:13.466050 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:18:14.617412 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.629749 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:14.692159 tst iperf3.py: using LAC 29432 17:18:14.819947 tst iperf3.py: using RAC 107 17:18:14.942597 tst iperf3.py: using CellId 29432 17:18:15.064478 tst iperf3.py: using BVCI 29433 17:18:15.176381 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:15.188003 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:15.199191 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:15.210488 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:15.221306 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:15.232019 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:15.242914 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:15.253689 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:15.264591 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:15.385301 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:18:15.608724 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:15.973156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28111): Launched 17:18:16.293004 run iperf3-srv_10.42.42.10(pid=28112): Launched 17:18:16.433539 tst iperf3.py:8: start network... 17:18:16.661571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:17.182109 run create_hlr_db(pid=28113): Launched 17:18:17.309548 bus /gobi_6: Setting Powered False 17:18:18.370844 run create_hlr_db(pid=28113): Terminated: ok {rc=0} 17:18:18.824395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28115): Launched 17:18:19.157337 run osmo-hlr_10.42.42.2(pid=28116): Launched 17:18:19.283755 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:19.854852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28118): Launched 17:18:20.187568 run osmo-stp_10.42.42.5(pid=28119): Launched 17:18:20.313197 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:20.884245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28121): Launched 17:18:21.010579 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:21.292194 run patchelf(pid=28122): Launched 17:18:21.477684 run osmo-stp_10.42.42.5(pid=28119): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28119)] 17:18:21.617207 run osmo-stp_10.42.42.5(pid=28119): stdout: | (launched: 2022-12-10_17:18:20.124808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:21.758903 run osmo-stp_10.42.42.5(pid=28119): stderr: | 20221210171820322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171820322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171820323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171820323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171820323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171820323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171820324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:21.900494 run osmo-stp_10.42.42.5(pid=28119): stdout: | (launched: 2022-12-10_17:18:20.124808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:22.035924 run osmo-stp_10.42.42.5(pid=28119): stderr: | 20221210171820322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171820322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171820323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171820323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171820323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171820323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171820324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:22.196237 run patchelf(pid=28122): Terminating (SIGINT) 17:18:22.380727 run patchelf(pid=28122): Terminated: ok {rc=0} 17:18:22.513472 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28119): Process ended prematurely: osmo-stp_10.42.42.5(pid=28119) [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28119)] [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 17:18:22.523567 tst iperf3.py:8: Test FAILED (7.9 sec) 17:18:22.552725 run osmo-hlr_10.42.42.2(pid=28116): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28116)] 17:18:22.603286 run osmo-hlr_10.42.42.2(pid=28116): stdout: | (launched: 2022-12-10_17:18:19.095158) 17:18:22.655749 run osmo-hlr_10.42.42.2(pid=28116): stderr: | 20221210171819299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171819299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171819299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171819299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171819299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171819299 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171819312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171819320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171819321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171819321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:22.708203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28111): Terminating (SIGTERM) 17:18:22.750148 run iperf3-srv_10.42.42.10(pid=28112): Terminating (SIGTERM) 17:18:22.792168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28115): Terminating (SIGTERM) 17:18:22.834430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28118): Terminating (SIGTERM) 17:18:22.876443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28121): Terminating (SIGTERM) 17:18:22.919021 --- ParallelTerminationStrategy: PID 28111 died... 17:18:22.939336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28111): Terminated: ok {rc=0} 17:18:22.987151 --- ParallelTerminationStrategy: PID 28112 died... 17:18:23.006943 run iperf3-srv_10.42.42.10(pid=28112): Terminated {rc=256} 17:18:23.053631 --- ParallelTerminationStrategy: PID 28115 died... 17:18:23.073200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28115): Terminated: ok {rc=0} 17:18:23.119743 --- ParallelTerminationStrategy: PID 28118 died... 17:18:23.139186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28118): Terminated: ok {rc=0} 17:18:23.185855 --- ParallelTerminationStrategy: PID 28121 died... 17:18:23.205596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28121): Terminated: ok {rc=0} 17:18:23.295180 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:18:24.447373 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.460050 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:24.519494 tst iperf3m4.py: using LAC 29433 17:18:24.650505 tst iperf3m4.py: using RAC 108 17:18:24.781261 tst iperf3m4.py: using CellId 29433 17:18:24.911091 tst iperf3m4.py: using BVCI 29434 17:18:25.033012 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:25.044447 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:25.055632 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:25.067031 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:25.078356 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:25.089726 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:25.101428 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:25.112718 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:25.124284 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:25.243465 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:25.363835 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:25.484542 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:25.605074 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:18:25.814533 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:26.128197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28123): Launched 17:18:26.400089 run iperf3-srv_10.42.42.10(pid=28124): Launched 17:18:26.516517 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:18:26.724633 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:27.037607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28125): Launched 17:18:27.310623 run iperf3-srv_10.42.42.10(pid=28126): Launched 17:18:27.427281 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:18:27.634738 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:27.946919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28127): Launched 17:18:28.218456 run iperf3-srv_10.42.42.10(pid=28128): Launched 17:18:28.334158 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:18:28.540540 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:28.853183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28129): Launched 17:18:29.124582 run iperf3-srv_10.42.42.10(pid=28130): Launched 17:18:29.240467 tst iperf3m4.py:8: start network... 17:18:29.448101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:29.928937 run create_hlr_db(pid=28131): Launched 17:18:30.055812 bus /gobi_6: Setting Powered False 17:18:31.120862 run create_hlr_db(pid=28131): Terminated: ok {rc=0} 17:18:31.605436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28133): Launched 17:18:31.937095 run osmo-hlr_10.42.42.2(pid=28134): Launched 17:18:32.182852 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:32.780474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28136): Launched 17:18:33.112123 run osmo-stp_10.42.42.5(pid=28137): Launched 17:18:33.237891 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:33.811626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28139): Launched 17:18:33.937776 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:34.218624 run patchelf(pid=28140): Launched 17:18:34.401658 run osmo-stp_10.42.42.5(pid=28137): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28137)] 17:18:34.540409 run osmo-stp_10.42.42.5(pid=28137): stdout: | (launched: 2022-12-10_17:18:33.049827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:34.680888 run osmo-stp_10.42.42.5(pid=28137): stderr: | 20221210171833244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171833244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171833245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171833245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171833247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171833247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171833248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:34.821659 run osmo-stp_10.42.42.5(pid=28137): stdout: | (launched: 2022-12-10_17:18:33.049827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:34.956517 run osmo-stp_10.42.42.5(pid=28137): stderr: | 20221210171833244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171833244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171833245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171833245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171833247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171833247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171833248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:35.116493 run patchelf(pid=28140): Terminating (SIGINT) 17:18:35.300427 run patchelf(pid=28140): Terminated: ok {rc=0} 17:18:35.433385 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28137): Process ended prematurely: osmo-stp_10.42.42.5(pid=28137) [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28137)] [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:18:35.443474 tst iperf3m4.py:8: Test FAILED (11.0 sec) 17:18:35.472850 run osmo-hlr_10.42.42.2(pid=28134): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28134)] 17:18:35.523623 run osmo-hlr_10.42.42.2(pid=28134): stdout: | (launched: 2022-12-10_17:18:31.874039) 17:18:35.576040 run osmo-hlr_10.42.42.2(pid=28134): stderr: | 20221210171832150 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171832150 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171832151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171832151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171832151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171832151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171832163 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171832173 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171832173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171832173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:35.628564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28123): Terminating (SIGTERM) 17:18:35.671081 run iperf3-srv_10.42.42.10(pid=28124): Terminating (SIGTERM) 17:18:35.713426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28125): Terminating (SIGTERM) 17:18:35.755805 run iperf3-srv_10.42.42.10(pid=28126): Terminating (SIGTERM) 17:18:35.798041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28127): Terminating (SIGTERM) 17:18:35.840269 run iperf3-srv_10.42.42.10(pid=28128): Terminating (SIGTERM) 17:18:35.882551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28129): Terminating (SIGTERM) 17:18:35.924763 run iperf3-srv_10.42.42.10(pid=28130): Terminating (SIGTERM) 17:18:35.967395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28133): Terminating (SIGTERM) 17:18:36.009876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28136): Terminating (SIGTERM) 17:18:36.052242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28139): Terminating (SIGTERM) 17:18:36.094924 --- ParallelTerminationStrategy: PID 28123 died... 17:18:36.115050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28123): Terminated: ok {rc=0} 17:18:36.162269 --- ParallelTerminationStrategy: PID 28124 died... 17:18:36.181962 run iperf3-srv_10.42.42.10(pid=28124): Terminated {rc=256} 17:18:36.228609 --- ParallelTerminationStrategy: PID 28125 died... 17:18:36.248431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28125): Terminated: ok {rc=0} 17:18:36.295390 --- ParallelTerminationStrategy: PID 28126 died... 17:18:36.315056 run iperf3-srv_10.42.42.10(pid=28126): Terminated {rc=256} 17:18:36.361762 --- ParallelTerminationStrategy: PID 28127 died... 17:18:36.381372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28127): Terminated: ok {rc=0} 17:18:36.428179 --- ParallelTerminationStrategy: PID 28128 died... 17:18:36.447835 run iperf3-srv_10.42.42.10(pid=28128): Terminated {rc=256} 17:18:36.494396 --- ParallelTerminationStrategy: PID 28129 died... 17:18:36.514110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28129): Terminated: ok {rc=0} 17:18:36.561145 --- ParallelTerminationStrategy: PID 28130 died... 17:18:36.580719 run iperf3-srv_10.42.42.10(pid=28130): Terminated {rc=256} 17:18:36.627578 --- ParallelTerminationStrategy: PID 28133 died... 17:18:36.647480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28133): Terminated: ok {rc=0} 17:18:36.694509 --- ParallelTerminationStrategy: PID 28136 died... 17:18:36.714713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28136): Terminated: ok {rc=0} 17:18:36.761615 --- ParallelTerminationStrategy: PID 28139 died... 17:18:36.781439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28139): Terminated: ok {rc=0} 17:18:36.871757 bus /gobi_4: Setting Powered False 17:18:37.971475 bus /gobi_4: Setting Powered False 17:18:39.089405 bus /gobi_1: Setting Powered False 17:18:40.188792 bus /gobi_1: Setting Powered False 17:18:41.306338 bus /gobi_0: Setting Powered False 17:18:42.405570 bus /gobi_0: Setting Powered False 17:18:43.522540 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:18:44.625640 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.637769 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:44.697841 tst ping.py: using LAC 29434 17:18:44.826126 tst ping.py: using RAC 109 17:18:44.953435 tst ping.py: using CellId 29434 17:18:45.081604 tst ping.py: using BVCI 29435 17:18:45.193296 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:45.204280 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:45.215100 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:45.226828 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:45.238123 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:45.249438 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:45.260604 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:45.271887 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:45.391936 tst ping.py:19: start network... 17:18:45.611488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:46.125290 run create_hlr_db(pid=28141): Launched 17:18:46.284674 bus /gobi_6: Setting Powered False 17:18:47.350087 run create_hlr_db(pid=28141): Terminated: ok {rc=0} 17:18:47.797534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28143): Launched 17:18:48.124474 run osmo-hlr_10.42.42.2(pid=28144): Launched 17:18:48.247320 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:48.820685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28146): Launched 17:18:49.147299 run osmo-stp_10.42.42.5(pid=28147): Launched 17:18:49.270507 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:49.833267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28149): Launched 17:18:49.956459 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:50.231761 run patchelf(pid=28150): Launched 17:18:50.412156 run osmo-stp_10.42.42.5(pid=28147): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28147)] 17:18:50.549339 run osmo-stp_10.42.42.5(pid=28147): stdout: | (launched: 2022-12-10_17:18:49.085878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:50.688416 run osmo-stp_10.42.42.5(pid=28147): stderr: | 20221210171849283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171849283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171849283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171849283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171849284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171849284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171849284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:50.827126 run osmo-stp_10.42.42.5(pid=28147): stdout: | (launched: 2022-12-10_17:18:49.085878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:50.959666 run osmo-stp_10.42.42.5(pid=28147): stderr: | 20221210171849283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171849283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171849283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171849283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171849284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171849284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171849284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:51.116812 run patchelf(pid=28150): Terminating (SIGINT) 17:18:51.297838 run patchelf(pid=28150): Terminated: ok {rc=0} 17:18:51.428202 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28147): Process ended prematurely: osmo-stp_10.42.42.5(pid=28147) [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28147)] [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 17:18:51.437662 tst ping.py:22: Test FAILED (6.8 sec) 17:18:51.466229 run osmo-hlr_10.42.42.2(pid=28144): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28144)] 17:18:51.517509 run osmo-hlr_10.42.42.2(pid=28144): stdout: | (launched: 2022-12-10_17:18:48.063205) 17:18:51.569880 run osmo-hlr_10.42.42.2(pid=28144): stderr: | 20221210171848265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171848265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171848265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171848265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171848265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171848265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171848277 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171848285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171848285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171848285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:51.622614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28143): Terminating (SIGTERM) 17:18:51.665171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28146): Terminating (SIGTERM) 17:18:51.707975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28149): Terminating (SIGTERM) 17:18:51.750792 --- ParallelTerminationStrategy: PID 28143 died... 17:18:51.770942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28143): Terminated: ok {rc=0} 17:18:51.818055 --- ParallelTerminationStrategy: PID 28146 died... 17:18:51.837732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28146): Terminated: ok {rc=0} 17:18:51.884925 --- ParallelTerminationStrategy: PID 28149 died... 17:18:51.905064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28149): Terminated: ok {rc=0} 17:18:51.994004 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:18:53.082403 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:53.094374 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:53.152255 tst ping_idle_ping.py: using LAC 29435 17:18:53.272085 tst ping_idle_ping.py: using RAC 110 17:18:53.392919 tst ping_idle_ping.py: using CellId 29435 17:18:53.512148 tst ping_idle_ping.py: using BVCI 29436 17:18:53.623716 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:53.634742 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:53.645506 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:53.656150 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:53.666891 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:53.677490 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:53.688267 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:53.698985 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:53.814392 tst ping_idle_ping.py:24: start network... 17:18:54.018384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:54.496206 run create_hlr_db(pid=28151): Launched 17:18:54.621297 bus /gobi_6: Setting Powered False 17:18:55.682379 run create_hlr_db(pid=28151): Terminated: ok {rc=0} 17:18:56.131941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28154): Launched 17:18:56.462305 run osmo-hlr_10.42.42.2(pid=28155): Launched 17:18:56.589508 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:57.153231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28157): Launched 17:18:57.481832 run osmo-stp_10.42.42.5(pid=28158): Launched 17:18:57.606024 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:58.173506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28160): Launched 17:18:58.298900 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:58.578078 run patchelf(pid=28161): Launched 17:18:58.760202 run osmo-stp_10.42.42.5(pid=28158): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28158)] 17:18:58.898736 run osmo-stp_10.42.42.5(pid=28158): stdout: | (launched: 2022-12-10_17:18:57.419338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:59.038718 run osmo-stp_10.42.42.5(pid=28158): stderr: | 20221210171857618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171857618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171857618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171857619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171857619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171857619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171857619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:59.178896 run osmo-stp_10.42.42.5(pid=28158): stdout: | (launched: 2022-12-10_17:18:57.419338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:59.313085 run osmo-stp_10.42.42.5(pid=28158): stderr: | 20221210171857618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171857618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171857618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171857619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171857619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171857619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171857619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:59.472300 run patchelf(pid=28161): Terminating (SIGINT) 17:18:59.655123 run patchelf(pid=28161): Terminated: ok {rc=0} 17:18:59.787351 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28158): Process ended prematurely: osmo-stp_10.42.42.5(pid=28158) [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28158)] [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:18:59.796728 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:18:59.825412 run osmo-hlr_10.42.42.2(pid=28155): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28155)] 17:18:59.876276 run osmo-hlr_10.42.42.2(pid=28155): stdout: | (launched: 2022-12-10_17:18:56.400574) 17:18:59.928933 run osmo-hlr_10.42.42.2(pid=28155): stderr: | 20221210171856602 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171856602 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171856602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171856602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171856603 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171856603 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171856615 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171856625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171856625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171856625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:59.981921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28154): Terminating (SIGTERM) 17:19:00.024572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28157): Terminating (SIGTERM) 17:19:00.067188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28160): Terminating (SIGTERM) 17:19:00.110043 --- ParallelTerminationStrategy: PID 28154 died... 17:19:00.130153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28154): Terminated: ok {rc=0} 17:19:00.177323 --- ParallelTerminationStrategy: PID 28157 died... 17:19:00.197612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28157): Terminated: ok {rc=0} 17:19:00.244704 --- ParallelTerminationStrategy: PID 28160 died... 17:19:00.264481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28160): Terminated: ok {rc=0} 17:19:00.353308 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:19:01.642810 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:19:01.652363 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:19:01.679717 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:19:01.731001 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:19:01.835793 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:19:01.860001 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:19:01.903016 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:19:02.486934 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:19:02.541912 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.553436 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:19:02.616143 tst cs_paging_gprs_active.py: using LAC 29436 17:19:02.745952 tst cs_paging_gprs_active.py: using RAC 111 17:19:02.875420 tst cs_paging_gprs_active.py: using CellId 29436 17:19:02.996507 tst cs_paging_gprs_active.py: using BVCI 29437 17:19:03.109198 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:03.120298 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:03.131009 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:03.141979 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:03.152570 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:03.163326 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:03.174073 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:03.184538 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:03.199600 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:03.319677 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:03.440300 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:19:03.665239 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:03.999280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28166): Launched 17:19:04.288613 run iperf3-srv_10.42.42.10(pid=28167): Launched 17:19:04.413730 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:19:04.637041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:04.971390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28168): Launched 17:19:05.260695 run iperf3-srv_10.42.42.10(pid=28169): Launched 17:19:05.385176 tst cs_paging_gprs_active.py:38: start network... 17:19:05.607899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:06.122802 run create_hlr_db(pid=28170): Launched 17:19:06.249945 bus /gobi_6: Setting Powered False 17:19:07.314592 run create_hlr_db(pid=28170): Terminated: ok {rc=0} 17:19:07.758565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28172): Launched 17:19:08.072031 run osmo-hlr_10.42.42.2(pid=28173): Launched 17:19:08.190218 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:08.740318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28175): Launched 17:19:09.052271 run osmo-stp_10.42.42.5(pid=28176): Launched 17:19:09.170186 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:09.707742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28178): Launched 17:19:09.826643 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:10.090618 run patchelf(pid=28179): Launched 17:19:10.262932 run osmo-stp_10.42.42.5(pid=28176): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28176)] 17:19:10.393719 run osmo-stp_10.42.42.5(pid=28176): stdout: | (launched: 2022-12-10_17:19:08.993288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:10.525785 run osmo-stp_10.42.42.5(pid=28176): stderr: | 20221210171909168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171909168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171909168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171909168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171909169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171909169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171909169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:10.658316 run osmo-stp_10.42.42.5(pid=28176): stdout: | (launched: 2022-12-10_17:19:08.993288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:10.785323 run osmo-stp_10.42.42.5(pid=28176): stderr: | 20221210171909168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171909168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171909168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171909168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171909169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171909169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171909169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:10.935901 run patchelf(pid=28179): Terminating (SIGINT) 17:19:11.108658 run patchelf(pid=28179): Terminated: ok {rc=0} 17:19:11.233687 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28176): Process ended prematurely: osmo-stp_10.42.42.5(pid=28176) [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28176)] [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:19:11.243052 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:19:11.270345 run osmo-hlr_10.42.42.2(pid=28173): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28173)] 17:19:11.318292 run osmo-hlr_10.42.42.2(pid=28173): stdout: | (launched: 2022-12-10_17:19:08.012560) 17:19:11.367886 run osmo-hlr_10.42.42.2(pid=28173): stderr: | 20221210171908194 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171908194 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171908194 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171908194 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171908194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171908194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171908206 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171908217 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171908217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171908217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:11.417768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28166): Terminating (SIGTERM) 17:19:11.457978 run iperf3-srv_10.42.42.10(pid=28167): Terminating (SIGTERM) 17:19:11.498094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28168): Terminating (SIGTERM) 17:19:11.538188 run iperf3-srv_10.42.42.10(pid=28169): Terminating (SIGTERM) 17:19:11.577983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28172): Terminating (SIGTERM) 17:19:11.617885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28175): Terminating (SIGTERM) 17:19:11.658185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28178): Terminating (SIGTERM) 17:19:11.698298 --- ParallelTerminationStrategy: PID 28166 died... 17:19:11.717355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28166): Terminated: ok {rc=0} 17:19:11.761506 --- ParallelTerminationStrategy: PID 28167 died... 17:19:11.779948 run iperf3-srv_10.42.42.10(pid=28167): Terminated {rc=256} 17:19:11.823827 --- ParallelTerminationStrategy: PID 28168 died... 17:19:11.842481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28168): Terminated: ok {rc=0} 17:19:11.886411 --- ParallelTerminationStrategy: PID 28169 died... 17:19:11.905552 run iperf3-srv_10.42.42.10(pid=28169): Terminated {rc=256} 17:19:11.950024 --- ParallelTerminationStrategy: PID 28172 died... 17:19:11.968488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28172): Terminated: ok {rc=0} 17:19:12.012851 --- ParallelTerminationStrategy: PID 28175 died... 17:19:12.031844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28175): Terminated: ok {rc=0} 17:19:12.075825 --- ParallelTerminationStrategy: PID 28178 died... 17:19:12.094482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28178): Terminated: ok {rc=0} 17:19:12.180435 bus /gobi_0: Setting Powered False 17:19:13.281061 bus /gobi_0: Setting Powered False 17:19:14.396706 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:19:15.549247 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.561774 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:19:15.623589 tst iperf3.py: using LAC 29437 17:19:15.755280 tst iperf3.py: using RAC 112 17:19:15.892659 tst iperf3.py: using CellId 29437 17:19:16.029231 tst iperf3.py: using BVCI 29438 17:19:16.180734 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:16.195898 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:16.209880 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:16.223683 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:16.239551 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:16.253737 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:16.267533 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:16.281720 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:16.297969 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:16.423401 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:19:16.640133 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:16.969069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28180): Launched 17:19:17.291253 run iperf3-srv_10.42.42.10(pid=28181): Launched 17:19:17.425987 tst iperf3.py:8: start network... 17:19:17.650157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:18.167822 run create_hlr_db(pid=28182): Launched 17:19:18.294738 bus /gobi_6: Setting Powered False 17:19:19.359881 run create_hlr_db(pid=28182): Terminated: ok {rc=0} 17:19:19.806047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28184): Launched 17:19:20.118834 run osmo-hlr_10.42.42.2(pid=28185): Launched 17:19:20.237304 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:20.775016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28187): Launched 17:19:21.087409 run osmo-stp_10.42.42.5(pid=28188): Launched 17:19:21.205883 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:21.743923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28190): Launched 17:19:21.862863 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:22.127174 run patchelf(pid=28191): Launched 17:19:22.299434 run osmo-stp_10.42.42.5(pid=28188): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28188)] 17:19:22.430530 run osmo-stp_10.42.42.5(pid=28188): stdout: | (launched: 2022-12-10_17:19:21.028234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:22.563446 run osmo-stp_10.42.42.5(pid=28188): stderr: | 20221210171921202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171921202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171921202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171921202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171921205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171921205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171921205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:22.696221 run osmo-stp_10.42.42.5(pid=28188): stdout: | (launched: 2022-12-10_17:19:21.028234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:22.823077 run osmo-stp_10.42.42.5(pid=28188): stderr: | 20221210171921202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171921202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171921202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171921202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171921205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171921205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171921205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:22.973925 run patchelf(pid=28191): Terminating (SIGINT) 17:19:23.147598 run patchelf(pid=28191): Terminated: ok {rc=0} 17:19:23.272283 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28188): Process ended prematurely: osmo-stp_10.42.42.5(pid=28188) [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28188)] [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 17:19:23.281786 tst iperf3.py:8: Test FAILED (7.8 sec) 17:19:23.308842 run osmo-hlr_10.42.42.2(pid=28185): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28185)] 17:19:23.356841 run osmo-hlr_10.42.42.2(pid=28185): stdout: | (launched: 2022-12-10_17:19:20.059437) 17:19:23.406401 run osmo-hlr_10.42.42.2(pid=28185): stderr: | 20221210171920243 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171920243 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171920243 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171920244 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171920244 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171920244 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171920256 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171920266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171920266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171920266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:23.456410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28180): Terminating (SIGTERM) 17:19:23.496246 run iperf3-srv_10.42.42.10(pid=28181): Terminating (SIGTERM) 17:19:23.535853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28184): Terminating (SIGTERM) 17:19:23.575853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28187): Terminating (SIGTERM) 17:19:23.615611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28190): Terminating (SIGTERM) 17:19:23.655848 --- ParallelTerminationStrategy: PID 28180 died... 17:19:23.674999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28180): Terminated: ok {rc=0} 17:19:23.719635 --- ParallelTerminationStrategy: PID 28181 died... 17:19:23.738938 run iperf3-srv_10.42.42.10(pid=28181): Terminated {rc=256} 17:19:23.783206 --- ParallelTerminationStrategy: PID 28184 died... 17:19:23.802010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28184): Terminated: ok {rc=0} 17:19:23.846366 --- ParallelTerminationStrategy: PID 28187 died... 17:19:23.865267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28187): Terminated: ok {rc=0} 17:19:23.909379 --- ParallelTerminationStrategy: PID 28190 died... 17:19:23.928286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28190): Terminated: ok {rc=0} 17:19:24.014877 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:19:25.167499 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.179878 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:19:25.240710 tst iperf3m4.py: using LAC 29438 17:19:25.370733 tst iperf3m4.py: using RAC 113 17:19:25.503994 tst iperf3m4.py: using CellId 29438 17:19:25.633207 tst iperf3m4.py: using BVCI 29439 17:19:25.754467 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.766084 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.777427 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.788860 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.800340 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.811995 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.823806 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.835270 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.847179 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:25.966156 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:26.088822 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:26.211559 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:26.333239 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:19:26.556785 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:26.890920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28192): Launched 17:19:27.180445 run iperf3-srv_10.42.42.10(pid=28193): Launched 17:19:27.304145 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:19:27.526633 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:27.860423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28194): Launched 17:19:28.149170 run iperf3-srv_10.42.42.10(pid=28195): Launched 17:19:28.273198 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:19:28.495547 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:28.829195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28196): Launched 17:19:29.118509 run iperf3-srv_10.42.42.10(pid=28197): Launched 17:19:29.242281 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:19:29.464046 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:29.797582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28198): Launched 17:19:30.086435 run iperf3-srv_10.42.42.10(pid=28199): Launched 17:19:30.212033 tst iperf3m4.py:8: start network... 17:19:30.434294 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:30.974232 run create_hlr_db(pid=28200): Launched 17:19:31.134030 bus /gobi_6: Setting Powered False 17:19:32.206283 run create_hlr_db(pid=28200): Terminated: ok {rc=0} 17:19:32.666707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28202): Launched 17:19:33.001206 run osmo-hlr_10.42.42.2(pid=28203): Launched 17:19:33.128308 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:33.707521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28205): Launched 17:19:34.040900 run osmo-stp_10.42.42.5(pid=28206): Launched 17:19:34.167958 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:34.743095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28208): Launched 17:19:34.869921 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:35.152325 run patchelf(pid=28209): Launched 17:19:35.337655 run osmo-stp_10.42.42.5(pid=28206): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28206)] 17:19:35.477901 run osmo-stp_10.42.42.5(pid=28206): stdout: | (launched: 2022-12-10_17:19:33.978235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:35.619772 run osmo-stp_10.42.42.5(pid=28206): stderr: | 20221210171934172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171934172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171934172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171934173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171934173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171934173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171934174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:35.762025 run osmo-stp_10.42.42.5(pid=28206): stdout: | (launched: 2022-12-10_17:19:33.978235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:35.898235 run osmo-stp_10.42.42.5(pid=28206): stderr: | 20221210171934172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171934172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171934172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171934173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171934173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171934173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171934174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:36.059203 run patchelf(pid=28209): Terminating (SIGINT) 17:19:36.244323 run patchelf(pid=28209): Terminated: ok {rc=0} 17:19:36.378106 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28206): Process ended prematurely: osmo-stp_10.42.42.5(pid=28206) [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28206)] [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:19:36.388254 tst iperf3m4.py:8: Test FAILED (11.3 sec) 17:19:36.417849 run osmo-hlr_10.42.42.2(pid=28203): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28203)] 17:19:36.469151 run osmo-hlr_10.42.42.2(pid=28203): stdout: | (launched: 2022-12-10_17:19:32.938929) 17:19:36.521609 run osmo-hlr_10.42.42.2(pid=28203): stderr: | 20221210171933139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171933139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171933139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171933139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171933139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171933139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171933150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171933159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171933159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171933159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:36.574732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28192): Terminating (SIGTERM) 17:19:36.616880 run iperf3-srv_10.42.42.10(pid=28193): Terminating (SIGTERM) 17:19:36.659084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28194): Terminating (SIGTERM) 17:19:36.701814 run iperf3-srv_10.42.42.10(pid=28195): Terminating (SIGTERM) 17:19:36.743933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28196): Terminating (SIGTERM) 17:19:36.786387 run iperf3-srv_10.42.42.10(pid=28197): Terminating (SIGTERM) 17:19:36.828483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28198): Terminating (SIGTERM) 17:19:36.870702 run iperf3-srv_10.42.42.10(pid=28199): Terminating (SIGTERM) 17:19:36.913018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28202): Terminating (SIGTERM) 17:19:36.955480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28205): Terminating (SIGTERM) 17:19:36.997878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28208): Terminating (SIGTERM) 17:19:37.040616 --- ParallelTerminationStrategy: PID 28192 died... 17:19:37.060656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28192): Terminated: ok {rc=0} 17:19:37.108036 --- ParallelTerminationStrategy: PID 28193 died... 17:19:37.127675 run iperf3-srv_10.42.42.10(pid=28193): Terminated {rc=256} 17:19:37.174638 --- ParallelTerminationStrategy: PID 28194 died... 17:19:37.194397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28194): Terminated: ok {rc=0} 17:19:37.241337 --- ParallelTerminationStrategy: PID 28195 died... 17:19:37.261004 run iperf3-srv_10.42.42.10(pid=28195): Terminated {rc=256} 17:19:37.307984 --- ParallelTerminationStrategy: PID 28196 died... 17:19:37.327711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28196): Terminated: ok {rc=0} 17:19:37.374755 --- ParallelTerminationStrategy: PID 28197 died... 17:19:37.394430 run iperf3-srv_10.42.42.10(pid=28197): Terminated {rc=256} 17:19:37.441430 --- ParallelTerminationStrategy: PID 28198 died... 17:19:37.461157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28198): Terminated: ok {rc=0} 17:19:37.508166 --- ParallelTerminationStrategy: PID 28199 died... 17:19:37.527983 run iperf3-srv_10.42.42.10(pid=28199): Terminated {rc=256} 17:19:37.574909 --- ParallelTerminationStrategy: PID 28202 died... 17:19:37.594822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28202): Terminated: ok {rc=0} 17:19:37.641753 --- ParallelTerminationStrategy: PID 28205 died... 17:19:37.661475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28205): Terminated: ok {rc=0} 17:19:37.708552 --- ParallelTerminationStrategy: PID 28208 died... 17:19:37.728241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28208): Terminated: ok {rc=0} 17:19:37.816190 bus /gobi_4: Setting Powered False 17:19:38.917016 bus /gobi_4: Setting Powered False 17:19:40.033952 bus /gobi_1: Setting Powered False 17:19:41.132379 bus /gobi_1: Setting Powered False 17:19:42.247817 bus /gobi_0: Setting Powered False 17:19:43.345679 bus /gobi_0: Setting Powered False 17:19:44.463611 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:19:45.571170 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:45.583376 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:19:45.643454 tst ping.py: using LAC 29439 17:19:45.772061 tst ping.py: using RAC 114 17:19:45.902119 tst ping.py: using CellId 29439 17:19:46.039711 tst ping.py: using BVCI 29440 17:19:46.193805 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:46.206526 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:46.218702 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:46.230976 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:46.243623 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:46.256692 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:46.268776 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:46.281111 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:46.412731 tst ping.py:19: start network... 17:19:46.624023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:47.110998 run create_hlr_db(pid=28210): Launched 17:19:47.270260 bus /gobi_6: Setting Powered False 17:19:48.330673 run create_hlr_db(pid=28210): Terminated: ok {rc=0} 17:19:48.777636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28212): Launched 17:19:49.104184 run osmo-hlr_10.42.42.2(pid=28213): Launched 17:19:49.222274 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:49.755096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28215): Launched 17:19:50.062025 run osmo-stp_10.42.42.5(pid=28216): Launched 17:19:50.176395 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:50.702525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28218): Launched 17:19:50.818272 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:51.076827 run patchelf(pid=28219): Launched 17:19:51.246365 run osmo-stp_10.42.42.5(pid=28216): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28216)] 17:19:51.375149 run osmo-stp_10.42.42.5(pid=28216): stdout: | (launched: 2022-12-10_17:19:50.004145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:51.505322 run osmo-stp_10.42.42.5(pid=28216): stderr: | 20221210171950178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171950178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171950179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171950179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171950179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171950179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171950179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:51.635547 run osmo-stp_10.42.42.5(pid=28216): stdout: | (launched: 2022-12-10_17:19:50.004145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:51.760084 run osmo-stp_10.42.42.5(pid=28216): stderr: | 20221210171950178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171950178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171950179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171950179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171950179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171950179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171950179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:51.907552 run patchelf(pid=28219): Terminating (SIGINT) 17:19:52.078227 run patchelf(pid=28219): Terminated: ok {rc=0} 17:19:52.200600 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28216): Process ended prematurely: osmo-stp_10.42.42.5(pid=28216) [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28216)] [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 17:19:52.209542 tst ping.py:22: Test FAILED (6.6 sec) 17:19:52.236497 run osmo-hlr_10.42.42.2(pid=28213): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28213)] 17:19:52.284671 run osmo-hlr_10.42.42.2(pid=28213): stdout: | (launched: 2022-12-10_17:19:49.043087) 17:19:52.334746 run osmo-hlr_10.42.42.2(pid=28213): stderr: | 20221210171949223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171949223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171949223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171949223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171949223 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171949223 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171949235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171949245 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171949245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171949246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:52.385258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28212): Terminating (SIGTERM) 17:19:52.425532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28215): Terminating (SIGTERM) 17:19:52.465521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28218): Terminating (SIGTERM) 17:19:52.505896 --- ParallelTerminationStrategy: PID 28212 died... 17:19:52.525204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28212): Terminated: ok {rc=0} 17:19:52.569658 --- ParallelTerminationStrategy: PID 28215 died... 17:19:52.588157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28215): Terminated: ok {rc=0} 17:19:52.632575 --- ParallelTerminationStrategy: PID 28218 died... 17:19:52.651579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28218): Terminated: ok {rc=0} 17:19:52.738475 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:19:53.829263 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:53.841650 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:19:53.900900 tst ping_idle_ping.py: using LAC 29440 17:19:54.030291 tst ping_idle_ping.py: using RAC 115 17:19:54.157636 tst ping_idle_ping.py: using CellId 29440 17:19:54.284864 tst ping_idle_ping.py: using BVCI 29441 17:19:54.403461 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:54.415111 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:54.426369 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:54.437852 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:54.449221 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:54.460624 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:54.472336 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:54.483865 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:54.599683 tst ping_idle_ping.py:24: start network... 17:19:54.805687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:55.284359 run create_hlr_db(pid=28220): Launched 17:19:55.409548 bus /gobi_6: Setting Powered False 17:19:56.470267 run create_hlr_db(pid=28220): Terminated: ok {rc=0} 17:19:56.918211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28222): Launched 17:19:57.246183 run osmo-hlr_10.42.42.2(pid=28223): Launched 17:19:57.370912 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:57.938084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28225): Launched 17:19:58.266821 run osmo-stp_10.42.42.5(pid=28226): Launched 17:19:58.391516 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:58.957784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28228): Launched 17:19:59.082357 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:59.360075 run patchelf(pid=28229): Launched 17:19:59.542151 run osmo-stp_10.42.42.5(pid=28226): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28226)] 17:19:59.680336 run osmo-stp_10.42.42.5(pid=28226): stdout: | (launched: 2022-12-10_17:19:58.204868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:59.820484 run osmo-stp_10.42.42.5(pid=28226): stderr: | 20221210171958401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171958402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171958402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171958402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171958403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171958403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171958403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:59.960373 run osmo-stp_10.42.42.5(pid=28226): stdout: | (launched: 2022-12-10_17:19:58.204868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:00.095115 run osmo-stp_10.42.42.5(pid=28226): stderr: | 20221210171958401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210171958402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210171958402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210171958402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210171958403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210171958403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210171958403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:00.253990 run patchelf(pid=28229): Terminating (SIGINT) 17:20:00.436216 run patchelf(pid=28229): Terminated: ok {rc=0} 17:20:00.567948 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28226): Process ended prematurely: osmo-stp_10.42.42.5(pid=28226) [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28226)] [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:20:00.577509 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:20:00.606334 run osmo-hlr_10.42.42.2(pid=28223): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28223)] 17:20:00.657116 run osmo-hlr_10.42.42.2(pid=28223): stdout: | (launched: 2022-12-10_17:19:57.184439) 17:20:00.710023 run osmo-hlr_10.42.42.2(pid=28223): stderr: | 20221210171957388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210171957388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210171957388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210171957388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210171957388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210171957388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210171957402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210171957413 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210171957413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210171957413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:00.763119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28222): Terminating (SIGTERM) 17:20:00.805644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28225): Terminating (SIGTERM) 17:20:00.855180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28228): Terminating (SIGTERM) 17:20:00.899812 --- ParallelTerminationStrategy: PID 28222 died... 17:20:00.919631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28222): Terminated: ok {rc=0} 17:20:00.966716 --- ParallelTerminationStrategy: PID 28225 died... 17:20:00.986141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28225): Terminated: ok {rc=0} 17:20:01.031544 --- ParallelTerminationStrategy: PID 28228 died... 17:20:01.051000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28228): Terminated: ok {rc=0} 17:20:01.138431 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:20:02.441256 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:02.447603 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:20:02.468642 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:20:02.503307 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:20:02.555304 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:20:02.575874 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:20:02.609727 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:20:03.169684 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2377 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:20:03.174645 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:03.185978 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:20:03.244824 tst switch_tch_pdch.py: using LAC 29441 17:20:03.364825 tst switch_tch_pdch.py: using RAC 116 17:20:03.481993 tst switch_tch_pdch.py: using CellId 29441 17:20:03.599322 tst switch_tch_pdch.py: using BVCI 29442 17:20:03.710662 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:03.722131 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:03.733524 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:03.744539 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:03.755577 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:03.766635 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:03.777841 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:03.788867 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:20:03.908723 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:20:04.030161 tst switch_tch_pdch.py:51: start network... 17:20:04.250595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:04.755609 run create_hlr_db(pid=28239): Launched 17:20:04.878836 bus /gobi_6: Setting Powered False 17:20:05.942616 run create_hlr_db(pid=28239): Terminated: ok {rc=0} 17:20:06.396415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28241): Launched 17:20:06.722095 run osmo-hlr_10.42.42.2(pid=28242): Launched 17:20:06.847986 run osmo-stp_10.42.42.5: Starting osmo-stp 17:20:07.408368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28244): Launched 17:20:07.733399 run osmo-stp_10.42.42.5(pid=28245): Launched 17:20:07.856436 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:20:08.417524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28247): Launched 17:20:08.541653 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:20:08.817428 run patchelf(pid=28248): Launched 17:20:08.997317 run osmo-stp_10.42.42.5(pid=28245): ERR: Terminated: ERROR {rc=1} [trial-2377↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28245)] 17:20:09.134370 run osmo-stp_10.42.42.5(pid=28245): stdout: | (launched: 2022-12-10_17:20:07.671778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:09.272704 run osmo-stp_10.42.42.5(pid=28245): stderr: | 20221210172007864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172007865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172007865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172007865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172007868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172007868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172007868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:09.411475 run osmo-stp_10.42.42.5(pid=28245): stdout: | (launched: 2022-12-10_17:20:07.671778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:09.543989 run osmo-stp_10.42.42.5(pid=28245): stderr: | 20221210172007864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172007865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172007865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172007865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172007868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172007868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172007868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:09.700863 run patchelf(pid=28248): Terminating (SIGINT) 17:20:09.882095 run patchelf(pid=28248): Terminated: ok {rc=0} 17:20:10.012535 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28245): Process ended prematurely: osmo-stp_10.42.42.5(pid=28245) [trial-2377↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28245)] [trial-2377↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:20:10.021982 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 17:20:10.050603 run osmo-hlr_10.42.42.2(pid=28242): ERR: Terminated: ERROR {rc=237} [trial-2377↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28242)] 17:20:10.101231 run osmo-hlr_10.42.42.2(pid=28242): stdout: | (launched: 2022-12-10_17:20:06.660165) 17:20:10.153843 run osmo-hlr_10.42.42.2(pid=28242): stderr: | 20221210172006860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172006860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172006860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172006860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172006860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172006860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172006873 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172006881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172006881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172006881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:10.206698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28241): Terminating (SIGTERM) 17:20:10.249039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28244): Terminating (SIGTERM) 17:20:10.291582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28247): Terminating (SIGTERM) 17:20:10.334485 --- ParallelTerminationStrategy: PID 28241 died... 17:20:10.354697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28241): Terminated: ok {rc=0} 17:20:10.401832 --- ParallelTerminationStrategy: PID 28244 died... 17:20:10.421582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28244): Terminated: ok {rc=0} 17:20:10.468326 --- ParallelTerminationStrategy: PID 28247 died... 17:20:10.487865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28247): Terminated: ok {rc=0} 17:20:10.575265 bus /gobi_0: Setting Powered False 17:20:11.673693 bus /gobi_0: Setting Powered False 17:20:12.788302 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:20:14.024224 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:14.029983 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:20:14.050710 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:20:14.085250 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:20:14.139347 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:20:14.160939 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:20:14.196670 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:20:14.751094 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2377 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:20:14.756368 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:14.767841 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:20:14.825966 tst switch_tch_pdch.py: using LAC 29442 17:20:14.952903 tst switch_tch_pdch.py: using RAC 117 17:20:15.080468 tst switch_tch_pdch.py: using CellId 29442 17:20:15.208357 tst switch_tch_pdch.py: using BVCI 29443 17:20:15.327579 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:15.339175 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:15.350495 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:15.361967 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:15.373389 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:15.384640 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:15.396493 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:15.407977 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:20:15.523759 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:20:15.643938 tst switch_tch_pdch.py:51: start network... 17:20:15.888807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:16.398694 run create_hlr_db(pid=28252): Launched 17:20:16.556828 bus /gobi_6: Setting Powered False 17:20:17.620826 run create_hlr_db(pid=28252): Terminated: ok {rc=0} 17:20:18.031842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28254): Launched 17:20:18.339034 run osmo-hlr_10.42.42.2(pid=28255): Launched 17:20:18.454060 run osmo-stp_10.42.42.5: Starting osmo-stp 17:20:18.951262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28257): Launched 17:20:19.255085 run osmo-stp_10.42.42.5(pid=28258): Launched 17:20:19.369932 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:20:19.870542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28260): Launched 17:20:19.986024 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:20:20.244360 run patchelf(pid=28261): Launched 17:20:20.413512 run osmo-stp_10.42.42.5(pid=28258): ERR: Terminated: ERROR {rc=1} [trial-2377↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28258)] 17:20:20.542214 run osmo-stp_10.42.42.5(pid=28258): stdout: | (launched: 2022-12-10_17:20:19.197134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:20.671989 run osmo-stp_10.42.42.5(pid=28258): stderr: | 20221210172019371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172019371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172019372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172019372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172019373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172019373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172019373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:20.802114 run osmo-stp_10.42.42.5(pid=28258): stdout: | (launched: 2022-12-10_17:20:19.197134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:20.926194 run osmo-stp_10.42.42.5(pid=28258): stderr: | 20221210172019371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172019371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172019372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172019372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172019373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172019373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172019373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:21.073252 run patchelf(pid=28261): Terminating (SIGINT) 17:20:21.242633 run patchelf(pid=28261): Terminated: ok {rc=0} 17:20:21.364823 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28258): Process ended prematurely: osmo-stp_10.42.42.5(pid=28258) [trial-2377↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28258)] [trial-2377↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:20:21.373788 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 17:20:21.400566 run osmo-hlr_10.42.42.2(pid=28255): ERR: Terminated: ERROR {rc=237} [trial-2377↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28255)] 17:20:21.448748 run osmo-hlr_10.42.42.2(pid=28255): stdout: | (launched: 2022-12-10_17:20:18.280738) 17:20:21.498607 run osmo-hlr_10.42.42.2(pid=28255): stderr: | 20221210172018459 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172018459 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172018459 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172018459 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172018459 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172018459 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172018474 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172018484 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172018484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172018484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:21.548741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28254): Terminating (SIGTERM) 17:20:21.588910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28257): Terminating (SIGTERM) 17:20:21.628993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28260): Terminating (SIGTERM) 17:20:21.669325 --- ParallelTerminationStrategy: PID 28254 died... 17:20:21.688672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28254): Terminated: ok {rc=0} 17:20:21.733193 --- ParallelTerminationStrategy: PID 28257 died... 17:20:21.751717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28257): Terminated: ok {rc=0} 17:20:21.796064 --- ParallelTerminationStrategy: PID 28260 died... 17:20:21.814926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28260): Terminated: ok {rc=0} 17:20:21.901344 bus /gobi_0: Setting Powered False 17:20:23.003218 bus /gobi_0: Setting Powered False 17:20:24.117212 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 nitb_sms:oc2g --------------------------------------------------------------------- 17:20:25.356101 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:25.361107 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 17:20:25.383570 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 17:20:25.391217 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 17:20:25.447035 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 17:20:25.468689 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 17:20:25.475498 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 17:20:26.010805 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 17:20:26.015956 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 17:20:26.027141 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 17:20:26.063485 tst mo_mt_sms.py: using LAC 29443 17:20:26.190530 tst mo_mt_sms.py: using RAC 118 17:20:26.318373 tst mo_mt_sms.py: using CellId 29443 17:20:26.443906 tst mo_mt_sms.py: using BVCI 29444 17:20:26.562085 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 17:20:26.676902 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 17:20:26.797318 tst mo_mt_sms.py:9: start nitb and bts... 17:20:27.000634 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:20:27.623076 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28266): Launched 17:20:27.929728 run osmo-nitb_10.42.42.2(pid=28267): Launched 17:20:28.097693 run osmo-nitb_10.42.42.2(pid=28267): ERR: Terminated: ERROR {rc=2} [trial-2377↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28267)] 17:20:28.234230 run osmo-nitb_10.42.42.2(pid=28267): stdout: | (launched: 2022-12-10_17:20:27.871833) 17:20:28.371856 run osmo-nitb_10.42.42.2(pid=28267): stderr: | (launched: 2022-12-10_17:20:27.917055) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:28.509582 run osmo-nitb_10.42.42.2(pid=28267): stdout: | (launched: 2022-12-10_17:20:27.871833) 17:20:28.641747 run osmo-nitb_10.42.42.2(pid=28267): stderr: | (launched: 2022-12-10_17:20:27.917055) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f2803594268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28267): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28267) [trial-2377↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28267)] 17:20:29.044442 tst osmo-nitb_10.42.42.2(pid=28267): stdout: | (launched: 2022-12-10_17:20:27.871833) 17:20:29.167115 tst osmo-nitb_10.42.42.2(pid=28267): stderr: | (launched: 2022-12-10_17:20:27.917055) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:29.311323 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28267): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28267) [trial-2377↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28267)] [trial-2377↪nitb_sms:oc2g↪mo_mt_sms.py:11] 17:20:29.319835 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 17:20:29.326450 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28266): Terminating (SIGTERM) 17:20:29.535313 --- ParallelTerminationStrategy: PID 28266 died... 17:20:29.556100 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28266): Terminated: ok {rc=0} 17:20:29.643018 bus /sierra_3: Setting Powered False 17:20:30.743545 bus /sierra_3: Setting Powered False 17:20:31.859124 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 sms:oc2g --------------------------------------------------------------------- 17:20:33.053849 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:33.058237 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 17:20:33.080280 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 17:20:33.108073 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 17:20:33.163327 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 17:20:33.185514 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 17:20:33.213275 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 17:20:33.754830 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 sms:oc2g mo_mt_sms.py ---------------------------------------------- 17:20:33.759736 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:33.770334 tst sms:oc2g: Using 1 x bts (candidates: 1) 17:20:33.804396 tst mo_mt_sms.py: using LAC 29444 17:20:33.923289 tst mo_mt_sms.py: using RAC 119 17:20:34.043374 tst mo_mt_sms.py: using CellId 29444 17:20:34.162951 tst mo_mt_sms.py: using BVCI 29445 17:20:34.273530 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:34.284390 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:34.294926 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:34.305592 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:34.316060 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:34.326497 tst sms:oc2g: Using 1 x modem (candidates: 2) 17:20:34.445414 tst sms:oc2g: Using 1 x modem (candidates: 2) 17:20:34.562719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:35.036471 run create_hlr_db(pid=28271): Launched 17:20:35.160620 bus /sierra_2: Setting Powered False 17:20:36.221669 run create_hlr_db(pid=28271): Terminated: ok {rc=0} 17:20:36.667382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28273): Launched 17:20:36.993607 run osmo-hlr_10.42.42.2(pid=28274): Launched 17:20:37.116702 run osmo-stp_10.42.42.5: Starting osmo-stp 17:20:37.678236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28276): Launched 17:20:38.006642 run osmo-stp_10.42.42.5(pid=28277): Launched 17:20:38.129502 run osmo-msc_10.42.42.6: Starting osmo-msc 17:20:38.720519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28279): Launched 17:20:39.048463 run osmo-msc_10.42.42.6(pid=28280): Launched 17:20:39.229471 run osmo-stp_10.42.42.5(pid=28277): ERR: Terminated: ERROR {rc=1} [trial-2377↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28277)] 17:20:39.367634 run osmo-stp_10.42.42.5(pid=28277): stdout: | (launched: 2022-12-10_17:20:37.944598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:39.506264 run osmo-stp_10.42.42.5(pid=28277): stderr: | 20221210172038139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172038139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172038139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172038140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172038140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172038140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172038140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:39.643856 run osmo-stp_10.42.42.5(pid=28277): stdout: | (launched: 2022-12-10_17:20:37.944598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:39.774129 run osmo-stp_10.42.42.5(pid=28277): stderr: | 20221210172038139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172038139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172038139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172038140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172038140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172038140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172038140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:39.929030 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28277): Process ended prematurely: osmo-stp_10.42.42.5(pid=28277) [trial-2377↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28277)] [trial-2377↪sms:oc2g↪mo_mt_sms.py:16] 17:20:39.938127 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 17:20:39.966294 run osmo-hlr_10.42.42.2(pid=28274): ERR: Terminated: ERROR {rc=237} [trial-2377↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28274)] 17:20:40.017177 run osmo-hlr_10.42.42.2(pid=28274): stdout: | (launched: 2022-12-10_17:20:36.932169) 17:20:40.070123 run osmo-hlr_10.42.42.2(pid=28274): stderr: | 20221210172037133 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172037133 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172037133 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172037133 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172037133 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172037133 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172037146 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172037154 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172037154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172037154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:40.143727 run osmo-msc_10.42.42.6(pid=28280): ERR: Terminated: ERROR {rc=2} [trial-2377↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28280)] 17:20:40.194898 run osmo-msc_10.42.42.6(pid=28280): stdout: | (launched: 2022-12-10_17:20:38.986814) 17:20:40.247693 run osmo-msc_10.42.42.6(pid=28280): stderr: | 20221210172039312 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172039312 DLGLOBAL DEBUG validating counter group 0x7feb27443c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172039312 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172039313 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172039313 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172039313 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172039315 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172039315 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172039315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172039315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:20:40.300903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28273): Terminating (SIGTERM) 17:20:40.343674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28276): Terminating (SIGTERM) 17:20:40.386432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28279): Terminating (SIGTERM) 17:20:40.429372 --- ParallelTerminationStrategy: PID 28273 died... 17:20:40.449679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28273): Terminated: ok {rc=0} 17:20:40.496846 --- ParallelTerminationStrategy: PID 28276 died... 17:20:40.517064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28276): Terminated: ok {rc=0} 17:20:40.564287 --- ParallelTerminationStrategy: PID 28279 died... 17:20:40.584129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28279): Terminated: ok {rc=0} 17:20:40.674005 bus /sierra_3: Setting Powered False 17:20:41.774509 bus /sierra_3: Setting Powered False 17:20:42.893325 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 nitb_ussd:oc2g --------------------------------------------------------------------- 17:20:44.108496 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:44.112481 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 17:20:44.134673 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 17:20:44.142895 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 17:20:44.179120 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 17:20:44.200587 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 17:20:44.208019 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 17:20:44.727227 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2377 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 17:20:44.732092 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 17:20:44.742821 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 17:20:44.776551 tst assert_extension.py: using LAC 29445 17:20:44.899228 tst assert_extension.py: using RAC 120 17:20:45.018282 tst assert_extension.py: using CellId 29445 17:20:45.137826 tst assert_extension.py: using BVCI 29446 17:20:45.247151 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 17:20:45.365986 tst assert_extension.py:10: start nitb and bts... 17:20:45.585334 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:20:46.256444 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28285): Launched 17:20:46.602671 run osmo-nitb_10.42.42.2(pid=28286): Launched 17:20:46.801759 run osmo-nitb_10.42.42.2(pid=28286): ERR: Terminated: ERROR {rc=2} [trial-2377↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28286)] 17:20:46.951336 run osmo-nitb_10.42.42.2(pid=28286): stdout: | (launched: 2022-12-10_17:20:46.537295) 17:20:47.102307 run osmo-nitb_10.42.42.2(pid=28286): stderr: | (launched: 2022-12-10_17:20:46.586741) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:47.246472 run osmo-nitb_10.42.42.2(pid=28286): stdout: | (launched: 2022-12-10_17:20:46.537295) 17:20:47.379779 run osmo-nitb_10.42.42.2(pid=28286): stderr: | (launched: 2022-12-10_17:20:46.586741) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f2803594268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28286): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28286) [trial-2377↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28286)] 17:20:47.742882 tst osmo-nitb_10.42.42.2(pid=28286): stdout: | (launched: 2022-12-10_17:20:46.537295) 17:20:47.865728 tst osmo-nitb_10.42.42.2(pid=28286): stderr: | (launched: 2022-12-10_17:20:46.586741) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:48.010076 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28286): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28286) [trial-2377↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28286)] [trial-2377↪nitb_ussd:oc2g↪assert_extension.py:12] 17:20:48.018305 tst assert_extension.py:12: Test FAILED (3.3 sec) 17:20:48.024899 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28285): Terminating (SIGTERM) 17:20:48.233970 --- ParallelTerminationStrategy: PID 28285 died... 17:20:48.255141 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28285): Terminated: ok {rc=0} 17:20:48.342490 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 ussd:oc2g --------------------------------------------------------------------- 17:20:49.520255 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:49.523953 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 17:20:49.544538 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 17:20:49.571434 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 17:20:49.606536 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 17:20:49.627370 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 17:20:49.653997 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 17:20:50.181836 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2377 ussd:oc2g assert_extension.py ---------------------------------------------- 17:20:50.186762 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:50.197433 tst ussd:oc2g: Using 1 x bts (candidates: 1) 17:20:50.234516 tst assert_extension.py: using LAC 29446 17:20:50.355928 tst assert_extension.py: using RAC 121 17:20:50.477724 tst assert_extension.py: using CellId 29446 17:20:50.606507 tst assert_extension.py: using BVCI 29447 17:20:50.724367 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:50.735952 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:50.747103 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:50.758453 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:50.769787 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:50.780942 tst ussd:oc2g: Using 1 x modem (candidates: 1) 17:20:50.896175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:51.370002 run create_hlr_db(pid=28290): Launched 17:20:51.494208 bus /sierra_2: Setting Powered False 17:20:52.555870 run create_hlr_db(pid=28290): Terminated: ok {rc=0} 17:20:53.002459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28292): Launched 17:20:53.329338 run osmo-hlr_10.42.42.2(pid=28293): Launched 17:20:53.453735 run osmo-stp_10.42.42.5: Starting osmo-stp 17:20:54.026781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28295): Launched 17:20:54.355849 run osmo-stp_10.42.42.5(pid=28296): Launched 17:20:54.479288 run osmo-msc_10.42.42.6: Starting osmo-msc 17:20:55.070052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28298): Launched 17:20:55.396755 run osmo-msc_10.42.42.6(pid=28299): Launched 17:20:55.579239 run osmo-stp_10.42.42.5(pid=28296): ERR: Terminated: ERROR {rc=1} [trial-2377↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28296)] 17:20:55.716852 run osmo-stp_10.42.42.5(pid=28296): stdout: | (launched: 2022-12-10_17:20:54.294354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:55.855503 run osmo-stp_10.42.42.5(pid=28296): stderr: | 20221210172054490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172054490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172054491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172054491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172054491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172054492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172054492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:55.992729 run osmo-stp_10.42.42.5(pid=28296): stdout: | (launched: 2022-12-10_17:20:54.294354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:56.122235 run osmo-stp_10.42.42.5(pid=28296): stderr: | 20221210172054490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172054490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172054491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172054491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172054491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172054492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172054492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:56.277311 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28296): Process ended prematurely: osmo-stp_10.42.42.5(pid=28296) [trial-2377↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28296)] [trial-2377↪ussd:oc2g↪assert_extension.py:17] 17:20:56.286357 tst assert_extension.py:17: Test FAILED (6.1 sec) 17:20:56.314771 run osmo-hlr_10.42.42.2(pid=28293): ERR: Terminated: ERROR {rc=237} [trial-2377↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28293)] 17:20:56.365804 run osmo-hlr_10.42.42.2(pid=28293): stdout: | (launched: 2022-12-10_17:20:53.267739) 17:20:56.418408 run osmo-hlr_10.42.42.2(pid=28293): stderr: | 20221210172053470 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172053470 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172053470 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172053470 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172053470 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172053470 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172053483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172053493 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172053493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172053493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:56.491889 run osmo-msc_10.42.42.6(pid=28299): ERR: Terminated: ERROR {rc=2} [trial-2377↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28299)] 17:20:56.543312 run osmo-msc_10.42.42.6(pid=28299): stdout: | (launched: 2022-12-10_17:20:55.335150) 17:20:56.595923 run osmo-msc_10.42.42.6(pid=28299): stderr: | 20221210172055657 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172055657 DLGLOBAL DEBUG validating counter group 0x7fca4ca02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172055657 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172055657 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172055657 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172055658 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172055659 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172055660 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172055660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172055660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:20:56.648852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28292): Terminating (SIGTERM) 17:20:56.691359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28295): Terminating (SIGTERM) 17:20:56.734008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28298): Terminating (SIGTERM) 17:20:56.776603 --- ParallelTerminationStrategy: PID 28292 died... 17:20:56.796645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28292): Terminated: ok {rc=0} 17:20:56.843948 --- ParallelTerminationStrategy: PID 28295 died... 17:20:56.863761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28295): Terminated: ok {rc=0} 17:20:56.910615 --- ParallelTerminationStrategy: PID 28298 died... 17:20:56.930232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28298): Terminated: ok {rc=0} 17:20:57.019180 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:20:58.220926 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:58.228279 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:20:58.250872 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:20:58.278871 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:20:58.330650 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:20:58.351909 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:20:58.379787 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:20:58.933228 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:20:58.987153 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:20:58.998717 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:20:59.055416 tst mo_mt_call.py: using LAC 29447 17:20:59.184799 tst mo_mt_call.py: using RAC 122 17:20:59.313147 tst mo_mt_call.py: using CellId 29447 17:20:59.434190 tst mo_mt_call.py: using BVCI 29448 17:20:59.548395 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:20:59.559786 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:20:59.570779 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:20:59.582404 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:20:59.594134 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:20:59.605570 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:20:59.726858 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:20:59.850297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:00.365056 run create_hlr_db(pid=28304): Launched 17:21:00.490983 bus /sierra_2: Setting Powered False 17:21:01.555629 run create_hlr_db(pid=28304): Terminated: ok {rc=0} 17:21:02.068553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28306): Launched 17:21:02.410806 run osmo-hlr_10.42.42.2(pid=28307): Launched 17:21:02.537898 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:03.111021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28309): Launched 17:21:03.445033 run osmo-stp_10.42.42.5(pid=28310): Launched 17:21:03.571967 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:04.173592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28312): Launched 17:21:04.506828 run osmo-msc_10.42.42.6(pid=28313): Launched 17:21:04.691770 run osmo-stp_10.42.42.5(pid=28310): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28310)] 17:21:04.833236 run osmo-stp_10.42.42.5(pid=28310): stdout: | (launched: 2022-12-10_17:21:03.382615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:04.974556 run osmo-stp_10.42.42.5(pid=28310): stderr: | 20221210172103579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172103579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172103579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172103579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172103580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172103580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172103580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:05.113155 run osmo-stp_10.42.42.5(pid=28310): stdout: | (launched: 2022-12-10_17:21:03.382615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:05.245081 run osmo-stp_10.42.42.5(pid=28310): stderr: | 20221210172103579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172103579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172103579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172103579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172103580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172103580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172103580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:05.403297 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28310): Process ended prematurely: osmo-stp_10.42.42.5(pid=28310) [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28310)] [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:21:05.412763 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 17:21:05.441223 run osmo-hlr_10.42.42.2(pid=28307): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28307)] 17:21:05.491599 run osmo-hlr_10.42.42.2(pid=28307): stdout: | (launched: 2022-12-10_17:21:02.348523) 17:21:05.543688 run osmo-hlr_10.42.42.2(pid=28307): stderr: | 20221210172102548 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172102548 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172102548 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172102548 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172102548 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172102548 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172102560 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172102568 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172102569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172102569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:05.616090 run osmo-msc_10.42.42.6(pid=28313): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28313)] 17:21:05.666349 run osmo-msc_10.42.42.6(pid=28313): stdout: | (launched: 2022-12-10_17:21:04.444116) 17:21:05.718377 run osmo-msc_10.42.42.6(pid=28313): stderr: | 20221210172104769 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172104770 DLGLOBAL DEBUG validating counter group 0x7f32af08cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172104770 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172104770 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172104770 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172104770 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172104774 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172104774 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172104774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172104774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:05.770997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28306): Terminating (SIGTERM) 17:21:05.813127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28309): Terminating (SIGTERM) 17:21:05.855031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28312): Terminating (SIGTERM) 17:21:05.897757 --- ParallelTerminationStrategy: PID 28306 died... 17:21:05.917683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28306): Terminated: ok {rc=0} 17:21:05.964367 --- ParallelTerminationStrategy: PID 28309 died... 17:21:05.983772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28309): Terminated: ok {rc=0} 17:21:06.030449 --- ParallelTerminationStrategy: PID 28312 died... 17:21:06.049982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28312): Terminated: ok {rc=0} 17:21:06.138614 bus /sierra_3: Setting Powered False 17:21:07.238372 bus /sierra_3: Setting Powered False 17:21:08.355139 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:21:09.504830 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:09.517186 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:21:09.574819 tst mo_mt_call_osmux.py: using LAC 29448 17:21:09.706450 tst mo_mt_call_osmux.py: using RAC 123 17:21:09.836315 tst mo_mt_call_osmux.py: using CellId 29448 17:21:09.966026 tst mo_mt_call_osmux.py: using BVCI 29449 17:21:10.087810 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:10.099502 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:10.111019 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:10.122707 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:10.134828 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:10.146921 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:21:10.267874 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:21:10.385780 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:10.868771 run create_hlr_db(pid=28315): Launched 17:21:10.994803 bus /sierra_2: Setting Powered False 17:21:12.056067 run create_hlr_db(pid=28315): Terminated: ok {rc=0} 17:21:12.490727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28317): Launched 17:21:12.803905 run osmo-hlr_10.42.42.2(pid=28318): Launched 17:21:12.921181 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:13.456468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28321): Launched 17:21:13.768365 run osmo-stp_10.42.42.5(pid=28322): Launched 17:21:13.887088 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:14.462422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28324): Launched 17:21:14.767229 run osmo-msc_10.42.42.6(pid=28325): Launched 17:21:14.936308 run osmo-stp_10.42.42.5(pid=28322): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28322)] 17:21:15.064557 run osmo-stp_10.42.42.5(pid=28322): stdout: | (launched: 2022-12-10_17:21:13.709322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:15.192375 run osmo-stp_10.42.42.5(pid=28322): stderr: | 20221210172113884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172113884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172113884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172113885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172113887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172113887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172113887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:15.318749 run osmo-stp_10.42.42.5(pid=28322): stdout: | (launched: 2022-12-10_17:21:13.709322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:15.439092 run osmo-stp_10.42.42.5(pid=28322): stderr: | 20221210172113884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172113884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172113884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172113885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172113887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172113887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172113887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:15.582975 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28322): Process ended prematurely: osmo-stp_10.42.42.5(pid=28322) [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28322)] [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:21:15.591832 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:21:15.618249 run osmo-hlr_10.42.42.2(pid=28318): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28318)] 17:21:15.665820 run osmo-hlr_10.42.42.2(pid=28318): stdout: | (launched: 2022-12-10_17:21:12.744673) 17:21:15.714885 run osmo-hlr_10.42.42.2(pid=28318): stderr: | 20221210172112927 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172112927 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172112927 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172112927 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172112927 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172112927 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172112937 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172112946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172112947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172112947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:15.783111 run osmo-msc_10.42.42.6(pid=28325): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28325)] 17:21:15.832054 run osmo-msc_10.42.42.6(pid=28325): stdout: | (launched: 2022-12-10_17:21:14.709586) 17:21:15.893241 run osmo-msc_10.42.42.6(pid=28325): stderr: | 20221210172114983 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172114983 DLGLOBAL DEBUG validating counter group 0x7effabdc1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172114983 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172114983 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172114983 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172114983 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172114985 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172114986 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172114986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172114986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:15.948939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28317): Terminating (SIGTERM) 17:21:15.993509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28321): Terminating (SIGTERM) 17:21:16.039692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28324): Terminating (SIGTERM) 17:21:16.086006 --- ParallelTerminationStrategy: PID 28317 died... 17:21:16.108044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28317): Terminated: ok {rc=0} 17:21:16.159035 --- ParallelTerminationStrategy: PID 28321 died... 17:21:16.179752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28321): Terminated: ok {rc=0} 17:21:16.229841 --- ParallelTerminationStrategy: PID 28324 died... 17:21:16.250791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28324): Terminated: ok {rc=0} 17:21:16.345118 bus /sierra_3: Setting Powered False 17:21:17.446662 bus /sierra_3: Setting Powered False 17:21:18.562935 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:21:19.793706 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:21:19.800294 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:21:19.821028 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:21:19.847437 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:21:19.899592 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:21:19.920042 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:21:19.946076 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:21:20.495087 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:21:20.543678 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:20.554795 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:21:20.610237 tst mo_mt_call.py: using LAC 29449 17:21:20.739493 tst mo_mt_call.py: using RAC 124 17:21:20.867810 tst mo_mt_call.py: using CellId 29449 17:21:20.997762 tst mo_mt_call.py: using BVCI 29450 17:21:21.117497 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:21.128928 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:21.140214 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:21.151619 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:21.163093 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:21.174611 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:21:21.293715 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:21:21.414588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:21.932916 run create_hlr_db(pid=28330): Launched 17:21:22.065394 bus /sierra_2: Setting Powered False 17:21:23.126093 run create_hlr_db(pid=28330): Terminated: ok {rc=0} 17:21:23.551831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28332): Launched 17:21:23.858365 run osmo-hlr_10.42.42.2(pid=28333): Launched 17:21:23.972592 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:24.510311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28335): Launched 17:21:24.817398 run osmo-stp_10.42.42.5(pid=28336): Launched 17:21:24.931566 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:25.480668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28338): Launched 17:21:25.785604 run osmo-msc_10.42.42.6(pid=28339): Launched 17:21:25.955757 run osmo-stp_10.42.42.5(pid=28336): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28336)] 17:21:26.084218 run osmo-stp_10.42.42.5(pid=28336): stdout: | (launched: 2022-12-10_17:21:24.759740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:26.212371 run osmo-stp_10.42.42.5(pid=28336): stderr: | 20221210172124933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172124933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172124934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172124934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172124934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172124935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172124935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:26.338699 run osmo-stp_10.42.42.5(pid=28336): stdout: | (launched: 2022-12-10_17:21:24.759740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:26.459379 run osmo-stp_10.42.42.5(pid=28336): stderr: | 20221210172124933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172124933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172124934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172124934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172124934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172124935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172124935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:26.603773 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28336): Process ended prematurely: osmo-stp_10.42.42.5(pid=28336) [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28336)] [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:21:26.612524 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:21:26.638846 run osmo-hlr_10.42.42.2(pid=28333): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28333)] 17:21:26.686227 run osmo-hlr_10.42.42.2(pid=28333): stdout: | (launched: 2022-12-10_17:21:23.800237) 17:21:26.735744 run osmo-hlr_10.42.42.2(pid=28333): stderr: | 20221210172123981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172123981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172123981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172123981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172123981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172123982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172123994 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172124004 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172124005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172124005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:26.804240 run osmo-msc_10.42.42.6(pid=28339): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28339)] 17:21:26.851454 run osmo-msc_10.42.42.6(pid=28339): stdout: | (launched: 2022-12-10_17:21:25.727785) 17:21:26.900140 run osmo-msc_10.42.42.6(pid=28339): stderr: | 20221210172126003 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172126003 DLGLOBAL DEBUG validating counter group 0x7fe9a05aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172126003 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172126003 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172126003 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172126003 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172126005 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172126006 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172126007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172126007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:26.949348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28332): Terminating (SIGTERM) 17:21:26.988156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28335): Terminating (SIGTERM) 17:21:27.027037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28338): Terminating (SIGTERM) 17:21:27.066284 --- ParallelTerminationStrategy: PID 28332 died... 17:21:27.085090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28332): Terminated: ok {rc=0} 17:21:27.128489 --- ParallelTerminationStrategy: PID 28335 died... 17:21:27.146804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28335): Terminated: ok {rc=0} 17:21:27.189941 --- ParallelTerminationStrategy: PID 28338 died... 17:21:27.208089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28338): Terminated: ok {rc=0} 17:21:27.292696 bus /sierra_3: Setting Powered False 17:21:28.391014 bus /sierra_3: Setting Powered False 17:21:29.506220 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:21:30.650312 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:30.662004 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:21:30.718494 tst mo_mt_call_osmux.py: using LAC 29450 17:21:30.843099 tst mo_mt_call_osmux.py: using RAC 125 17:21:30.979054 tst mo_mt_call_osmux.py: using CellId 29450 17:21:31.147316 tst mo_mt_call_osmux.py: using BVCI 29451 17:21:31.271898 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:31.283807 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:31.295471 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:31.307067 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:31.318728 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:31.331234 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:21:31.464565 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:21:31.610246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:32.147437 run create_hlr_db(pid=28341): Launched 17:21:32.302337 bus /sierra_2: Setting Powered False 17:21:33.362390 run create_hlr_db(pid=28341): Terminated: ok {rc=0} 17:21:33.788379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28343): Launched 17:21:34.094855 run osmo-hlr_10.42.42.2(pid=28344): Launched 17:21:34.209864 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:34.754150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28346): Launched 17:21:35.061245 run osmo-stp_10.42.42.5(pid=28347): Launched 17:21:35.176544 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:35.727805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28349): Launched 17:21:36.034489 run osmo-msc_10.42.42.6(pid=28350): Launched 17:21:36.204158 run osmo-stp_10.42.42.5(pid=28347): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28347)] 17:21:36.332587 run osmo-stp_10.42.42.5(pid=28347): stdout: | (launched: 2022-12-10_17:21:35.003271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:36.460626 run osmo-stp_10.42.42.5(pid=28347): stderr: | 20221210172135176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172135177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172135177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172135177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172135178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172135178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172135178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:36.587342 run osmo-stp_10.42.42.5(pid=28347): stdout: | (launched: 2022-12-10_17:21:35.003271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:36.707901 run osmo-stp_10.42.42.5(pid=28347): stderr: | 20221210172135176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172135177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172135177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172135177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172135178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172135178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172135178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:36.852807 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28347): Process ended prematurely: osmo-stp_10.42.42.5(pid=28347) [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28347)] [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:21:36.861899 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:21:36.888481 run osmo-hlr_10.42.42.2(pid=28344): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28344)] 17:21:36.936329 run osmo-hlr_10.42.42.2(pid=28344): stdout: | (launched: 2022-12-10_17:21:34.036940) 17:21:36.985819 run osmo-hlr_10.42.42.2(pid=28344): stderr: | 20221210172134217 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172134217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172134217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172134217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172134218 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172134218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172134230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172134240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172134241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172134241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:37.055152 run osmo-msc_10.42.42.6(pid=28350): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28350)] 17:21:37.102913 run osmo-msc_10.42.42.6(pid=28350): stdout: | (launched: 2022-12-10_17:21:35.976255) 17:21:37.152218 run osmo-msc_10.42.42.6(pid=28350): stderr: | 20221210172136252 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172136252 DLGLOBAL DEBUG validating counter group 0x7f80b42ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172136252 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172136252 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172136253 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172136253 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172136254 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172136255 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172136255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172136255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:37.201887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28343): Terminating (SIGTERM) 17:21:37.241366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28346): Terminating (SIGTERM) 17:21:37.281084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28349): Terminating (SIGTERM) 17:21:37.321002 --- ParallelTerminationStrategy: PID 28343 died... 17:21:37.340091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28343): Terminated: ok {rc=0} 17:21:37.384075 --- ParallelTerminationStrategy: PID 28346 died... 17:21:37.402665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28346): Terminated: ok {rc=0} 17:21:37.446424 --- ParallelTerminationStrategy: PID 28349 died... 17:21:37.465018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28349): Terminated: ok {rc=0} 17:21:37.549949 bus /sierra_3: Setting Powered False 17:21:38.648633 bus /sierra_3: Setting Powered False 17:21:39.763815 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:21:40.996120 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:21:41.002398 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:21:41.022659 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:21:41.049408 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:21:41.105443 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:21:41.125800 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:21:41.152069 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:21:41.697577 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:21:41.745960 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:41.757067 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:21:41.811530 tst mo_mt_call.py: using LAC 29451 17:21:41.929284 tst mo_mt_call.py: using RAC 126 17:21:42.049467 tst mo_mt_call.py: using CellId 29451 17:21:42.167437 tst mo_mt_call.py: using BVCI 29452 17:21:42.278061 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:42.289168 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:42.299957 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:42.310735 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:42.321600 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:42.332397 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:21:42.450932 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:21:42.571160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:43.081571 run create_hlr_db(pid=28355): Launched 17:21:43.206737 bus /sierra_2: Setting Powered False 17:21:44.270854 run create_hlr_db(pid=28355): Terminated: ok {rc=0} 17:21:44.709565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28357): Launched 17:21:45.035820 run osmo-hlr_10.42.42.2(pid=28358): Launched 17:21:45.149452 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:45.669361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28360): Launched 17:21:46.000148 run osmo-stp_10.42.42.5(pid=28361): Launched 17:21:46.401936 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:47.133440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28363): Launched 17:21:47.446833 run osmo-msc_10.42.42.6(pid=28364): Launched 17:21:47.614306 run osmo-stp_10.42.42.5(pid=28361): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28361)] 17:21:47.740538 run osmo-stp_10.42.42.5(pid=28361): stdout: | (launched: 2022-12-10_17:21:45.933463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:47.867062 run osmo-stp_10.42.42.5(pid=28361): stderr: | 20221210172146279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172146279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172146279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172146281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172146282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172146282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172146283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:47.991786 run osmo-stp_10.42.42.5(pid=28361): stdout: | (launched: 2022-12-10_17:21:45.933463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:48.110780 run osmo-stp_10.42.42.5(pid=28361): stderr: | 20221210172146279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172146279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172146279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172146281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172146282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172146282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172146283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:48.253388 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28361): Process ended prematurely: osmo-stp_10.42.42.5(pid=28361) [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28361)] [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:21:48.262253 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 17:21:48.288245 run osmo-hlr_10.42.42.2(pid=28358): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28358)] 17:21:48.336443 run osmo-hlr_10.42.42.2(pid=28358): stdout: | (launched: 2022-12-10_17:21:44.976833) 17:21:48.385477 run osmo-hlr_10.42.42.2(pid=28358): stderr: | 20221210172145158 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172145158 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172145158 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172145158 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172145158 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172145158 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172145170 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172145179 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172145179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172145179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:48.453941 run osmo-msc_10.42.42.6(pid=28364): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28364)] 17:21:48.501325 run osmo-msc_10.42.42.6(pid=28364): stdout: | (launched: 2022-12-10_17:21:47.388414) 17:21:48.550121 run osmo-msc_10.42.42.6(pid=28364): stderr: | 20221210172147663 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172147663 DLGLOBAL DEBUG validating counter group 0x7f0d8cea9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172147663 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172147663 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172147663 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172147664 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172147668 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172147668 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172147668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172147669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:48.599463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28357): Terminating (SIGTERM) 17:21:48.638459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28360): Terminating (SIGTERM) 17:21:48.677368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28363): Terminating (SIGTERM) 17:21:48.716679 --- ParallelTerminationStrategy: PID 28357 died... 17:21:48.735643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28357): Terminated: ok {rc=0} 17:21:48.779047 --- ParallelTerminationStrategy: PID 28360 died... 17:21:48.797499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28360): Terminated: ok {rc=0} 17:21:48.841120 --- ParallelTerminationStrategy: PID 28363 died... 17:21:48.859529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28363): Terminated: ok {rc=0} 17:21:48.944558 bus /sierra_3: Setting Powered False 17:21:50.044369 bus /sierra_3: Setting Powered False 17:21:51.159211 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:21:52.304767 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:52.316286 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:21:52.371606 tst mo_mt_call_osmux.py: using LAC 29452 17:21:52.490650 tst mo_mt_call_osmux.py: using RAC 127 17:21:52.617068 tst mo_mt_call_osmux.py: using CellId 29452 17:21:52.744206 tst mo_mt_call_osmux.py: using BVCI 29453 17:21:52.853685 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:52.864669 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:52.875420 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:52.886167 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:52.896797 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:52.907936 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:21:53.026745 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:21:53.145794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:53.650482 run create_hlr_db(pid=28366): Launched 17:21:53.774276 bus /sierra_2: Setting Powered False 17:21:54.838471 run create_hlr_db(pid=28366): Terminated: ok {rc=0} 17:21:55.274460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28368): Launched 17:21:55.574323 run osmo-hlr_10.42.42.2(pid=28369): Launched 17:21:55.688023 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:56.203627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28371): Launched 17:21:56.502213 run osmo-stp_10.42.42.5(pid=28372): Launched 17:21:56.614423 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:57.154864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28374): Launched 17:21:57.454116 run osmo-msc_10.42.42.6(pid=28375): Launched 17:21:57.619241 run osmo-stp_10.42.42.5(pid=28372): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28372)] 17:21:57.744690 run osmo-stp_10.42.42.5(pid=28372): stdout: | (launched: 2022-12-10_17:21:56.444717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:57.871405 run osmo-stp_10.42.42.5(pid=28372): stderr: | 20221210172156618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172156618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172156618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172156619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172156619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172156619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172156619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:57.995019 run osmo-stp_10.42.42.5(pid=28372): stdout: | (launched: 2022-12-10_17:21:56.444717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:58.113451 run osmo-stp_10.42.42.5(pid=28372): stderr: | 20221210172156618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172156618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172156618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172156619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172156619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172156619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172156619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:58.254719 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28372): Process ended prematurely: osmo-stp_10.42.42.5(pid=28372) [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28372)] [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:21:58.263302 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 17:21:58.289541 run osmo-hlr_10.42.42.2(pid=28369): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28369)] 17:21:58.337018 run osmo-hlr_10.42.42.2(pid=28369): stdout: | (launched: 2022-12-10_17:21:55.515725) 17:21:58.386358 run osmo-hlr_10.42.42.2(pid=28369): stderr: | 20221210172155693 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172155693 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172155693 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172155693 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172155693 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172155693 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172155706 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172155715 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172155715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172155715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:58.454697 run osmo-msc_10.42.42.6(pid=28375): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28375)] 17:21:58.501890 run osmo-msc_10.42.42.6(pid=28375): stdout: | (launched: 2022-12-10_17:21:57.396343) 17:21:58.550668 run osmo-msc_10.42.42.6(pid=28375): stderr: | 20221210172157673 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172157673 DLGLOBAL DEBUG validating counter group 0x7f878989dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172157673 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172157673 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172157673 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172157674 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172157675 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172157676 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172157676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172157676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:58.601383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28368): Terminating (SIGTERM) 17:21:58.640339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28371): Terminating (SIGTERM) 17:21:58.679258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28374): Terminating (SIGTERM) 17:21:58.718780 --- ParallelTerminationStrategy: PID 28368 died... 17:21:58.737643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28368): Terminated: ok {rc=0} 17:21:58.781091 --- ParallelTerminationStrategy: PID 28371 died... 17:21:58.799504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28371): Terminated: ok {rc=0} 17:21:58.843675 --- ParallelTerminationStrategy: PID 28374 died... 17:21:58.862415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28374): Terminated: ok {rc=0} 17:21:58.945943 bus /sierra_3: Setting Powered False 17:22:00.044213 bus /sierra_3: Setting Powered False 17:22:01.159137 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:22:02.387337 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:22:02.393507 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:22:02.413902 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:22:02.440902 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:22:02.496341 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:22:02.516541 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:22:02.542668 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:22:03.090013 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:22:03.137840 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:03.148899 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:22:03.203045 tst mo_mt_call.py: using LAC 29453 17:22:03.324282 tst mo_mt_call.py: using RAC 128 17:22:03.441986 tst mo_mt_call.py: using CellId 29453 17:22:03.560199 tst mo_mt_call.py: using BVCI 29454 17:22:03.679386 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:03.691199 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:03.702648 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:03.714991 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:03.727036 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:03.739133 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:22:03.856068 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:22:03.973360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:04.437838 run create_hlr_db(pid=28380): Launched 17:22:04.561799 bus /sierra_2: Setting Powered False 17:22:05.621711 run create_hlr_db(pid=28380): Terminated: ok {rc=0} 17:22:06.058376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28382): Launched 17:22:06.381262 run osmo-hlr_10.42.42.2(pid=28383): Launched 17:22:06.505084 run osmo-stp_10.42.42.5: Starting osmo-stp 17:22:07.021808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28385): Launched 17:22:07.321425 run osmo-stp_10.42.42.5(pid=28386): Launched 17:22:07.435587 run osmo-msc_10.42.42.6: Starting osmo-msc 17:22:07.974984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28388): Launched 17:22:08.274525 run osmo-msc_10.42.42.6(pid=28389): Launched 17:22:08.442055 run osmo-stp_10.42.42.5(pid=28386): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28386)] 17:22:08.567886 run osmo-stp_10.42.42.5(pid=28386): stdout: | (launched: 2022-12-10_17:22:07.266703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:08.694155 run osmo-stp_10.42.42.5(pid=28386): stderr: | 20221210172207435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172207436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172207436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172207436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172207437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172207437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172207437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:08.819019 run osmo-stp_10.42.42.5(pid=28386): stdout: | (launched: 2022-12-10_17:22:07.266703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:08.937837 run osmo-stp_10.42.42.5(pid=28386): stderr: | 20221210172207435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172207436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172207436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172207436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172207437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172207437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172207437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:09.080642 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28386): Process ended prematurely: osmo-stp_10.42.42.5(pid=28386) [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28386)] [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:22:09.089515 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:22:09.115820 run osmo-hlr_10.42.42.2(pid=28383): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28383)] 17:22:09.163269 run osmo-hlr_10.42.42.2(pid=28383): stdout: | (launched: 2022-12-10_17:22:06.323078) 17:22:09.212865 run osmo-hlr_10.42.42.2(pid=28383): stderr: | 20221210172206521 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172206521 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172206521 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172206521 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172206521 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172206521 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172206533 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172206541 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172206542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172206542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:22:09.281333 run osmo-msc_10.42.42.6(pid=28389): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28389)] 17:22:09.329210 run osmo-msc_10.42.42.6(pid=28389): stdout: | (launched: 2022-12-10_17:22:08.219348) 17:22:09.378624 run osmo-msc_10.42.42.6(pid=28389): stderr: | 20221210172208492 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172208492 DLGLOBAL DEBUG validating counter group 0x7f8abc533c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172208494 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172208494 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172208494 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172208494 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172208496 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172208496 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172208497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172208497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:22:09.428568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28382): Terminating (SIGTERM) 17:22:09.468232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28385): Terminating (SIGTERM) 17:22:09.507931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28388): Terminating (SIGTERM) 17:22:09.547934 --- ParallelTerminationStrategy: PID 28382 died... 17:22:09.567116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28382): Terminated: ok {rc=0} 17:22:09.610873 --- ParallelTerminationStrategy: PID 28385 died... 17:22:09.629348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28385): Terminated: ok {rc=0} 17:22:09.672736 --- ParallelTerminationStrategy: PID 28388 died... 17:22:09.691272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28388): Terminated: ok {rc=0} 17:22:09.775136 bus /sierra_3: Setting Powered False 17:22:10.873242 bus /sierra_3: Setting Powered False 17:22:11.984600 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:22:13.132265 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:13.144217 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:22:13.201423 tst mo_mt_call_osmux.py: using LAC 29454 17:22:13.328564 tst mo_mt_call_osmux.py: using RAC 129 17:22:13.455806 tst mo_mt_call_osmux.py: using CellId 29454 17:22:13.581543 tst mo_mt_call_osmux.py: using BVCI 29455 17:22:13.690505 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:13.701736 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:13.715715 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:13.727634 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:13.738811 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:13.750192 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:22:13.870917 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:22:13.987276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:14.486590 run create_hlr_db(pid=28391): Launched 17:22:14.610425 bus /sierra_2: Setting Powered False 17:22:15.670355 run create_hlr_db(pid=28391): Terminated: ok {rc=0} 17:22:16.120593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28393): Launched 17:22:16.445962 run osmo-hlr_10.42.42.2(pid=28394): Launched 17:22:16.571619 run osmo-stp_10.42.42.5: Starting osmo-stp 17:22:17.277796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28396): Launched 17:22:17.606646 run osmo-stp_10.42.42.5(pid=28397): Launched 17:22:17.730882 run osmo-msc_10.42.42.6: Starting osmo-msc 17:22:18.313540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28399): Launched 17:22:18.635698 run osmo-msc_10.42.42.6(pid=28400): Launched 17:22:18.816058 run osmo-stp_10.42.42.5(pid=28397): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28397)] 17:22:18.951793 run osmo-stp_10.42.42.5(pid=28397): stdout: | (launched: 2022-12-10_17:22:17.548146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:19.088812 run osmo-stp_10.42.42.5(pid=28397): stderr: | 20221210172217738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172217738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172217739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172217739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172217739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172217739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172217739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:19.224464 run osmo-stp_10.42.42.5(pid=28397): stdout: | (launched: 2022-12-10_17:22:17.548146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:19.353196 run osmo-stp_10.42.42.5(pid=28397): stderr: | 20221210172217738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172217738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172217739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172217739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172217739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172217739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172217739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:19.506542 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28397): Process ended prematurely: osmo-stp_10.42.42.5(pid=28397) [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28397)] [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:22:19.516070 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:22:19.544495 run osmo-hlr_10.42.42.2(pid=28394): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28394)] 17:22:19.595029 run osmo-hlr_10.42.42.2(pid=28394): stdout: | (launched: 2022-12-10_17:22:16.381754) 17:22:19.646955 run osmo-hlr_10.42.42.2(pid=28394): stderr: | 20221210172216769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172216769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172216769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172216769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172216770 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172216770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172216791 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172216812 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172216812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172216812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:22:19.719385 run osmo-msc_10.42.42.6(pid=28400): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28400)] 17:22:19.769638 run osmo-msc_10.42.42.6(pid=28400): stdout: | (launched: 2022-12-10_17:22:18.577371) 17:22:19.822081 run osmo-msc_10.42.42.6(pid=28400): stderr: | 20221210172218899 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172218899 DLGLOBAL DEBUG validating counter group 0x7f5298a47c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172218899 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172218899 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172218899 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172218900 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172218901 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172218902 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172218902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172218902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:22:19.874380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28393): Terminating (SIGTERM) 17:22:19.916322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28396): Terminating (SIGTERM) 17:22:19.958443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28399): Terminating (SIGTERM) 17:22:20.000707 --- ParallelTerminationStrategy: PID 28393 died... 17:22:20.020654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28393): Terminated: ok {rc=0} 17:22:20.067246 --- ParallelTerminationStrategy: PID 28396 died... 17:22:20.086874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28396): Terminated: ok {rc=0} 17:22:20.133459 --- ParallelTerminationStrategy: PID 28399 died... 17:22:20.153027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28399): Terminated: ok {rc=0} 17:22:20.240750 bus /sierra_3: Setting Powered False 17:22:21.339496 bus /sierra_3: Setting Powered False 17:22:22.454854 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:22:23.692168 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:22:23.699134 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:22:23.720638 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:22:23.748458 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:22:23.802106 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:22:23.823045 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:22:23.850742 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:22:24.402003 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:22:24.453712 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:24.465362 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:22:24.521570 tst mo_mt_call.py: using LAC 29455 17:22:24.646306 tst mo_mt_call.py: using RAC 130 17:22:24.772606 tst mo_mt_call.py: using CellId 29455 17:22:24.897337 tst mo_mt_call.py: using BVCI 29456 17:22:25.014531 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:25.026057 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:25.037288 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:25.048806 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:25.060248 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:25.071719 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:22:25.188258 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:22:25.303574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:25.770090 run create_hlr_db(pid=28406): Launched 17:22:25.898807 bus /sierra_2: Setting Powered False 17:22:26.962156 run create_hlr_db(pid=28406): Terminated: ok {rc=0} 17:22:27.391267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28408): Launched 17:22:27.691214 run osmo-hlr_10.42.42.2(pid=28409): Launched 17:22:27.805161 run osmo-stp_10.42.42.5: Starting osmo-stp 17:22:28.336072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28411): Launched 17:22:28.637407 run osmo-stp_10.42.42.5(pid=28412): Launched 17:22:28.752326 run osmo-msc_10.42.42.6: Starting osmo-msc 17:22:29.295629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28414): Launched 17:22:29.596198 run osmo-msc_10.42.42.6(pid=28415): Launched 17:22:29.764811 run osmo-stp_10.42.42.5(pid=28412): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28412)] 17:22:29.891497 run osmo-stp_10.42.42.5(pid=28412): stdout: | (launched: 2022-12-10_17:22:28.582216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:30.018351 run osmo-stp_10.42.42.5(pid=28412): stderr: | 20221210172228752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172228753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172228753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172228753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172228754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172228754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172228754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:30.143474 run osmo-stp_10.42.42.5(pid=28412): stdout: | (launched: 2022-12-10_17:22:28.582216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:30.262587 run osmo-stp_10.42.42.5(pid=28412): stderr: | 20221210172228752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172228753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172228753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172228753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172228754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172228754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172228754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:30.405512 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28412): Process ended prematurely: osmo-stp_10.42.42.5(pid=28412) [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28412)] [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:22:30.414392 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:22:30.440708 run osmo-hlr_10.42.42.2(pid=28409): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28409)] 17:22:30.488311 run osmo-hlr_10.42.42.2(pid=28409): stdout: | (launched: 2022-12-10_17:22:27.636446) 17:22:30.537696 run osmo-hlr_10.42.42.2(pid=28409): stderr: | 20221210172227814 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172227814 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172227814 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172227814 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172227814 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172227814 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172227826 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172227835 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172227836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172227836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:22:30.606367 run osmo-msc_10.42.42.6(pid=28415): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28415)] 17:22:30.653847 run osmo-msc_10.42.42.6(pid=28415): stdout: | (launched: 2022-12-10_17:22:29.541460) 17:22:30.702851 run osmo-msc_10.42.42.6(pid=28415): stderr: | 20221210172229814 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172229814 DLGLOBAL DEBUG validating counter group 0x7fc2a8a73c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172229814 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172229814 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172229814 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172229815 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172229817 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172229818 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172229818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172229818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:22:30.752194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28408): Terminating (SIGTERM) 17:22:30.791770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28411): Terminating (SIGTERM) 17:22:30.836453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28414): Terminating (SIGTERM) 17:22:30.883410 --- ParallelTerminationStrategy: PID 28408 died... 17:22:30.915348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28408): Terminated: ok {rc=0} 17:22:30.964042 --- ParallelTerminationStrategy: PID 28411 died... 17:22:30.984743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28411): Terminated: ok {rc=0} 17:22:31.034370 --- ParallelTerminationStrategy: PID 28414 died... 17:22:31.055301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28414): Terminated: ok {rc=0} 17:22:31.147869 bus /sierra_3: Setting Powered False 17:22:32.245410 bus /sierra_3: Setting Powered False 17:22:33.360712 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:22:34.511567 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:34.523652 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:22:34.581960 tst mo_mt_call_osmux.py: using LAC 29456 17:22:34.713268 tst mo_mt_call_osmux.py: using RAC 131 17:22:34.839872 tst mo_mt_call_osmux.py: using CellId 29456 17:22:34.963927 tst mo_mt_call_osmux.py: using BVCI 29457 17:22:35.080928 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:35.092443 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:35.103666 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:35.115047 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:35.126378 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:35.137959 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:22:35.252801 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:22:35.367451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:35.831972 run create_hlr_db(pid=28417): Launched 17:22:35.955846 bus /sierra_2: Setting Powered False 17:22:37.016675 run create_hlr_db(pid=28417): Terminated: ok {rc=0} 17:22:37.454191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28419): Launched 17:22:37.776113 run osmo-hlr_10.42.42.2(pid=28420): Launched 17:22:37.900070 run osmo-stp_10.42.42.5: Starting osmo-stp 17:22:38.456805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28422): Launched 17:22:38.778840 run osmo-stp_10.42.42.5(pid=28423): Launched 17:22:38.902620 run osmo-msc_10.42.42.6: Starting osmo-msc 17:22:39.484779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28425): Launched 17:22:39.808036 run osmo-msc_10.42.42.6(pid=28426): Launched 17:22:39.987870 run osmo-stp_10.42.42.5(pid=28423): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28423)] 17:22:40.123679 run osmo-stp_10.42.42.5(pid=28423): stdout: | (launched: 2022-12-10_17:22:38.720336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:40.259689 run osmo-stp_10.42.42.5(pid=28423): stderr: | 20221210172238912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172238912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172238912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172238913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172238913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172238913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172238913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:40.395208 run osmo-stp_10.42.42.5(pid=28423): stdout: | (launched: 2022-12-10_17:22:38.720336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:40.523562 run osmo-stp_10.42.42.5(pid=28423): stderr: | 20221210172238912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172238912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172238912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172238913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172238913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172238913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172238913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:40.677082 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28423): Process ended prematurely: osmo-stp_10.42.42.5(pid=28423) [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28423)] [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:22:40.686711 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:22:40.715121 run osmo-hlr_10.42.42.2(pid=28420): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28420)] 17:22:40.765891 run osmo-hlr_10.42.42.2(pid=28420): stdout: | (launched: 2022-12-10_17:22:37.718049) 17:22:40.818788 run osmo-hlr_10.42.42.2(pid=28420): stderr: | 20221210172237917 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172237917 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172237917 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172237917 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172237917 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172237917 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172237928 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172237937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172237937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172237937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:22:40.891872 run osmo-msc_10.42.42.6(pid=28426): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28426)] 17:22:40.942662 run osmo-msc_10.42.42.6(pid=28426): stdout: | (launched: 2022-12-10_17:22:39.749064) 17:22:40.995151 run osmo-msc_10.42.42.6(pid=28426): stderr: | 20221210172240072 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172240072 DLGLOBAL DEBUG validating counter group 0x7f91b5a7fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172240072 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172240072 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172240072 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172240073 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172240074 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172240075 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172240075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172240075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:22:41.048257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28419): Terminating (SIGTERM) 17:22:41.090591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28422): Terminating (SIGTERM) 17:22:41.133040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28425): Terminating (SIGTERM) 17:22:41.175772 --- ParallelTerminationStrategy: PID 28419 died... 17:22:41.196000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28419): Terminated: ok {rc=0} 17:22:41.242957 --- ParallelTerminationStrategy: PID 28422 died... 17:22:41.262684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28422): Terminated: ok {rc=0} 17:22:41.309962 --- ParallelTerminationStrategy: PID 28425 died... 17:22:41.330207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28425): Terminated: ok {rc=0} 17:22:41.417793 bus /sierra_3: Setting Powered False 17:22:42.516299 bus /sierra_3: Setting Powered False 17:22:43.633237 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:22:44.866856 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:22:44.874856 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:22:44.896136 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:22:44.924528 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:22:44.978596 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:22:45.000897 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:22:45.028052 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:22:45.577292 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:22:45.629139 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:45.640755 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:22:45.698727 tst mo_mt_call.py: using LAC 29457 17:22:45.824552 tst mo_mt_call.py: using RAC 132 17:22:45.979121 tst mo_mt_call.py: using CellId 29457 17:22:46.107730 tst mo_mt_call.py: using BVCI 29458 17:22:46.252452 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:46.264515 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:46.276853 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:46.289872 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:46.303227 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:46.317550 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:22:46.438553 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:22:46.569364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:47.054908 run create_hlr_db(pid=28431): Launched 17:22:47.218271 bus /sierra_2: Setting Powered False 17:22:48.281981 run create_hlr_db(pid=28431): Terminated: ok {rc=0} 17:22:48.727853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28433): Launched 17:22:49.049175 run osmo-hlr_10.42.42.2(pid=28434): Launched 17:22:49.172177 run osmo-stp_10.42.42.5: Starting osmo-stp 17:22:49.724144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28436): Launched 17:22:50.046398 run osmo-stp_10.42.42.5(pid=28437): Launched 17:22:50.169235 run osmo-msc_10.42.42.6: Starting osmo-msc 17:22:50.750008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28439): Launched 17:22:51.072941 run osmo-msc_10.42.42.6(pid=28440): Launched 17:22:51.253357 run osmo-stp_10.42.42.5(pid=28437): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28437)] 17:22:51.390290 run osmo-stp_10.42.42.5(pid=28437): stdout: | (launched: 2022-12-10_17:22:49.987985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:51.527516 run osmo-stp_10.42.42.5(pid=28437): stderr: | 20221210172250178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172250178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172250178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172250178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172250179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172250179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172250179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:51.663787 run osmo-stp_10.42.42.5(pid=28437): stdout: | (launched: 2022-12-10_17:22:49.987985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:51.792600 run osmo-stp_10.42.42.5(pid=28437): stderr: | 20221210172250178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172250178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172250178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172250178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172250179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172250179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172250179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:51.946337 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28437): Process ended prematurely: osmo-stp_10.42.42.5(pid=28437) [trial-2377↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28437)] [trial-2377↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:22:51.955849 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:22:51.984314 run osmo-hlr_10.42.42.2(pid=28434): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28434)] 17:22:52.034739 run osmo-hlr_10.42.42.2(pid=28434): stdout: | (launched: 2022-12-10_17:22:48.990957) 17:22:52.087454 run osmo-hlr_10.42.42.2(pid=28434): stderr: | 20221210172249189 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172249189 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172249189 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172249189 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172249189 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172249189 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172249201 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172249209 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172249209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172249209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:22:52.160038 run osmo-msc_10.42.42.6(pid=28440): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28440)] 17:22:52.210558 run osmo-msc_10.42.42.6(pid=28440): stdout: | (launched: 2022-12-10_17:22:51.014327) 17:22:52.262715 run osmo-msc_10.42.42.6(pid=28440): stderr: | 20221210172251336 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172251336 DLGLOBAL DEBUG validating counter group 0x7fa02f387c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172251337 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172251337 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172251337 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172251337 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172251339 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172251339 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172251339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172251339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:22:52.315479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28433): Terminating (SIGTERM) 17:22:52.357486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28436): Terminating (SIGTERM) 17:22:52.399212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28439): Terminating (SIGTERM) 17:22:52.441408 --- ParallelTerminationStrategy: PID 28433 died... 17:22:52.461441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28433): Terminated: ok {rc=0} 17:22:52.508138 --- ParallelTerminationStrategy: PID 28436 died... 17:22:52.527635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28436): Terminated: ok {rc=0} 17:22:52.574535 --- ParallelTerminationStrategy: PID 28439 died... 17:22:52.593934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28439): Terminated: ok {rc=0} 17:22:52.681761 bus /sierra_3: Setting Powered False 17:22:53.779756 bus /sierra_3: Setting Powered False 17:22:54.897103 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:22:56.044864 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:56.057241 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:22:56.115740 tst mo_mt_call_osmux.py: using LAC 29458 17:22:56.243475 tst mo_mt_call_osmux.py: using RAC 133 17:22:56.369373 tst mo_mt_call_osmux.py: using CellId 29458 17:22:56.495590 tst mo_mt_call_osmux.py: using BVCI 29459 17:22:56.612538 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:56.624024 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:56.635324 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:56.646944 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:56.658918 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:56.670854 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:22:56.788403 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:22:56.905799 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:57.371178 run create_hlr_db(pid=28442): Launched 17:22:57.494807 bus /sierra_2: Setting Powered False 17:22:58.555550 run create_hlr_db(pid=28442): Terminated: ok {rc=0} 17:22:58.994483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28444): Launched 17:22:59.318419 run osmo-hlr_10.42.42.2(pid=28445): Launched 17:22:59.442437 run osmo-stp_10.42.42.5: Starting osmo-stp 17:22:59.999072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28447): Launched 17:23:00.321696 run osmo-stp_10.42.42.5(pid=28448): Launched 17:23:00.445117 run osmo-msc_10.42.42.6: Starting osmo-msc 17:23:01.048320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28450): Launched 17:23:01.393738 run osmo-msc_10.42.42.6(pid=28451): Launched 17:23:01.637458 run osmo-stp_10.42.42.5(pid=28448): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28448)] 17:23:01.816213 run osmo-stp_10.42.42.5(pid=28448): stdout: | (launched: 2022-12-10_17:23:00.263255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:02.113576 run osmo-stp_10.42.42.5(pid=28448): stderr: | 20221210172300454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172300454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172300454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172300454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172300455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172300455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172300455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:02.309115 run osmo-stp_10.42.42.5(pid=28448): stdout: | (launched: 2022-12-10_17:23:00.263255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:02.529597 run osmo-stp_10.42.42.5(pid=28448): stderr: | 20221210172300454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172300454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172300454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172300454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172300455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172300455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172300455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:02.673072 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28448): Process ended prematurely: osmo-stp_10.42.42.5(pid=28448) [trial-2377↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28448)] [trial-2377↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:23:02.681967 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 17:23:02.708443 run osmo-hlr_10.42.42.2(pid=28445): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28445)] 17:23:02.757262 run osmo-hlr_10.42.42.2(pid=28445): stdout: | (launched: 2022-12-10_17:22:59.258819) 17:23:02.806745 run osmo-hlr_10.42.42.2(pid=28445): stderr: | 20221210172259457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172259457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172259457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172259457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172259457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172259457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172259470 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172259481 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172259481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172259481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:23:02.875909 run osmo-msc_10.42.42.6(pid=28451): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28451)] 17:23:02.923639 run osmo-msc_10.42.42.6(pid=28451): stdout: | (launched: 2022-12-10_17:23:01.321586) 17:23:02.973117 run osmo-msc_10.42.42.6(pid=28451): stderr: | 20221210172302047 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172302047 DLGLOBAL DEBUG validating counter group 0x7f91f842ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172302047 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172302048 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172302048 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172302048 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172302052 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172302057 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172302057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172302057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:23:03.022954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28444): Terminating (SIGTERM) 17:23:03.062408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28447): Terminating (SIGTERM) 17:23:03.101938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28450): Terminating (SIGTERM) 17:23:03.141870 --- ParallelTerminationStrategy: PID 28444 died... 17:23:03.160825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28444): Terminated: ok {rc=0} 17:23:03.204870 --- ParallelTerminationStrategy: PID 28447 died... 17:23:03.223743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28447): Terminated: ok {rc=0} 17:23:03.268420 --- ParallelTerminationStrategy: PID 28450 died... 17:23:03.287189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28450): Terminated: ok {rc=0} 17:23:03.371603 bus /sierra_3: Setting Powered False 17:23:04.470285 bus /sierra_3: Setting Powered False 17:23:05.583030 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:23:06.822180 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:23:06.828680 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:23:06.849140 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:23:06.875570 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:23:06.927218 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:23:06.947683 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:23:06.973909 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:23:07.522654 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:23:07.571692 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:07.582795 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:23:07.639863 tst mo_mt_call.py: using LAC 29459 17:23:07.760311 tst mo_mt_call.py: using RAC 134 17:23:07.878762 tst mo_mt_call.py: using CellId 29459 17:23:07.998986 tst mo_mt_call.py: using BVCI 29460 17:23:08.110110 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:08.121042 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:08.131672 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:08.142550 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:08.153383 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:08.164106 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:23:08.281295 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:23:08.401272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:23:08.900202 run create_hlr_db(pid=28456): Launched 17:23:09.024424 bus /sierra_2: Setting Powered False 17:23:10.088730 run create_hlr_db(pid=28456): Terminated: ok {rc=0} 17:23:10.519057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28458): Launched 17:23:10.819473 run osmo-hlr_10.42.42.2(pid=28459): Launched 17:23:10.934299 run osmo-stp_10.42.42.5: Starting osmo-stp 17:23:11.463861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28461): Launched 17:23:11.764710 run osmo-stp_10.42.42.5(pid=28462): Launched 17:23:11.879611 run osmo-msc_10.42.42.6: Starting osmo-msc 17:23:12.421872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28464): Launched 17:23:12.721210 run osmo-msc_10.42.42.6(pid=28465): Launched 17:23:12.889473 run osmo-stp_10.42.42.5(pid=28462): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28462)] 17:23:13.015376 run osmo-stp_10.42.42.5(pid=28462): stdout: | (launched: 2022-12-10_17:23:11.710093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:13.142328 run osmo-stp_10.42.42.5(pid=28462): stderr: | 20221210172311879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172311879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172311879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172311880 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172311880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172311880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172311880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:13.266950 run osmo-stp_10.42.42.5(pid=28462): stdout: | (launched: 2022-12-10_17:23:11.710093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:13.386521 run osmo-stp_10.42.42.5(pid=28462): stderr: | 20221210172311879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172311879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172311879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172311880 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172311880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172311880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172311880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:13.529411 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28462): Process ended prematurely: osmo-stp_10.42.42.5(pid=28462) [trial-2377↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28462)] [trial-2377↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:23:13.538224 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:23:13.564935 run osmo-hlr_10.42.42.2(pid=28459): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28459)] 17:23:13.612861 run osmo-hlr_10.42.42.2(pid=28459): stdout: | (launched: 2022-12-10_17:23:10.764930) 17:23:13.662349 run osmo-hlr_10.42.42.2(pid=28459): stderr: | 20221210172310941 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172310942 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172310942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172310942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172310942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172310942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172310956 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172310966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172310966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172310966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:23:13.731245 run osmo-msc_10.42.42.6(pid=28465): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28465)] 17:23:13.778807 run osmo-msc_10.42.42.6(pid=28465): stdout: | (launched: 2022-12-10_17:23:12.666504) 17:23:13.827988 run osmo-msc_10.42.42.6(pid=28465): stderr: | 20221210172312935 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172312935 DLGLOBAL DEBUG validating counter group 0x7f1be9f08c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172312935 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172312935 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172312936 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172312936 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172312938 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172312938 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172312938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172312938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:23:13.877392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28458): Terminating (SIGTERM) 17:23:13.916647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28461): Terminating (SIGTERM) 17:23:13.955783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28464): Terminating (SIGTERM) 17:23:13.995384 --- ParallelTerminationStrategy: PID 28458 died... 17:23:14.014461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28458): Terminated: ok {rc=0} 17:23:14.058282 --- ParallelTerminationStrategy: PID 28461 died... 17:23:14.076665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28461): Terminated: ok {rc=0} 17:23:14.120394 --- ParallelTerminationStrategy: PID 28464 died... 17:23:14.138983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28464): Terminated: ok {rc=0} 17:23:14.222135 bus /sierra_3: Setting Powered False 17:23:15.317237 bus /sierra_3: Setting Powered False 17:23:16.437084 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:23:17.629803 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:17.647013 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:23:17.725258 tst mo_mt_call_osmux.py: using LAC 29460 17:23:17.886219 tst mo_mt_call_osmux.py: using RAC 135 17:23:18.041529 tst mo_mt_call_osmux.py: using CellId 29460 17:23:18.199240 tst mo_mt_call_osmux.py: using BVCI 29461 17:23:18.380104 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:18.396870 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:18.411492 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:18.424752 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:18.436933 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:18.454909 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:23:18.591781 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:23:18.734468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:23:19.321295 run create_hlr_db(pid=28736): Launched 17:23:19.476910 bus /sierra_2: Setting Powered False 17:23:20.541481 run create_hlr_db(pid=28736): Terminated: ok {rc=0} 17:23:20.978619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28740): Launched 17:23:21.308303 run osmo-hlr_10.42.42.2(pid=28742): Launched 17:23:21.603649 run osmo-stp_10.42.42.5: Starting osmo-stp 17:23:22.169267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28744): Launched 17:23:22.508827 run osmo-stp_10.42.42.5(pid=28745): Launched 17:23:22.751337 run osmo-msc_10.42.42.6: Starting osmo-msc 17:23:23.436486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28747): Launched 17:23:23.777319 run osmo-msc_10.42.42.6(pid=28748): Launched 17:23:24.143895 run osmo-stp_10.42.42.5(pid=28745): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28745)] 17:23:24.428854 run osmo-stp_10.42.42.5(pid=28745): stdout: | (launched: 2022-12-10_17:23:22.447882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:24.599786 run osmo-stp_10.42.42.5(pid=28745): stderr: | 20221210172322742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172322742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172322742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172322743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172322743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172322743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172322743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:24.738966 run osmo-stp_10.42.42.5(pid=28745): stdout: | (launched: 2022-12-10_17:23:22.447882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:24.872889 run osmo-stp_10.42.42.5(pid=28745): stderr: | 20221210172322742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172322742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172322742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172322743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172322743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172322743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172322743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:25.032599 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28745): Process ended prematurely: osmo-stp_10.42.42.5(pid=28745) [trial-2377↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28745)] [trial-2377↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:23:25.043365 tst mo_mt_call_osmux.py:8: Test FAILED (7.5 sec) 17:23:25.075541 run osmo-hlr_10.42.42.2(pid=28742): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28742)] 17:23:25.128908 run osmo-hlr_10.42.42.2(pid=28742): stdout: | (launched: 2022-12-10_17:23:21.247050) 17:23:25.184036 run osmo-hlr_10.42.42.2(pid=28742): stderr: | 20221210172321422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172321422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172321422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172321422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172321422 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172321422 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172321435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172321451 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172321451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172321451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:23:25.261148 run osmo-msc_10.42.42.6(pid=28748): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28748)] 17:23:25.314858 run osmo-msc_10.42.42.6(pid=28748): stdout: | (launched: 2022-12-10_17:23:23.718104) 17:23:25.369908 run osmo-msc_10.42.42.6(pid=28748): stderr: | 20221210172324216 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172324216 DLGLOBAL DEBUG validating counter group 0x7fbad07b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172324216 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172324217 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172324217 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172324217 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172324219 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172324219 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172324219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172324219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:23:25.426067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28740): Terminating (SIGTERM) 17:23:25.471578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28744): Terminating (SIGTERM) 17:23:25.518507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28747): Terminating (SIGTERM) 17:23:25.566160 --- ParallelTerminationStrategy: PID 28740 died... 17:23:25.587317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28740): Terminated: ok {rc=0} 17:23:25.639747 --- ParallelTerminationStrategy: PID 28744 died... 17:23:25.660738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28744): Terminated: ok {rc=0} 17:23:25.710633 --- ParallelTerminationStrategy: PID 28747 died... 17:23:25.731506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28747): Terminated: ok {rc=0} 17:23:25.824929 bus /sierra_3: Setting Powered False 17:23:26.930318 bus /sierra_3: Setting Powered False 17:23:28.051866 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 emergency:oc2g --------------------------------------------------------------------- 17:23:29.286631 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:23:29.291629 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 17:23:29.313153 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 17:23:29.342158 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 17:23:29.426773 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 17:23:29.448086 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 17:23:29.475605 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 17:23:30.057790 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2377 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 17:23:30.063652 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:30.074783 tst emergency:oc2g: Using 1 x bts (candidates: 1) 17:23:30.112208 tst emergency_mo_mt_call.py: using LAC 29461 17:23:30.232367 tst emergency_mo_mt_call.py: using RAC 136 17:23:30.352145 tst emergency_mo_mt_call.py: using CellId 29461 17:23:30.473057 tst emergency_mo_mt_call.py: using BVCI 29462 17:23:30.584839 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:30.596496 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:30.608008 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:30.619623 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:30.631272 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:30.643424 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:30.763221 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:30.899555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:23:31.395848 run create_hlr_db(pid=28753): Launched 17:23:31.572595 bus /sierra_2: Setting Powered False 17:23:32.636643 run create_hlr_db(pid=28753): Terminated: ok {rc=0} 17:23:33.204115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28755): Launched 17:23:33.539441 run osmo-hlr_10.42.42.2(pid=28756): Launched 17:23:33.789298 run osmo-stp_10.42.42.5: Starting osmo-stp 17:23:34.445471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28758): Launched 17:23:34.780263 run osmo-stp_10.42.42.5(pid=28759): Launched 17:23:35.036033 tst emergency_mo_mt_call.py: using MSISDN 7819 17:23:35.266711 run osmo-msc_10.42.42.6: Starting osmo-msc 17:23:35.852790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28761): Launched 17:23:36.187262 run osmo-msc_10.42.42.6(pid=28762): Launched 17:23:36.545734 run osmo-stp_10.42.42.5(pid=28759): ERR: Terminated: ERROR {rc=1} [trial-2377↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28759)] 17:23:36.829798 run osmo-stp_10.42.42.5(pid=28759): stdout: | (launched: 2022-12-10_17:23:34.721859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:37.005510 run osmo-stp_10.42.42.5(pid=28759): stderr: | 20221210172335015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172335015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172335015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172335016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172335016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172335016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172335016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:37.142601 run osmo-stp_10.42.42.5(pid=28759): stdout: | (launched: 2022-12-10_17:23:34.721859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:37.274097 run osmo-stp_10.42.42.5(pid=28759): stderr: | 20221210172335015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172335015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172335015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172335016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172335016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172335016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172335016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:37.431889 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28759): Process ended prematurely: osmo-stp_10.42.42.5(pid=28759) [trial-2377↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28759)] [trial-2377↪emergency:oc2g↪emergency_mo_mt_call.py:19] 17:23:37.441966 tst emergency_mo_mt_call.py:19: Test FAILED (7.4 sec) 17:23:37.473230 run osmo-hlr_10.42.42.2(pid=28756): ERR: Terminated: ERROR {rc=237} [trial-2377↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28756)] 17:23:37.527788 run osmo-hlr_10.42.42.2(pid=28756): stdout: | (launched: 2022-12-10_17:23:33.481180) 17:23:37.582750 run osmo-hlr_10.42.42.2(pid=28756): stderr: | 20221210172333785 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172333785 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172333785 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172333785 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172333785 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172333785 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172333805 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172333822 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172333822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172333822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:23:37.658646 run osmo-msc_10.42.42.6(pid=28762): ERR: Terminated: ERROR {rc=2} [trial-2377↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28762)] 17:23:37.712558 run osmo-msc_10.42.42.6(pid=28762): stdout: | (launched: 2022-12-10_17:23:36.128689) 17:23:37.767635 run osmo-msc_10.42.42.6(pid=28762): stderr: | 20221210172336634 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172336634 DLGLOBAL DEBUG validating counter group 0x7f7357456c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172336634 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172336634 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172336634 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172336634 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172336636 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172336637 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172336637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172336637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:23:37.823734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28755): Terminating (SIGTERM) 17:23:37.869098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28758): Terminating (SIGTERM) 17:23:37.915912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28761): Terminating (SIGTERM) 17:23:37.962809 --- ParallelTerminationStrategy: PID 28755 died... 17:23:37.983892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28755): Terminated: ok {rc=0} 17:23:38.035215 --- ParallelTerminationStrategy: PID 28758 died... 17:23:38.055976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28758): Terminated: ok {rc=0} 17:23:38.106180 --- ParallelTerminationStrategy: PID 28761 died... 17:23:38.127120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28761): Terminated: ok {rc=0} 17:23:38.220064 bus /sierra_3: Setting Powered False 17:23:39.323976 bus /sierra_3: Setting Powered False 17:23:40.444923 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 17:23:41.533293 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:41.544751 tst emergency:oc2g: Using 1 x bts (candidates: 1) 17:23:41.580851 tst emergency_preemptive_call.py: using LAC 29462 17:23:41.705659 tst emergency_preemptive_call.py: using RAC 137 17:23:41.821738 tst emergency_preemptive_call.py: using CellId 29462 17:23:41.936757 tst emergency_preemptive_call.py: using BVCI 29463 17:23:42.044332 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:42.055031 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:42.065634 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:42.076159 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:42.086496 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:42.096845 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:42.209949 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:42.330058 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:42.445198 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:42.561553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:23:43.027220 run create_hlr_db(pid=28764): Launched 17:23:43.151994 bus /sierra_2: Setting Powered False 17:23:44.211460 run create_hlr_db(pid=28764): Terminated: ok {rc=0} 17:23:44.648522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28766): Launched 17:23:44.969254 run osmo-hlr_10.42.42.2(pid=28767): Launched 17:23:45.091534 run osmo-stp_10.42.42.5: Starting osmo-stp 17:23:45.643162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28769): Launched 17:23:45.989658 run osmo-stp_10.42.42.5(pid=28770): Launched 17:23:46.288262 tst emergency_preemptive_call.py: using MSISDN 7820 17:23:46.466137 run osmo-msc_10.42.42.6: Starting osmo-msc 17:23:47.057966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28772): Launched 17:23:47.389506 run osmo-msc_10.42.42.6(pid=28773): Launched 17:23:47.569776 run osmo-stp_10.42.42.5(pid=28770): ERR: Terminated: ERROR {rc=1} [trial-2377↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28770)] 17:23:47.705440 run osmo-stp_10.42.42.5(pid=28770): stdout: | (launched: 2022-12-10_17:23:45.931235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:47.841848 run osmo-stp_10.42.42.5(pid=28770): stderr: | 20221210172346297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172346297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172346298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172346298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172346300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172346300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172346300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:47.976338 run osmo-stp_10.42.42.5(pid=28770): stdout: | (launched: 2022-12-10_17:23:45.931235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:48.103030 run osmo-stp_10.42.42.5(pid=28770): stderr: | 20221210172346297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172346297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172346298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172346298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172346300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172346300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172346300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:48.254556 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28770): Process ended prematurely: osmo-stp_10.42.42.5(pid=28770) [trial-2377↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28770)] [trial-2377↪emergency:oc2g↪emergency_preemptive_call.py:32] 17:23:48.263394 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 17:23:48.291677 run osmo-hlr_10.42.42.2(pid=28767): ERR: Terminated: ERROR {rc=237} [trial-2377↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28767)] 17:23:48.341941 run osmo-hlr_10.42.42.2(pid=28767): stdout: | (launched: 2022-12-10_17:23:44.910699) 17:23:48.394025 run osmo-hlr_10.42.42.2(pid=28767): stderr: | 20221210172345108 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172345108 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172345108 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172345108 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172345108 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172345108 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172345120 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172345128 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172345128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172345128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:23:48.466376 run osmo-msc_10.42.42.6(pid=28773): ERR: Terminated: ERROR {rc=2} [trial-2377↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28773)] 17:23:48.516327 run osmo-msc_10.42.42.6(pid=28773): stdout: | (launched: 2022-12-10_17:23:47.329950) 17:23:48.568176 run osmo-msc_10.42.42.6(pid=28773): stderr: | 20221210172347653 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172347653 DLGLOBAL DEBUG validating counter group 0x7fe886c93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172347653 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172347653 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172347654 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172347654 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172347655 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172347656 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172347656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172347656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:23:48.620403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28766): Terminating (SIGTERM) 17:23:48.662126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28769): Terminating (SIGTERM) 17:23:48.703855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28772): Terminating (SIGTERM) 17:23:48.745885 --- ParallelTerminationStrategy: PID 28766 died... 17:23:48.765871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28766): Terminated: ok {rc=0} 17:23:48.812371 --- ParallelTerminationStrategy: PID 28769 died... 17:23:48.832232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28769): Terminated: ok {rc=0} 17:23:48.879144 --- ParallelTerminationStrategy: PID 28772 died... 17:23:48.898937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28772): Terminated: ok {rc=0} 17:23:48.987612 bus /sierra_9: Setting Powered False 17:23:50.087006 bus /sierra_9: Setting Powered False 17:23:51.203670 bus /sierra_8: Setting Powered False 17:23:52.302906 bus /sierra_8: Setting Powered False 17:23:53.418883 bus /sierra_3: Setting Powered False 17:23:54.517391 bus /sierra_3: Setting Powered False 17:23:55.634585 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:oc2g --------------------------------------------------------------------- 17:23:56.898153 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:23:56.902704 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 17:23:56.923670 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 17:23:56.963714 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 17:23:57.053069 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 17:23:57.074294 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 17:23:57.114177 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 17:23:57.702736 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 17:23:57.755895 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:57.766884 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:23:57.805828 tst cs_paging_gprs_active.py: using LAC 29463 17:23:57.934386 tst cs_paging_gprs_active.py: using RAC 138 17:23:58.065448 tst cs_paging_gprs_active.py: using CellId 29463 17:23:58.192357 tst cs_paging_gprs_active.py: using BVCI 29464 17:23:58.310662 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:58.321746 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:58.332420 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:58.343413 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:58.354807 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:58.365750 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:58.376642 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:58.387707 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:58.398861 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:23:58.514540 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:23:58.632668 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:23:58.836057 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:23:59.139892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28778): Launched 17:23:59.404804 run iperf3-srv_10.42.42.10(pid=28779): Launched 17:23:59.519485 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:23:59.721980 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:00.026163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28780): Launched 17:24:00.292720 run iperf3-srv_10.42.42.10(pid=28781): Launched 17:24:00.407401 tst cs_paging_gprs_active.py:38: start network... 17:24:00.609911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:01.112567 run create_hlr_db(pid=28782): Launched 17:24:01.261854 bus /sierra_2: Setting Powered False 17:24:02.321612 run create_hlr_db(pid=28782): Terminated: ok {rc=0} 17:24:02.763929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28784): Launched 17:24:03.090799 run osmo-hlr_10.42.42.2(pid=28785): Launched 17:24:03.217139 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:03.776552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28787): Launched 17:24:04.104454 run osmo-stp_10.42.42.5(pid=28789): Launched 17:24:04.230336 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:24:04.791184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28791): Launched 17:24:04.916718 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:24:05.191249 run patchelf(pid=28792): Launched 17:24:05.374348 run osmo-stp_10.42.42.5(pid=28789): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28789)] 17:24:05.511629 run osmo-stp_10.42.42.5(pid=28789): stdout: | (launched: 2022-12-10_17:24:04.044765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:05.650975 run osmo-stp_10.42.42.5(pid=28789): stderr: | 20221210172404239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172404239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172404239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172404240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172404242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172404242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172404242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:05.790126 run osmo-stp_10.42.42.5(pid=28789): stdout: | (launched: 2022-12-10_17:24:04.044765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:05.924007 run osmo-stp_10.42.42.5(pid=28789): stderr: | 20221210172404239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172404239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172404239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172404240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172404242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172404242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172404242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:06.082547 run patchelf(pid=28792): Terminating (SIGINT) 17:24:06.264295 run patchelf(pid=28792): Terminated: ok {rc=0} 17:24:06.395794 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28789): Process ended prematurely: osmo-stp_10.42.42.5(pid=28789) [trial-2377↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28789)] [trial-2377↪gprs:oc2g↪cs_paging_gprs_active.py:38] 17:24:06.405841 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:24:06.434904 run osmo-hlr_10.42.42.2(pid=28785): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28785)] 17:24:06.485886 run osmo-hlr_10.42.42.2(pid=28785): stdout: | (launched: 2022-12-10_17:24:03.031145) 17:24:06.538102 run osmo-hlr_10.42.42.2(pid=28785): stderr: | 20221210172403232 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172403232 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172403232 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172403232 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172403232 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172403232 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172403245 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172403253 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172403253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172403254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:06.591183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28778): Terminating (SIGTERM) 17:24:06.633409 run iperf3-srv_10.42.42.10(pid=28779): Terminating (SIGTERM) 17:24:06.675597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28780): Terminating (SIGTERM) 17:24:06.717315 run iperf3-srv_10.42.42.10(pid=28781): Terminating (SIGTERM) 17:24:06.758855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28784): Terminating (SIGTERM) 17:24:06.800649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28787): Terminating (SIGTERM) 17:24:06.842713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28791): Terminating (SIGTERM) 17:24:06.884833 --- ParallelTerminationStrategy: PID 28778 died... 17:24:06.904591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28778): Terminated: ok {rc=0} 17:24:06.951336 --- ParallelTerminationStrategy: PID 28779 died... 17:24:06.970578 run iperf3-srv_10.42.42.10(pid=28779): Terminated {rc=256} 17:24:07.016302 --- ParallelTerminationStrategy: PID 28780 died... 17:24:07.035586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28780): Terminated: ok {rc=0} 17:24:07.081555 --- ParallelTerminationStrategy: PID 28781 died... 17:24:07.100853 run iperf3-srv_10.42.42.10(pid=28781): Terminated {rc=256} 17:24:07.146809 --- ParallelTerminationStrategy: PID 28784 died... 17:24:07.166151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28784): Terminated: ok {rc=0} 17:24:07.212182 --- ParallelTerminationStrategy: PID 28787 died... 17:24:07.231583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28787): Terminated: ok {rc=0} 17:24:07.277710 --- ParallelTerminationStrategy: PID 28791 died... 17:24:07.297209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28791): Terminated: ok {rc=0} 17:24:07.385313 bus /gobi_0: Setting Powered False 17:24:08.483957 bus /gobi_0: Setting Powered False 17:24:09.601779 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:oc2g iperf3.py ---------------------------------------------- 17:24:10.747615 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:10.758675 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:24:10.794227 tst iperf3.py: using LAC 29464 17:24:10.912544 tst iperf3.py: using RAC 139 17:24:11.033028 tst iperf3.py: using CellId 29464 17:24:11.156065 tst iperf3.py: using BVCI 29465 17:24:11.265292 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:11.275620 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:11.286004 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:11.296153 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:11.306379 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:11.316531 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:11.326922 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:11.337252 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:11.348034 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:11.467416 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:24:11.686693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:12.014039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28793): Launched 17:24:12.298777 run iperf3-srv_10.42.42.10(pid=28794): Launched 17:24:12.422855 tst iperf3.py:8: start network... 17:24:12.641973 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:13.146037 run create_hlr_db(pid=28795): Launched 17:24:13.273395 bus /gobi_6: Setting Powered False 17:24:14.338172 run create_hlr_db(pid=28795): Terminated: ok {rc=0} 17:24:14.789678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28797): Launched 17:24:15.116744 run osmo-hlr_10.42.42.2(pid=28798): Launched 17:24:15.241502 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:15.804028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28800): Launched 17:24:16.161205 run osmo-stp_10.42.42.5(pid=28801): Launched 17:24:16.320694 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:24:17.073896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28803): Launched 17:24:17.202552 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:24:17.480179 run patchelf(pid=28804): Launched 17:24:17.663780 run osmo-stp_10.42.42.5(pid=28801): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28801)] 17:24:17.801788 run osmo-stp_10.42.42.5(pid=28801): stdout: | (launched: 2022-12-10_17:24:16.101088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:17.941203 run osmo-stp_10.42.42.5(pid=28801): stderr: | 20221210172416408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172416408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172416408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172416408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172416409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172416409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172416409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:18.080646 run osmo-stp_10.42.42.5(pid=28801): stdout: | (launched: 2022-12-10_17:24:16.101088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:18.214330 run osmo-stp_10.42.42.5(pid=28801): stderr: | 20221210172416408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172416408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172416408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172416408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172416409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172416409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172416409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:18.372358 run patchelf(pid=28804): Terminating (SIGINT) 17:24:18.554689 run patchelf(pid=28804): Terminated: ok {rc=0} 17:24:18.685641 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28801): Process ended prematurely: osmo-stp_10.42.42.5(pid=28801) [trial-2377↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28801)] [trial-2377↪gprs:oc2g↪iperf3.py:8] 17:24:18.695816 tst iperf3.py:8: Test FAILED (8.0 sec) 17:24:18.725105 run osmo-hlr_10.42.42.2(pid=28798): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28798)] 17:24:18.775158 run osmo-hlr_10.42.42.2(pid=28798): stdout: | (launched: 2022-12-10_17:24:15.057135) 17:24:18.826998 run osmo-hlr_10.42.42.2(pid=28798): stderr: | 20221210172415256 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172415256 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172415256 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172415256 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172415256 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172415256 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172415269 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172415277 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172415277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172415278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:18.879652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28793): Terminating (SIGTERM) 17:24:18.921671 run iperf3-srv_10.42.42.10(pid=28794): Terminating (SIGTERM) 17:24:18.963926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28797): Terminating (SIGTERM) 17:24:19.006261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28800): Terminating (SIGTERM) 17:24:19.048151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28803): Terminating (SIGTERM) 17:24:19.090645 --- ParallelTerminationStrategy: PID 28793 died... 17:24:19.110504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28793): Terminated: ok {rc=0} 17:24:19.157297 --- ParallelTerminationStrategy: PID 28794 died... 17:24:19.176779 run iperf3-srv_10.42.42.10(pid=28794): Terminated {rc=256} 17:24:19.223456 --- ParallelTerminationStrategy: PID 28797 died... 17:24:19.243175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28797): Terminated: ok {rc=0} 17:24:19.289691 --- ParallelTerminationStrategy: PID 28800 died... 17:24:19.309320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28800): Terminated: ok {rc=0} 17:24:19.355887 --- ParallelTerminationStrategy: PID 28803 died... 17:24:19.375479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28803): Terminated: ok {rc=0} 17:24:19.462413 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:oc2g iperf3m4.py ---------------------------------------------- 17:24:20.611883 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:20.623668 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:24:20.661348 tst iperf3m4.py: using LAC 29465 17:24:20.789965 tst iperf3m4.py: using RAC 140 17:24:20.919306 tst iperf3m4.py: using CellId 29465 17:24:21.046566 tst iperf3m4.py: using BVCI 29466 17:24:21.166173 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:21.176936 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:21.187844 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:21.198903 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:21.209928 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:21.220776 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:21.231849 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:21.242898 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:21.254127 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:21.370855 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:21.487459 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:21.604448 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:21.717684 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:24:21.920023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:22.226842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28805): Launched 17:24:22.493456 run iperf3-srv_10.42.42.10(pid=28806): Launched 17:24:22.607780 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:24:22.810232 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:23.114461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28807): Launched 17:24:23.381186 run iperf3-srv_10.42.42.10(pid=28808): Launched 17:24:23.495066 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:24:23.696875 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:24.000687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28809): Launched 17:24:24.265744 run iperf3-srv_10.42.42.10(pid=28810): Launched 17:24:24.379500 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:24:24.581480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:24.884881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28811): Launched 17:24:25.149125 run iperf3-srv_10.42.42.10(pid=28812): Launched 17:24:25.263654 tst iperf3m4.py:8: start network... 17:24:25.465783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:25.936817 run create_hlr_db(pid=28813): Launched 17:24:26.061842 bus /gobi_6: Setting Powered False 17:24:27.122310 run create_hlr_db(pid=28813): Terminated: ok {rc=0} 17:24:27.565661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28815): Launched 17:24:27.892444 run osmo-hlr_10.42.42.2(pid=28816): Launched 17:24:28.016779 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:28.578188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28818): Launched 17:24:28.907207 run osmo-stp_10.42.42.5(pid=28820): Launched 17:24:29.031131 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:24:29.590175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28822): Launched 17:24:29.715500 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:24:29.990661 run patchelf(pid=28823): Launched 17:24:30.173640 run osmo-stp_10.42.42.5(pid=28820): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28820)] 17:24:30.310979 run osmo-stp_10.42.42.5(pid=28820): stdout: | (launched: 2022-12-10_17:24:28.847083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:30.449631 run osmo-stp_10.42.42.5(pid=28820): stderr: | 20221210172429038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172429038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172429038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172429039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172429039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172429039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172429039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:30.588366 run osmo-stp_10.42.42.5(pid=28820): stdout: | (launched: 2022-12-10_17:24:28.847083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:30.721738 run osmo-stp_10.42.42.5(pid=28820): stderr: | 20221210172429038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172429038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172429038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172429039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172429039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172429039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172429039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:30.885744 run patchelf(pid=28823): Terminating (SIGINT) 17:24:31.070875 run patchelf(pid=28823): Terminated: ok {rc=0} 17:24:31.204447 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28820): Process ended prematurely: osmo-stp_10.42.42.5(pid=28820) [trial-2377↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28820)] [trial-2377↪gprs:oc2g↪iperf3m4.py:8] 17:24:31.215609 tst iperf3m4.py:8: Test FAILED (10.6 sec) 17:24:31.248036 run osmo-hlr_10.42.42.2(pid=28816): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28816)] 17:24:31.300543 run osmo-hlr_10.42.42.2(pid=28816): stdout: | (launched: 2022-12-10_17:24:27.832831) 17:24:31.354622 run osmo-hlr_10.42.42.2(pid=28816): stderr: | 20221210172428031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172428031 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172428031 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172428031 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172428031 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172428031 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172428043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172428051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172428052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172428052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:31.409430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28805): Terminating (SIGTERM) 17:24:31.454184 run iperf3-srv_10.42.42.10(pid=28806): Terminating (SIGTERM) 17:24:31.500797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28807): Terminating (SIGTERM) 17:24:31.545539 run iperf3-srv_10.42.42.10(pid=28808): Terminating (SIGTERM) 17:24:31.592184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28809): Terminating (SIGTERM) 17:24:31.637457 run iperf3-srv_10.42.42.10(pid=28810): Terminating (SIGTERM) 17:24:31.684143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28811): Terminating (SIGTERM) 17:24:31.729058 run iperf3-srv_10.42.42.10(pid=28812): Terminating (SIGTERM) 17:24:31.775882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28815): Terminating (SIGTERM) 17:24:31.820561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28818): Terminating (SIGTERM) 17:24:31.866495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28822): Terminating (SIGTERM) 17:24:31.911540 --- ParallelTerminationStrategy: PID 28805 died... 17:24:31.932229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28805): Terminated: ok {rc=0} 17:24:31.981868 --- ParallelTerminationStrategy: PID 28806 died... 17:24:32.002424 run iperf3-srv_10.42.42.10(pid=28806): Terminated {rc=256} 17:24:32.051842 --- ParallelTerminationStrategy: PID 28807 died... 17:24:32.072342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28807): Terminated: ok {rc=0} 17:24:32.121707 --- ParallelTerminationStrategy: PID 28808 died... 17:24:32.142188 run iperf3-srv_10.42.42.10(pid=28808): Terminated {rc=256} 17:24:32.192724 --- ParallelTerminationStrategy: PID 28809 died... 17:24:32.213433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28809): Terminated: ok {rc=0} 17:24:32.262867 --- ParallelTerminationStrategy: PID 28810 died... 17:24:32.282701 run iperf3-srv_10.42.42.10(pid=28810): Terminated {rc=256} 17:24:32.329867 --- ParallelTerminationStrategy: PID 28811 died... 17:24:32.349696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28811): Terminated: ok {rc=0} 17:24:32.396717 --- ParallelTerminationStrategy: PID 28812 died... 17:24:32.416580 run iperf3-srv_10.42.42.10(pid=28812): Terminated {rc=256} 17:24:32.463767 --- ParallelTerminationStrategy: PID 28815 died... 17:24:32.483629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28815): Terminated: ok {rc=0} 17:24:32.530795 --- ParallelTerminationStrategy: PID 28818 died... 17:24:32.550624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28818): Terminated: ok {rc=0} 17:24:32.597843 --- ParallelTerminationStrategy: PID 28822 died... 17:24:32.617676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28822): Terminated: ok {rc=0} 17:24:32.706365 bus /gobi_4: Setting Powered False 17:24:33.805888 bus /gobi_4: Setting Powered False 17:24:34.922602 bus /gobi_1: Setting Powered False 17:24:36.019601 bus /gobi_1: Setting Powered False 17:24:37.134808 bus /gobi_0: Setting Powered False 17:24:38.235640 bus /gobi_0: Setting Powered False 17:24:39.349003 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:oc2g ping.py ---------------------------------------------- 17:24:40.451979 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:40.463652 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:24:40.501170 tst ping.py: using LAC 29466 17:24:40.626949 tst ping.py: using RAC 141 17:24:40.751844 tst ping.py: using CellId 29466 17:24:40.869201 tst ping.py: using BVCI 29467 17:24:40.987348 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:40.998657 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:41.009744 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:41.021291 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:41.032404 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:41.043652 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:41.054845 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:41.065931 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:41.180531 tst ping.py:19: start network... 17:24:41.378854 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:41.837765 run create_hlr_db(pid=28824): Launched 17:24:41.960924 bus /gobi_6: Setting Powered False 17:24:43.020457 run create_hlr_db(pid=28824): Terminated: ok {rc=0} 17:24:43.456091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28826): Launched 17:24:43.776718 run osmo-hlr_10.42.42.2(pid=28827): Launched 17:24:43.901100 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:44.456443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28829): Launched 17:24:44.777980 run osmo-stp_10.42.42.5(pid=28830): Launched 17:24:44.901906 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:24:45.452622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28832): Launched 17:24:45.577078 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:24:45.852108 run patchelf(pid=28833): Launched 17:24:46.040203 run osmo-stp_10.42.42.5(pid=28830): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28830)] 17:24:46.171546 run osmo-stp_10.42.42.5(pid=28830): stdout: | (launched: 2022-12-10_17:24:44.719376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:46.303589 run osmo-stp_10.42.42.5(pid=28830): stderr: | 20221210172444911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172444911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172444911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172444912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172444912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172444912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172444912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:46.454757 run osmo-stp_10.42.42.5(pid=28830): stdout: | (launched: 2022-12-10_17:24:44.719376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:46.586964 run osmo-stp_10.42.42.5(pid=28830): stderr: | 20221210172444911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172444911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172444911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172444912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172444912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172444912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172444912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:46.740707 run patchelf(pid=28833): Terminating (SIGINT) 17:24:46.945756 run patchelf(pid=28833): Terminated: ok {rc=0} 17:24:47.070327 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28830): Process ended prematurely: osmo-stp_10.42.42.5(pid=28830) [trial-2377↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28830)] [trial-2377↪gprs:oc2g↪ping.py:22] 17:24:47.079562 tst ping.py:22: Test FAILED (6.6 sec) 17:24:47.107994 run osmo-hlr_10.42.42.2(pid=28827): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28827)] 17:24:47.157714 run osmo-hlr_10.42.42.2(pid=28827): stdout: | (launched: 2022-12-10_17:24:43.718019) 17:24:47.207864 run osmo-hlr_10.42.42.2(pid=28827): stderr: | 20221210172443916 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172443916 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172443916 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172443916 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172443916 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172443916 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172443928 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172443937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172443937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172443937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:47.258873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28826): Terminating (SIGTERM) 17:24:47.299668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28829): Terminating (SIGTERM) 17:24:47.339281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28832): Terminating (SIGTERM) 17:24:47.379278 --- ParallelTerminationStrategy: PID 28826 died... 17:24:47.398440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28826): Terminated: ok {rc=0} 17:24:47.442548 --- ParallelTerminationStrategy: PID 28829 died... 17:24:47.461374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28829): Terminated: ok {rc=0} 17:24:47.506134 --- ParallelTerminationStrategy: PID 28832 died... 17:24:47.524881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28832): Terminated: ok {rc=0} 17:24:47.612204 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 17:24:48.700765 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:48.711951 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:24:48.749563 tst ping_idle_ping.py: using LAC 29467 17:24:48.868429 tst ping_idle_ping.py: using RAC 142 17:24:48.994857 tst ping_idle_ping.py: using CellId 29467 17:24:49.121603 tst ping_idle_ping.py: using BVCI 29468 17:24:49.231242 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:49.241868 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:49.252380 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:49.263404 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:49.274190 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:49.285010 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:49.295919 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:49.306854 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:49.421421 tst ping_idle_ping.py:24: start network... 17:24:49.621181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:50.085680 run create_hlr_db(pid=28834): Launched 17:24:50.208809 bus /gobi_6: Setting Powered False 17:24:51.269560 run create_hlr_db(pid=28834): Terminated: ok {rc=0} 17:24:51.686538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28836): Launched 17:24:51.986404 run osmo-hlr_10.42.42.2(pid=28837): Launched 17:24:52.099621 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:52.613333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28839): Launched 17:24:52.913131 run osmo-stp_10.42.42.5(pid=28840): Launched 17:24:53.026826 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:24:53.540791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28842): Launched 17:24:53.655076 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:24:53.906771 run patchelf(pid=28843): Launched 17:24:54.073990 run osmo-stp_10.42.42.5(pid=28840): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28840)] 17:24:54.200733 run osmo-stp_10.42.42.5(pid=28840): stdout: | (launched: 2022-12-10_17:24:52.857732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:54.328264 run osmo-stp_10.42.42.5(pid=28840): stderr: | 20221210172453030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172453030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172453030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172453031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172453031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172453031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172453031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:54.457179 run osmo-stp_10.42.42.5(pid=28840): stdout: | (launched: 2022-12-10_17:24:52.857732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:54.579340 run osmo-stp_10.42.42.5(pid=28840): stderr: | 20221210172453030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172453030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172453030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172453031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172453031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172453031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172453031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:54.724485 run patchelf(pid=28843): Terminating (SIGINT) 17:24:54.891355 run patchelf(pid=28843): Terminated: ok {rc=0} 17:24:55.011358 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28840): Process ended prematurely: osmo-stp_10.42.42.5(pid=28840) [trial-2377↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28840)] [trial-2377↪gprs:oc2g↪ping_idle_ping.py:27] 17:24:55.020375 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 17:24:55.047323 run osmo-hlr_10.42.42.2(pid=28837): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28837)] 17:24:55.094743 run osmo-hlr_10.42.42.2(pid=28837): stdout: | (launched: 2022-12-10_17:24:51.930548) 17:24:55.143536 run osmo-hlr_10.42.42.2(pid=28837): stderr: | 20221210172452106 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172452106 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172452106 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172452106 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172452106 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172452106 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172452118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172452129 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172452129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172452129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:55.193034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28836): Terminating (SIGTERM) 17:24:55.232499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28839): Terminating (SIGTERM) 17:24:55.272029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28842): Terminating (SIGTERM) 17:24:55.311757 --- ParallelTerminationStrategy: PID 28836 died... 17:24:55.330888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28836): Terminated: ok {rc=0} 17:24:55.374599 --- ParallelTerminationStrategy: PID 28839 died... 17:24:55.393314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28839): Terminated: ok {rc=0} 17:24:55.437081 --- ParallelTerminationStrategy: PID 28842 died... 17:24:55.455810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28842): Terminated: ok {rc=0} 17:24:55.538648 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 17:24:56.825629 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:24:56.830649 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:24:56.850983 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:24:56.888744 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:24:56.975145 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:24:56.995254 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:24:57.032382 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:24:57.623732 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:24:57.671078 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:57.681742 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:24:57.717469 tst cs_paging_gprs_active.py: using LAC 29468 17:24:57.833612 tst cs_paging_gprs_active.py: using RAC 143 17:24:57.953123 tst cs_paging_gprs_active.py: using CellId 29468 17:24:58.069910 tst cs_paging_gprs_active.py: using BVCI 29469 17:24:58.178245 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:58.188862 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:58.199463 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:58.210457 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:58.221483 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:58.232345 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:58.243486 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:58.254472 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:58.265616 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:24:58.384820 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:24:58.502993 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:24:58.718641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:59.039069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28847): Launched 17:24:59.318463 run iperf3-srv_10.42.42.10(pid=28848): Launched 17:24:59.438678 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:24:59.652491 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:59.973465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28849): Launched 17:25:00.253147 run iperf3-srv_10.42.42.10(pid=28850): Launched 17:25:00.374134 tst cs_paging_gprs_active.py:38: start network... 17:25:00.589680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:01.121686 run create_hlr_db(pid=28851): Launched 17:25:01.275175 bus /gobi_6: Setting Powered False 17:25:02.334978 run create_hlr_db(pid=28851): Terminated: ok {rc=0} 17:25:02.767503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28856): Launched 17:25:03.070379 run osmo-hlr_10.42.42.2(pid=28857): Launched 17:25:03.184753 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:03.717133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28859): Launched 17:25:04.018420 run osmo-stp_10.42.42.5(pid=28860): Launched 17:25:04.134960 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:25:04.652317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28862): Launched 17:25:04.767686 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:25:05.020696 run patchelf(pid=28863): Launched 17:25:05.188256 run osmo-stp_10.42.42.5(pid=28860): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28860)] 17:25:05.315363 run osmo-stp_10.42.42.5(pid=28860): stdout: | (launched: 2022-12-10_17:25:03.963019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:05.443438 run osmo-stp_10.42.42.5(pid=28860): stderr: | 20221210172504133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172504133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172504133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172504134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172504134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172504134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172504134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:05.571847 run osmo-stp_10.42.42.5(pid=28860): stdout: | (launched: 2022-12-10_17:25:03.963019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:05.694784 run osmo-stp_10.42.42.5(pid=28860): stderr: | 20221210172504133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172504133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172504133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172504134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172504134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172504134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172504134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:05.840392 run patchelf(pid=28863): Terminating (SIGINT) 17:25:06.008158 run patchelf(pid=28863): Terminated: ok {rc=0} 17:25:06.129123 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28860): Process ended prematurely: osmo-stp_10.42.42.5(pid=28860) [trial-2377↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28860)] [trial-2377↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:25:06.138498 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 17:25:06.165491 run osmo-hlr_10.42.42.2(pid=28857): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28857)] 17:25:06.213155 run osmo-hlr_10.42.42.2(pid=28857): stdout: | (launched: 2022-12-10_17:25:03.014467) 17:25:06.262512 run osmo-hlr_10.42.42.2(pid=28857): stderr: | 20221210172503193 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172503194 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172503194 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172503194 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172503194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172503194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172503206 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172503215 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172503215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172503215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:06.312165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28847): Terminating (SIGTERM) 17:25:06.351665 run iperf3-srv_10.42.42.10(pid=28848): Terminating (SIGTERM) 17:25:06.391004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28849): Terminating (SIGTERM) 17:25:06.430380 run iperf3-srv_10.42.42.10(pid=28850): Terminating (SIGTERM) 17:25:06.470016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28856): Terminating (SIGTERM) 17:25:06.509311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28859): Terminating (SIGTERM) 17:25:06.548512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28862): Terminating (SIGTERM) 17:25:06.587922 --- ParallelTerminationStrategy: PID 28847 died... 17:25:06.606823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28847): Terminated: ok {rc=0} 17:25:06.650887 --- ParallelTerminationStrategy: PID 28848 died... 17:25:06.669161 run iperf3-srv_10.42.42.10(pid=28848): Terminated {rc=256} 17:25:06.712422 --- ParallelTerminationStrategy: PID 28849 died... 17:25:06.730672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28849): Terminated: ok {rc=0} 17:25:06.773816 --- ParallelTerminationStrategy: PID 28850 died... 17:25:06.792078 run iperf3-srv_10.42.42.10(pid=28850): Terminated {rc=256} 17:25:06.835396 --- ParallelTerminationStrategy: PID 28856 died... 17:25:06.853719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28856): Terminated: ok {rc=0} 17:25:06.896891 --- ParallelTerminationStrategy: PID 28859 died... 17:25:06.915585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28859): Terminated: ok {rc=0} 17:25:06.958920 --- ParallelTerminationStrategy: PID 28862 died... 17:25:06.977427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28862): Terminated: ok {rc=0} 17:25:07.060669 bus /gobi_0: Setting Powered False 17:25:08.158190 bus /gobi_0: Setting Powered False 17:25:09.272604 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:25:10.420702 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:10.432526 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:25:10.471461 tst iperf3.py: using LAC 29469 17:25:10.602629 tst iperf3.py: using RAC 144 17:25:10.727362 tst iperf3.py: using CellId 29469 17:25:10.851785 tst iperf3.py: using BVCI 29470 17:25:10.967869 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:10.979027 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:10.990123 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:11.001453 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:11.012558 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:11.023713 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:11.035010 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:11.046329 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:11.057946 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:11.174436 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:25:11.374125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:11.673392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28864): Launched 17:25:11.933619 run iperf3-srv_10.42.42.10(pid=28865): Launched 17:25:12.045793 tst iperf3.py:8: start network... 17:25:12.244084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:12.706665 run create_hlr_db(pid=28866): Launched 17:25:12.829162 bus /gobi_6: Setting Powered False 17:25:13.889119 run create_hlr_db(pid=28866): Terminated: ok {rc=0} 17:25:14.305097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28868): Launched 17:25:14.604115 run osmo-hlr_10.42.42.2(pid=28869): Launched 17:25:14.716861 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:15.248232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28871): Launched 17:25:15.549069 run osmo-stp_10.42.42.5(pid=28872): Launched 17:25:15.663778 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:25:16.245814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28874): Launched 17:25:16.372089 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:25:16.633729 run patchelf(pid=28875): Launched 17:25:16.827794 run osmo-stp_10.42.42.5(pid=28872): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28872)] 17:25:16.967191 run osmo-stp_10.42.42.5(pid=28872): stdout: | (launched: 2022-12-10_17:25:15.493246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:17.107459 run osmo-stp_10.42.42.5(pid=28872): stderr: | 20221210172515667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172515667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172515667 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172515668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172515668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172515668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172515668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:17.248260 run osmo-stp_10.42.42.5(pid=28872): stdout: | (launched: 2022-12-10_17:25:15.493246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:17.380215 run osmo-stp_10.42.42.5(pid=28872): stderr: | 20221210172515667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172515667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172515667 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172515668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172515668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172515668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172515668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:17.536635 run patchelf(pid=28875): Terminating (SIGINT) 17:25:17.715723 run patchelf(pid=28875): Terminated: ok {rc=0} 17:25:17.844891 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28872): Process ended prematurely: osmo-stp_10.42.42.5(pid=28872) [trial-2377↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28872)] [trial-2377↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 17:25:17.855225 tst iperf3.py:8: Test FAILED (7.5 sec) 17:25:17.885552 run osmo-hlr_10.42.42.2(pid=28869): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28869)] 17:25:17.936692 run osmo-hlr_10.42.42.2(pid=28869): stdout: | (launched: 2022-12-10_17:25:14.548871) 17:25:17.989539 run osmo-hlr_10.42.42.2(pid=28869): stderr: | 20221210172514728 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172514728 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172514728 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172514728 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172514728 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172514728 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172514740 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172514750 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172514750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172514750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:18.042549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28864): Terminating (SIGTERM) 17:25:18.085295 run iperf3-srv_10.42.42.10(pid=28865): Terminating (SIGTERM) 17:25:18.128055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28868): Terminating (SIGTERM) 17:25:18.171051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28871): Terminating (SIGTERM) 17:25:18.214007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28874): Terminating (SIGTERM) 17:25:18.257282 --- ParallelTerminationStrategy: PID 28864 died... 17:25:18.277418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28864): Terminated: ok {rc=0} 17:25:18.325679 --- ParallelTerminationStrategy: PID 28865 died... 17:25:18.345317 run iperf3-srv_10.42.42.10(pid=28865): Terminated {rc=256} 17:25:18.393313 --- ParallelTerminationStrategy: PID 28868 died... 17:25:18.412903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28868): Terminated: ok {rc=0} 17:25:18.460794 --- ParallelTerminationStrategy: PID 28871 died... 17:25:18.480390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28871): Terminated: ok {rc=0} 17:25:18.528272 --- ParallelTerminationStrategy: PID 28874 died... 17:25:18.547979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28874): Terminated: ok {rc=0} 17:25:18.638296 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:25:19.789370 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:19.801164 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:25:19.839358 tst iperf3m4.py: using LAC 29470 17:25:19.966576 tst iperf3m4.py: using RAC 145 17:25:20.091814 tst iperf3m4.py: using CellId 29470 17:25:20.217629 tst iperf3m4.py: using BVCI 29471 17:25:20.327062 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:20.337940 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:20.348531 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:20.359196 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:20.369618 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:20.380048 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:20.390739 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:20.401179 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:20.411776 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:20.532919 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:20.647054 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:20.766202 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:20.882984 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:25:21.090009 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:21.391174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28876): Launched 17:25:21.651599 run iperf3-srv_10.42.42.10(pid=28877): Launched 17:25:21.764185 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:25:21.963327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:22.262943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28878): Launched 17:25:22.523066 run iperf3-srv_10.42.42.10(pid=28879): Launched 17:25:22.635824 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:25:22.834229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:23.133100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28880): Launched 17:25:23.395135 run iperf3-srv_10.42.42.10(pid=28881): Launched 17:25:23.507194 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:25:23.705159 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:24.004461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28882): Launched 17:25:24.264771 run iperf3-srv_10.42.42.10(pid=28883): Launched 17:25:24.376692 tst iperf3m4.py:8: start network... 17:25:24.573867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:25.038170 run create_hlr_db(pid=28884): Launched 17:25:25.162573 bus /gobi_6: Setting Powered False 17:25:26.224781 run create_hlr_db(pid=28884): Terminated: ok {rc=0} 17:25:26.670591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28886): Launched 17:25:26.990856 run osmo-hlr_10.42.42.2(pid=28887): Launched 17:25:27.113821 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:27.662143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28889): Launched 17:25:27.983082 run osmo-stp_10.42.42.5(pid=28890): Launched 17:25:28.105921 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:25:28.655226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28892): Launched 17:25:28.779159 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:25:29.050410 run patchelf(pid=28893): Launched 17:25:29.230397 run osmo-stp_10.42.42.5(pid=28890): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28890)] 17:25:29.366093 run osmo-stp_10.42.42.5(pid=28890): stdout: | (launched: 2022-12-10_17:25:27.924590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:29.503212 run osmo-stp_10.42.42.5(pid=28890): stderr: | 20221210172528114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172528114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172528114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172528114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172528115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172528115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172528115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:29.640308 run osmo-stp_10.42.42.5(pid=28890): stdout: | (launched: 2022-12-10_17:25:27.924590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:29.771372 run osmo-stp_10.42.42.5(pid=28890): stderr: | 20221210172528114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172528114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172528114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172528114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172528115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172528115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172528115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:29.927439 run patchelf(pid=28893): Terminating (SIGINT) 17:25:30.106380 run patchelf(pid=28893): Terminated: ok {rc=0} 17:25:30.235027 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28890): Process ended prematurely: osmo-stp_10.42.42.5(pid=28890) [trial-2377↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28890)] [trial-2377↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 17:25:30.245236 tst iperf3m4.py:8: Test FAILED (10.5 sec) 17:25:30.274182 run osmo-hlr_10.42.42.2(pid=28887): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28887)] 17:25:30.324728 run osmo-hlr_10.42.42.2(pid=28887): stdout: | (launched: 2022-12-10_17:25:26.932440) 17:25:30.376661 run osmo-hlr_10.42.42.2(pid=28887): stderr: | 20221210172527128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172527128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172527128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172527128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172527128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172527128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172527140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172527148 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172527149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172527149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:30.428886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28876): Terminating (SIGTERM) 17:25:30.470900 run iperf3-srv_10.42.42.10(pid=28877): Terminating (SIGTERM) 17:25:30.513002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28878): Terminating (SIGTERM) 17:25:30.555156 run iperf3-srv_10.42.42.10(pid=28879): Terminating (SIGTERM) 17:25:30.598475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28880): Terminating (SIGTERM) 17:25:30.640759 run iperf3-srv_10.42.42.10(pid=28881): Terminating (SIGTERM) 17:25:30.682746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28882): Terminating (SIGTERM) 17:25:30.724479 run iperf3-srv_10.42.42.10(pid=28883): Terminating (SIGTERM) 17:25:30.766333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28886): Terminating (SIGTERM) 17:25:30.808041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28889): Terminating (SIGTERM) 17:25:30.850198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28892): Terminating (SIGTERM) 17:25:30.893245 --- ParallelTerminationStrategy: PID 28876 died... 17:25:30.913285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28876): Terminated: ok {rc=0} 17:25:30.960543 --- ParallelTerminationStrategy: PID 28877 died... 17:25:30.980510 run iperf3-srv_10.42.42.10(pid=28877): Terminated {rc=256} 17:25:31.027498 --- ParallelTerminationStrategy: PID 28878 died... 17:25:31.047454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28878): Terminated: ok {rc=0} 17:25:31.094575 --- ParallelTerminationStrategy: PID 28879 died... 17:25:31.114515 run iperf3-srv_10.42.42.10(pid=28879): Terminated {rc=256} 17:25:31.161760 --- ParallelTerminationStrategy: PID 28880 died... 17:25:31.181778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28880): Terminated: ok {rc=0} 17:25:31.228918 --- ParallelTerminationStrategy: PID 28881 died... 17:25:31.248937 run iperf3-srv_10.42.42.10(pid=28881): Terminated {rc=256} 17:25:31.296062 --- ParallelTerminationStrategy: PID 28882 died... 17:25:31.315981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28882): Terminated: ok {rc=0} 17:25:31.363489 --- ParallelTerminationStrategy: PID 28883 died... 17:25:31.383441 run iperf3-srv_10.42.42.10(pid=28883): Terminated {rc=256} 17:25:31.430897 --- ParallelTerminationStrategy: PID 28886 died... 17:25:31.450926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28886): Terminated: ok {rc=0} 17:25:31.497919 --- ParallelTerminationStrategy: PID 28889 died... 17:25:31.517919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28889): Terminated: ok {rc=0} 17:25:31.565290 --- ParallelTerminationStrategy: PID 28892 died... 17:25:31.585525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28892): Terminated: ok {rc=0} 17:25:31.675853 bus /gobi_4: Setting Powered False 17:25:32.776074 bus /gobi_4: Setting Powered False 17:25:33.894752 bus /gobi_1: Setting Powered False 17:25:34.994300 bus /gobi_1: Setting Powered False 17:25:36.109213 bus /gobi_0: Setting Powered False 17:25:37.206734 bus /gobi_0: Setting Powered False 17:25:38.323228 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 17:25:39.425918 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:39.437776 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:25:39.474870 tst ping.py: using LAC 29471 17:25:39.597232 tst ping.py: using RAC 146 17:25:39.717325 tst ping.py: using CellId 29471 17:25:39.837397 tst ping.py: using BVCI 29472 17:25:39.951236 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:39.963182 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:39.974365 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:39.985809 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:39.996775 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:40.007937 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:40.019334 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:40.030614 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:40.147780 tst ping.py:19: start network... 17:25:40.358178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:40.841252 run create_hlr_db(pid=28894): Launched 17:25:40.961267 bus /gobi_6: Setting Powered False 17:25:42.023639 run create_hlr_db(pid=28894): Terminated: ok {rc=0} 17:25:42.444216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28896): Launched 17:25:42.740442 run osmo-hlr_10.42.42.2(pid=28897): Launched 17:25:42.853309 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:43.360882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28899): Launched 17:25:43.655313 run osmo-stp_10.42.42.5(pid=28900): Launched 17:25:43.767226 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:25:44.276069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28902): Launched 17:25:44.388756 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:25:44.636846 run patchelf(pid=28903): Launched 17:25:44.801980 run osmo-stp_10.42.42.5(pid=28900): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28900)] 17:25:44.927059 run osmo-stp_10.42.42.5(pid=28900): stdout: | (launched: 2022-12-10_17:25:43.601118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:45.053097 run osmo-stp_10.42.42.5(pid=28900): stderr: | 20221210172543771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172543771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172543772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172543772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172543772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172543773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172543773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:45.179437 run osmo-stp_10.42.42.5(pid=28900): stdout: | (launched: 2022-12-10_17:25:43.601118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:45.299713 run osmo-stp_10.42.42.5(pid=28900): stderr: | 20221210172543771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172543771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172543772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172543772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172543772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172543773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172543773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:45.442356 run patchelf(pid=28903): Terminating (SIGINT) 17:25:45.606753 run patchelf(pid=28903): Terminated: ok {rc=0} 17:25:45.725694 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28900): Process ended prematurely: osmo-stp_10.42.42.5(pid=28900) [trial-2377↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28900)] [trial-2377↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 17:25:45.734468 tst ping.py:22: Test FAILED (6.3 sec) 17:25:45.760928 run osmo-hlr_10.42.42.2(pid=28897): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28897)] 17:25:45.808834 run osmo-hlr_10.42.42.2(pid=28897): stdout: | (launched: 2022-12-10_17:25:42.685421) 17:25:45.860638 run osmo-hlr_10.42.42.2(pid=28897): stderr: | 20221210172542859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172542859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172542859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172542859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172542859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172542860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172542872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172542883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172542883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172542883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:45.926579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28896): Terminating (SIGTERM) 17:25:45.967053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28899): Terminating (SIGTERM) 17:25:46.007404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28902): Terminating (SIGTERM) 17:25:46.048024 --- ParallelTerminationStrategy: PID 28896 died... 17:25:46.068001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28896): Terminated: ok {rc=0} 17:25:46.113695 --- ParallelTerminationStrategy: PID 28899 died... 17:25:46.132820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28899): Terminated: ok {rc=0} 17:25:46.177800 --- ParallelTerminationStrategy: PID 28902 died... 17:25:46.196870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28902): Terminated: ok {rc=0} 17:25:46.282761 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:25:47.366490 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:47.377867 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:25:47.415187 tst ping_idle_ping.py: using LAC 29472 17:25:47.529171 tst ping_idle_ping.py: using RAC 147 17:25:47.644048 tst ping_idle_ping.py: using CellId 29472 17:25:47.758883 tst ping_idle_ping.py: using BVCI 29473 17:25:47.873750 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:47.885382 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:47.896334 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:47.908235 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:47.919778 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:47.931510 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:47.943355 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:47.955069 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:48.068509 tst ping_idle_ping.py:24: start network... 17:25:48.266138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:48.725396 run create_hlr_db(pid=28904): Launched 17:25:48.847219 bus /gobi_6: Setting Powered False 17:25:49.906878 run create_hlr_db(pid=28904): Terminated: ok {rc=0} 17:25:50.319739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28906): Launched 17:25:50.617453 run osmo-hlr_10.42.42.2(pid=28907): Launched 17:25:50.730892 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:51.253103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28909): Launched 17:25:51.549195 run osmo-stp_10.42.42.5(pid=28910): Launched 17:25:51.662365 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:25:52.172820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28912): Launched 17:25:52.286244 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:25:52.535329 run patchelf(pid=28913): Launched 17:25:52.700634 run osmo-stp_10.42.42.5(pid=28910): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28910)] 17:25:52.826872 run osmo-stp_10.42.42.5(pid=28910): stdout: | (launched: 2022-12-10_17:25:51.494448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:52.954216 run osmo-stp_10.42.42.5(pid=28910): stderr: | 20221210172551666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172551666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172551666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172551666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172551667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172551667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172551667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:53.081336 run osmo-stp_10.42.42.5(pid=28910): stdout: | (launched: 2022-12-10_17:25:51.494448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:53.202857 run osmo-stp_10.42.42.5(pid=28910): stderr: | 20221210172551666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172551666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172551666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172551666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172551667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172551667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172551667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:53.346739 run patchelf(pid=28913): Terminating (SIGINT) 17:25:53.512822 run patchelf(pid=28913): Terminated: ok {rc=0} 17:25:53.632342 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28910): Process ended prematurely: osmo-stp_10.42.42.5(pid=28910) [trial-2377↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28910)] [trial-2377↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 17:25:53.641318 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 17:25:53.668063 run osmo-hlr_10.42.42.2(pid=28907): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28907)] 17:25:53.715941 run osmo-hlr_10.42.42.2(pid=28907): stdout: | (launched: 2022-12-10_17:25:50.561683) 17:25:53.765565 run osmo-hlr_10.42.42.2(pid=28907): stderr: | 20221210172550739 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172550739 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172550739 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172550739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172550739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172550739 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172550752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172550761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172550761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172550761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:53.815421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28906): Terminating (SIGTERM) 17:25:53.855166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28909): Terminating (SIGTERM) 17:25:53.894625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28912): Terminating (SIGTERM) 17:25:53.934586 --- ParallelTerminationStrategy: PID 28906 died... 17:25:53.953351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28906): Terminated: ok {rc=0} 17:25:53.997238 --- ParallelTerminationStrategy: PID 28909 died... 17:25:54.015778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28909): Terminated: ok {rc=0} 17:25:54.059695 --- ParallelTerminationStrategy: PID 28912 died... 17:25:54.078295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28912): Terminated: ok {rc=0} 17:25:54.165234 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:25:55.458063 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:25:55.464305 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:25:55.484931 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:25:55.522919 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:25:55.609515 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:25:55.629557 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:25:55.666713 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:25:56.260863 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:25:56.309168 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:56.319893 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:25:56.375529 tst cs_paging_gprs_active.py: using LAC 29473 17:25:56.495413 tst cs_paging_gprs_active.py: using RAC 148 17:25:56.626566 tst cs_paging_gprs_active.py: using CellId 29473 17:25:56.751966 tst cs_paging_gprs_active.py: using BVCI 29474 17:25:56.870489 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:56.882364 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:56.893523 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:56.905285 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:56.917055 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:56.928881 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:56.941070 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:56.952831 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:56.964650 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:25:57.083006 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:25:57.197274 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:25:57.399450 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:57.701367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28919): Launched 17:25:57.964490 run iperf3-srv_10.42.42.10(pid=28920): Launched 17:25:58.078215 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:25:58.279183 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:58.581394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28921): Launched 17:25:58.844603 run iperf3-srv_10.42.42.10(pid=28922): Launched 17:25:58.958872 tst cs_paging_gprs_active.py:38: start network... 17:25:59.159442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:59.627755 run create_hlr_db(pid=28923): Launched 17:25:59.752598 bus /gobi_6: Setting Powered False 17:26:00.812235 run create_hlr_db(pid=28923): Terminated: ok {rc=0} 17:26:01.262908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28925): Launched 17:26:01.580431 run osmo-hlr_10.42.42.2(pid=28926): Launched 17:26:01.768250 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:02.535598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28928): Launched 17:26:02.857683 run osmo-stp_10.42.42.5(pid=28929): Launched 17:26:02.981164 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:26:03.534719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28931): Launched 17:26:03.659832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:26:03.931283 run patchelf(pid=28932): Launched 17:26:04.110337 run osmo-stp_10.42.42.5(pid=28929): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28929)] 17:26:04.246343 run osmo-stp_10.42.42.5(pid=28929): stdout: | (launched: 2022-12-10_17:26:02.799097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:04.383740 run osmo-stp_10.42.42.5(pid=28929): stderr: | 20221210172602992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172602992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172602993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172602993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172602994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172602994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172602994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:04.521544 run osmo-stp_10.42.42.5(pid=28929): stdout: | (launched: 2022-12-10_17:26:02.799097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:04.653578 run osmo-stp_10.42.42.5(pid=28929): stderr: | 20221210172602992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172602992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172602993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172602993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172602994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172602994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172602994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:04.809975 run patchelf(pid=28932): Terminating (SIGINT) 17:26:04.990087 run patchelf(pid=28932): Terminated: ok {rc=0} 17:26:05.119593 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28929): Process ended prematurely: osmo-stp_10.42.42.5(pid=28929) [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28929)] [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:26:05.129655 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:26:05.158886 run osmo-hlr_10.42.42.2(pid=28926): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28926)] 17:26:05.209174 run osmo-hlr_10.42.42.2(pid=28926): stdout: | (launched: 2022-12-10_17:26:01.523693) 17:26:05.261230 run osmo-hlr_10.42.42.2(pid=28926): stderr: | 20221210172601937 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172601937 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172601937 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172601937 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172601938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172601938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172601960 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172601976 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172601978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172601980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:05.313708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28919): Terminating (SIGTERM) 17:26:05.355935 run iperf3-srv_10.42.42.10(pid=28920): Terminating (SIGTERM) 17:26:05.398159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28921): Terminating (SIGTERM) 17:26:05.440186 run iperf3-srv_10.42.42.10(pid=28922): Terminating (SIGTERM) 17:26:05.482120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28925): Terminating (SIGTERM) 17:26:05.524419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28928): Terminating (SIGTERM) 17:26:05.566396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28931): Terminating (SIGTERM) 17:26:05.608612 --- ParallelTerminationStrategy: PID 28919 died... 17:26:05.628619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28919): Terminated: ok {rc=0} 17:26:05.675177 --- ParallelTerminationStrategy: PID 28920 died... 17:26:05.694438 run iperf3-srv_10.42.42.10(pid=28920): Terminated {rc=256} 17:26:05.740436 --- ParallelTerminationStrategy: PID 28921 died... 17:26:05.759748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28921): Terminated: ok {rc=0} 17:26:05.805841 --- ParallelTerminationStrategy: PID 28922 died... 17:26:05.825159 run iperf3-srv_10.42.42.10(pid=28922): Terminated {rc=256} 17:26:05.871101 --- ParallelTerminationStrategy: PID 28925 died... 17:26:05.890905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28925): Terminated: ok {rc=0} 17:26:05.937336 --- ParallelTerminationStrategy: PID 28928 died... 17:26:05.956570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28928): Terminated: ok {rc=0} 17:26:06.002920 --- ParallelTerminationStrategy: PID 28931 died... 17:26:06.022403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28931): Terminated: ok {rc=0} 17:26:06.110622 bus /gobi_0: Setting Powered False 17:26:07.209391 bus /gobi_0: Setting Powered False 17:26:08.324810 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:26:09.473321 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:09.485253 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:26:09.546472 tst iperf3.py: using LAC 29474 17:26:09.671716 tst iperf3.py: using RAC 149 17:26:09.801229 tst iperf3.py: using CellId 29474 17:26:09.926823 tst iperf3.py: using BVCI 29475 17:26:10.044855 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:10.056222 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:10.067248 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:10.078720 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:10.089978 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:10.101221 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:10.112511 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:10.123572 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:10.135036 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:10.254451 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:26:10.456581 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:10.758569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28933): Launched 17:26:11.021834 run iperf3-srv_10.42.42.10(pid=28934): Launched 17:26:11.135006 tst iperf3.py:8: start network... 17:26:11.335000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:11.798953 run create_hlr_db(pid=28935): Launched 17:26:11.922347 bus /gobi_6: Setting Powered False 17:26:12.982777 run create_hlr_db(pid=28935): Terminated: ok {rc=0} 17:26:13.399515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28937): Launched 17:26:13.699060 run osmo-hlr_10.42.42.2(pid=28938): Launched 17:26:13.813959 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:14.330123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28940): Launched 17:26:14.629375 run osmo-stp_10.42.42.5(pid=28941): Launched 17:26:14.743911 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:26:15.261315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28943): Launched 17:26:15.376048 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:26:15.628354 run patchelf(pid=28944): Launched 17:26:15.794787 run osmo-stp_10.42.42.5(pid=28941): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28941)] 17:26:15.955503 run osmo-stp_10.42.42.5(pid=28941): stdout: | (launched: 2022-12-10_17:26:14.574159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:16.107104 run osmo-stp_10.42.42.5(pid=28941): stderr: | 20221210172614744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172614744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172614744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172614745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172614745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172614745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172614745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:16.249867 run osmo-stp_10.42.42.5(pid=28941): stdout: | (launched: 2022-12-10_17:26:14.574159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:16.387058 run osmo-stp_10.42.42.5(pid=28941): stderr: | 20221210172614744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172614744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172614744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172614745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172614745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172614745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172614745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:16.550157 run patchelf(pid=28944): Terminating (SIGINT) 17:26:16.735932 run patchelf(pid=28944): Terminated: ok {rc=0} 17:26:16.869987 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28941): Process ended prematurely: osmo-stp_10.42.42.5(pid=28941) [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28941)] [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 17:26:16.881316 tst iperf3.py:8: Test FAILED (7.4 sec) 17:26:16.913763 run osmo-hlr_10.42.42.2(pid=28938): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28938)] 17:26:16.967243 run osmo-hlr_10.42.42.2(pid=28938): stdout: | (launched: 2022-12-10_17:26:13.643455) 17:26:17.021992 run osmo-hlr_10.42.42.2(pid=28938): stderr: | 20221210172613820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172613821 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172613821 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172613821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172613821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172613821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172613833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172613842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172613842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172613842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:17.076690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28933): Terminating (SIGTERM) 17:26:17.121153 run iperf3-srv_10.42.42.10(pid=28934): Terminating (SIGTERM) 17:26:17.165168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28937): Terminating (SIGTERM) 17:26:17.207405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28940): Terminating (SIGTERM) 17:26:17.249490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28943): Terminating (SIGTERM) 17:26:17.291819 --- ParallelTerminationStrategy: PID 28933 died... 17:26:17.311929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28933): Terminated: ok {rc=0} 17:26:17.359099 --- ParallelTerminationStrategy: PID 28934 died... 17:26:17.378575 run iperf3-srv_10.42.42.10(pid=28934): Terminated {rc=256} 17:26:17.424659 --- ParallelTerminationStrategy: PID 28937 died... 17:26:17.444175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28937): Terminated: ok {rc=0} 17:26:17.493146 --- ParallelTerminationStrategy: PID 28940 died... 17:26:17.511356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28940): Terminated: ok {rc=0} 17:26:17.557342 --- ParallelTerminationStrategy: PID 28943 died... 17:26:17.576822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28943): Terminated: ok {rc=0} 17:26:17.665110 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:26:18.810159 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:18.821585 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:26:18.879212 tst iperf3m4.py: using LAC 29475 17:26:18.996856 tst iperf3m4.py: using RAC 150 17:26:19.116142 tst iperf3m4.py: using CellId 29475 17:26:19.234569 tst iperf3m4.py: using BVCI 29476 17:26:19.342089 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.353089 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.363623 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.374165 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.384547 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.395004 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.405843 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.416326 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.427056 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:19.544434 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:19.663347 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:19.778570 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:19.897082 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:26:20.113156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:20.434646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28945): Launched 17:26:20.715037 run iperf3-srv_10.42.42.10(pid=28946): Launched 17:26:20.836038 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:26:21.051286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:21.372805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28947): Launched 17:26:21.651520 run iperf3-srv_10.42.42.10(pid=28948): Launched 17:26:21.772226 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:26:21.987827 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:22.309521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28949): Launched 17:26:22.590538 run iperf3-srv_10.42.42.10(pid=28950): Launched 17:26:22.713476 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:26:22.929004 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:23.251347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28951): Launched 17:26:23.532446 run iperf3-srv_10.42.42.10(pid=28952): Launched 17:26:23.653583 tst iperf3m4.py:8: start network... 17:26:23.869148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:24.366581 run create_hlr_db(pid=28953): Launched 17:26:24.491031 bus /gobi_6: Setting Powered False 17:26:25.550987 run create_hlr_db(pid=28953): Terminated: ok {rc=0} 17:26:25.996788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28955): Launched 17:26:26.317831 run osmo-hlr_10.42.42.2(pid=28956): Launched 17:26:26.440667 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:26.997756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28958): Launched 17:26:27.319407 run osmo-stp_10.42.42.5(pid=28959): Launched 17:26:27.441718 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:26:27.997167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28961): Launched 17:26:28.120760 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:26:28.392171 run patchelf(pid=28962): Launched 17:26:28.571310 run osmo-stp_10.42.42.5(pid=28959): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28959)] 17:26:28.707478 run osmo-stp_10.42.42.5(pid=28959): stdout: | (launched: 2022-12-10_17:26:27.260048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:28.845122 run osmo-stp_10.42.42.5(pid=28959): stderr: | 20221210172627451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172627451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172627451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172627452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172627452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172627452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172627453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:28.983529 run osmo-stp_10.42.42.5(pid=28959): stdout: | (launched: 2022-12-10_17:26:27.260048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:29.115532 run osmo-stp_10.42.42.5(pid=28959): stderr: | 20221210172627451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172627451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172627451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172627452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172627452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172627452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172627453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:29.271864 run patchelf(pid=28962): Terminating (SIGINT) 17:26:29.451597 run patchelf(pid=28962): Terminated: ok {rc=0} 17:26:29.580808 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28959): Process ended prematurely: osmo-stp_10.42.42.5(pid=28959) [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28959)] [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:26:29.590903 tst iperf3m4.py:8: Test FAILED (10.8 sec) 17:26:29.620123 run osmo-hlr_10.42.42.2(pid=28956): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28956)] 17:26:29.670690 run osmo-hlr_10.42.42.2(pid=28956): stdout: | (launched: 2022-12-10_17:26:26.258764) 17:26:29.722804 run osmo-hlr_10.42.42.2(pid=28956): stderr: | 20221210172626458 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172626458 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172626458 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172626458 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172626458 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172626458 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172626471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172626479 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172626480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172626480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:29.775653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28945): Terminating (SIGTERM) 17:26:29.817663 run iperf3-srv_10.42.42.10(pid=28946): Terminating (SIGTERM) 17:26:29.859870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28947): Terminating (SIGTERM) 17:26:29.902427 run iperf3-srv_10.42.42.10(pid=28948): Terminating (SIGTERM) 17:26:29.944459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28949): Terminating (SIGTERM) 17:26:29.986784 run iperf3-srv_10.42.42.10(pid=28950): Terminating (SIGTERM) 17:26:30.028788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28951): Terminating (SIGTERM) 17:26:30.070905 run iperf3-srv_10.42.42.10(pid=28952): Terminating (SIGTERM) 17:26:30.112855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28955): Terminating (SIGTERM) 17:26:30.155004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28958): Terminating (SIGTERM) 17:26:30.197089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28961): Terminating (SIGTERM) 17:26:30.239194 --- ParallelTerminationStrategy: PID 28945 died... 17:26:30.259119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28945): Terminated: ok {rc=0} 17:26:30.306010 --- ParallelTerminationStrategy: PID 28946 died... 17:26:30.325522 run iperf3-srv_10.42.42.10(pid=28946): Terminated {rc=256} 17:26:30.372044 --- ParallelTerminationStrategy: PID 28947 died... 17:26:30.391637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28947): Terminated: ok {rc=0} 17:26:30.438653 --- ParallelTerminationStrategy: PID 28948 died... 17:26:30.458218 run iperf3-srv_10.42.42.10(pid=28948): Terminated {rc=256} 17:26:30.504501 --- ParallelTerminationStrategy: PID 28949 died... 17:26:30.523902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28949): Terminated: ok {rc=0} 17:26:30.570739 --- ParallelTerminationStrategy: PID 28950 died... 17:26:30.590203 run iperf3-srv_10.42.42.10(pid=28950): Terminated {rc=256} 17:26:30.636499 --- ParallelTerminationStrategy: PID 28951 died... 17:26:30.655990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28951): Terminated: ok {rc=0} 17:26:30.702429 --- ParallelTerminationStrategy: PID 28952 died... 17:26:30.722163 run iperf3-srv_10.42.42.10(pid=28952): Terminated {rc=256} 17:26:30.768607 --- ParallelTerminationStrategy: PID 28955 died... 17:26:30.788169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28955): Terminated: ok {rc=0} 17:26:30.835049 --- ParallelTerminationStrategy: PID 28958 died... 17:26:30.863869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28958): Terminated: ok {rc=0} 17:26:30.911528 --- ParallelTerminationStrategy: PID 28961 died... 17:26:30.931389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28961): Terminated: ok {rc=0} 17:26:31.021095 bus /gobi_4: Setting Powered False 17:26:32.121843 bus /gobi_4: Setting Powered False 17:26:33.238763 bus /gobi_1: Setting Powered False 17:26:34.336535 bus /gobi_1: Setting Powered False 17:26:35.451635 bus /gobi_0: Setting Powered False 17:26:36.549550 bus /gobi_0: Setting Powered False 17:26:37.664314 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:26:38.767020 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:38.778443 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:26:38.835057 tst ping.py: using LAC 29476 17:26:38.949993 tst ping.py: using RAC 151 17:26:39.065829 tst ping.py: using CellId 29476 17:26:39.180935 tst ping.py: using BVCI 29477 17:26:39.286756 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:39.297711 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:39.308289 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:39.318858 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:39.329450 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:39.339893 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:39.350635 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:39.361190 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:39.475709 tst ping.py:19: start network... 17:26:39.670957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:40.123698 run create_hlr_db(pid=28963): Launched 17:26:40.245315 bus /gobi_6: Setting Powered False 17:26:41.303913 run create_hlr_db(pid=28963): Terminated: ok {rc=0} 17:26:41.733734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28965): Launched 17:26:42.047920 run osmo-hlr_10.42.42.2(pid=28966): Launched 17:26:42.168321 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:42.715192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28968): Launched 17:26:43.029766 run osmo-stp_10.42.42.5(pid=28969): Launched 17:26:43.149746 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:26:43.690443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28971): Launched 17:26:43.811111 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:26:44.077568 run patchelf(pid=28972): Launched 17:26:44.254065 run osmo-stp_10.42.42.5(pid=28969): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28969)] 17:26:44.388007 run osmo-stp_10.42.42.5(pid=28969): stdout: | (launched: 2022-12-10_17:26:42.971975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:44.523436 run osmo-stp_10.42.42.5(pid=28969): stderr: | 20221210172643163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172643163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172643163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172643163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172643164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172643164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172643164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:44.658985 run osmo-stp_10.42.42.5(pid=28969): stdout: | (launched: 2022-12-10_17:26:42.971975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:44.788261 run osmo-stp_10.42.42.5(pid=28969): stderr: | 20221210172643163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172643163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172643163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172643163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172643164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172643164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172643164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:44.941997 run patchelf(pid=28972): Terminating (SIGINT) 17:26:45.118586 run patchelf(pid=28972): Terminated: ok {rc=0} 17:26:45.245716 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28969): Process ended prematurely: osmo-stp_10.42.42.5(pid=28969) [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28969)] [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 17:26:45.255318 tst ping.py:22: Test FAILED (6.5 sec) 17:26:45.283820 run osmo-hlr_10.42.42.2(pid=28966): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28966)] 17:26:45.334057 run osmo-hlr_10.42.42.2(pid=28966): stdout: | (launched: 2022-12-10_17:26:41.990551) 17:26:45.385780 run osmo-hlr_10.42.42.2(pid=28966): stderr: | 20221210172642189 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172642189 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172642189 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172642189 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172642189 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172642189 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172642201 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172642209 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172642210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172642210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:45.438343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28965): Terminating (SIGTERM) 17:26:45.480088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28968): Terminating (SIGTERM) 17:26:45.522052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28971): Terminating (SIGTERM) 17:26:45.564235 --- ParallelTerminationStrategy: PID 28965 died... 17:26:45.584241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28965): Terminated: ok {rc=0} 17:26:45.630939 --- ParallelTerminationStrategy: PID 28968 died... 17:26:45.650486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28968): Terminated: ok {rc=0} 17:26:45.696865 --- ParallelTerminationStrategy: PID 28971 died... 17:26:45.716766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28971): Terminated: ok {rc=0} 17:26:45.804538 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:26:46.904068 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:46.920916 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:26:46.995188 tst ping_idle_ping.py: using LAC 29477 17:26:47.142619 tst ping_idle_ping.py: using RAC 152 17:26:47.283066 tst ping_idle_ping.py: using CellId 29477 17:26:47.401310 tst ping_idle_ping.py: using BVCI 29478 17:26:47.509174 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:47.520075 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:47.530782 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:47.541924 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:47.552907 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:47.564046 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:47.575391 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:47.586464 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:47.703787 tst ping_idle_ping.py:24: start network... 17:26:47.917466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:48.409700 run create_hlr_db(pid=28973): Launched 17:26:48.531710 bus /gobi_6: Setting Powered False 17:26:49.595436 run create_hlr_db(pid=28973): Terminated: ok {rc=0} 17:26:50.020771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28975): Launched 17:26:50.318133 run osmo-hlr_10.42.42.2(pid=28976): Launched 17:26:50.431651 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:50.939689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28978): Launched 17:26:51.234308 run osmo-stp_10.42.42.5(pid=28979): Launched 17:26:51.347593 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:26:51.858125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28981): Launched 17:26:51.971510 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:26:52.220915 run patchelf(pid=28982): Launched 17:26:52.385959 run osmo-stp_10.42.42.5(pid=28979): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28979)] 17:26:52.510981 run osmo-stp_10.42.42.5(pid=28979): stdout: | (launched: 2022-12-10_17:26:51.179889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:52.637676 run osmo-stp_10.42.42.5(pid=28979): stderr: | 20221210172651348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172651348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172651348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172651349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172651352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172651352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172651352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:52.764428 run osmo-stp_10.42.42.5(pid=28979): stdout: | (launched: 2022-12-10_17:26:51.179889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:52.885479 run osmo-stp_10.42.42.5(pid=28979): stderr: | 20221210172651348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172651348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172651348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172651349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172651352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172651352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172651352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:53.028662 run patchelf(pid=28982): Terminating (SIGINT) 17:26:53.194300 run patchelf(pid=28982): Terminated: ok {rc=0} 17:26:53.314131 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28979): Process ended prematurely: osmo-stp_10.42.42.5(pid=28979) [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28979)] [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:26:53.323142 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 17:26:53.349666 run osmo-hlr_10.42.42.2(pid=28976): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28976)] 17:26:53.396769 run osmo-hlr_10.42.42.2(pid=28976): stdout: | (launched: 2022-12-10_17:26:50.262912) 17:26:53.445519 run osmo-hlr_10.42.42.2(pid=28976): stderr: | 20221210172650438 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172650438 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172650438 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172650439 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172650439 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172650439 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172650450 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172650459 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172650459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172650459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:53.494645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28975): Terminating (SIGTERM) 17:26:53.534002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28978): Terminating (SIGTERM) 17:26:53.573389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28981): Terminating (SIGTERM) 17:26:53.613233 --- ParallelTerminationStrategy: PID 28975 died... 17:26:53.632284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28975): Terminated: ok {rc=0} 17:26:53.676057 --- ParallelTerminationStrategy: PID 28978 died... 17:26:53.694645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28978): Terminated: ok {rc=0} 17:26:53.738138 --- ParallelTerminationStrategy: PID 28981 died... 17:26:53.756713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28981): Terminated: ok {rc=0} 17:26:53.842479 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:26:55.132579 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:26:55.138995 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:26:55.159754 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:26:55.197834 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:26:55.285716 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:26:55.306814 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:26:55.344444 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:26:55.935085 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:26:55.982806 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:55.993696 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:26:56.049993 tst cs_paging_gprs_active.py: using LAC 29478 17:26:56.167606 tst cs_paging_gprs_active.py: using RAC 153 17:26:56.286089 tst cs_paging_gprs_active.py: using CellId 29478 17:26:56.416876 tst cs_paging_gprs_active.py: using BVCI 29479 17:26:56.534630 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.546238 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.557378 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.568773 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.580206 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.591379 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.602780 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.613911 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.625251 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:26:56.741521 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:26:56.856037 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:26:57.056851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:57.358931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28987): Launched 17:26:57.622292 run iperf3-srv_10.42.42.10(pid=28988): Launched 17:26:57.737369 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:26:57.937591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:58.237998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28989): Launched 17:26:58.500213 run iperf3-srv_10.42.42.10(pid=29000): Launched 17:26:58.613103 tst cs_paging_gprs_active.py:38: start network... 17:26:58.813060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:59.277837 run create_hlr_db(pid=29001): Launched 17:26:59.403626 bus /gobi_6: Setting Powered False 17:27:00.462982 run create_hlr_db(pid=29001): Terminated: ok {rc=0} 17:27:00.932148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29003): Launched 17:27:01.289714 run osmo-hlr_10.42.42.2(pid=29004): Launched 17:27:01.554854 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:02.249190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29006): Launched 17:27:02.583388 run osmo-stp_10.42.42.5(pid=29007): Launched 17:27:02.707199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:27:03.260632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29009): Launched 17:27:03.384925 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:27:03.655884 run patchelf(pid=29010): Launched 17:27:03.835234 run osmo-stp_10.42.42.5(pid=29007): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29007)] 17:27:03.972189 run osmo-stp_10.42.42.5(pid=29007): stdout: | (launched: 2022-12-10_17:27:02.524623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:04.110442 run osmo-stp_10.42.42.5(pid=29007): stderr: | 20221210172702717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172702718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172702718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172702718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172702719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172702719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172702719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:04.248746 run osmo-stp_10.42.42.5(pid=29007): stdout: | (launched: 2022-12-10_17:27:02.524623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:04.381409 run osmo-stp_10.42.42.5(pid=29007): stderr: | 20221210172702717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172702718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172702718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172702718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172702719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172702719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172702719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:04.538407 run patchelf(pid=29010): Terminating (SIGINT) 17:27:04.717736 run patchelf(pid=29010): Terminated: ok {rc=0} 17:27:04.847096 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29007): Process ended prematurely: osmo-stp_10.42.42.5(pid=29007) [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29007)] [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:27:04.857426 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:27:04.886758 run osmo-hlr_10.42.42.2(pid=29004): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29004)] 17:27:04.937531 run osmo-hlr_10.42.42.2(pid=29004): stdout: | (launched: 2022-12-10_17:27:01.220910) 17:27:04.989754 run osmo-hlr_10.42.42.2(pid=29004): stderr: | 20221210172701461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172701461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172701461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172701461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172701461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172701461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172701480 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172701496 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172701496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172701496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:05.042204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28987): Terminating (SIGTERM) 17:27:05.084439 run iperf3-srv_10.42.42.10(pid=28988): Terminating (SIGTERM) 17:27:05.126646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28989): Terminating (SIGTERM) 17:27:05.168653 run iperf3-srv_10.42.42.10(pid=29000): Terminating (SIGTERM) 17:27:05.210449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29003): Terminating (SIGTERM) 17:27:05.252378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29006): Terminating (SIGTERM) 17:27:05.294403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29009): Terminating (SIGTERM) 17:27:05.336423 --- ParallelTerminationStrategy: PID 28987 died... 17:27:05.356127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28987): Terminated: ok {rc=0} 17:27:05.402463 --- ParallelTerminationStrategy: PID 28988 died... 17:27:05.421676 run iperf3-srv_10.42.42.10(pid=28988): Terminated {rc=256} 17:27:05.467429 --- ParallelTerminationStrategy: PID 28989 died... 17:27:05.486668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28989): Terminated: ok {rc=0} 17:27:05.532605 --- ParallelTerminationStrategy: PID 29000 died... 17:27:05.551874 run iperf3-srv_10.42.42.10(pid=29000): Terminated {rc=256} 17:27:05.598034 --- ParallelTerminationStrategy: PID 29003 died... 17:27:05.617312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29003): Terminated: ok {rc=0} 17:27:05.663257 --- ParallelTerminationStrategy: PID 29006 died... 17:27:05.682558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29006): Terminated: ok {rc=0} 17:27:05.728694 --- ParallelTerminationStrategy: PID 29009 died... 17:27:05.748124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29009): Terminated: ok {rc=0} 17:27:05.835836 bus /gobi_0: Setting Powered False 17:27:06.933594 bus /gobi_0: Setting Powered False 17:27:08.048686 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:27:09.192889 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:09.204516 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:27:09.264598 tst iperf3.py: using LAC 29479 17:27:09.384009 tst iperf3.py: using RAC 154 17:27:09.510331 tst iperf3.py: using CellId 29479 17:27:09.636018 tst iperf3.py: using BVCI 29480 17:27:09.751456 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:09.763191 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:09.774279 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:09.785628 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:09.796765 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:09.808071 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:09.819443 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:09.830664 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:09.842133 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:09.957098 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:27:10.157465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:10.457690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29011): Launched 17:27:10.719285 run iperf3-srv_10.42.42.10(pid=29012): Launched 17:27:10.832339 tst iperf3.py:8: start network... 17:27:11.032621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:11.500053 run create_hlr_db(pid=29013): Launched 17:27:11.623820 bus /gobi_6: Setting Powered False 17:27:12.684527 run create_hlr_db(pid=29013): Terminated: ok {rc=0} 17:27:13.103069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29015): Launched 17:27:13.403992 run osmo-hlr_10.42.42.2(pid=29016): Launched 17:27:13.519384 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:14.036839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29018): Launched 17:27:14.337103 run osmo-stp_10.42.42.5(pid=29019): Launched 17:27:14.451229 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:27:14.967718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29021): Launched 17:27:15.082956 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:27:15.336592 run patchelf(pid=29022): Launched 17:27:15.504190 run osmo-stp_10.42.42.5(pid=29019): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29019)] 17:27:15.630758 run osmo-stp_10.42.42.5(pid=29019): stdout: | (launched: 2022-12-10_17:27:14.280760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:15.758796 run osmo-stp_10.42.42.5(pid=29019): stderr: | 20221210172714452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172714452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172714453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172714453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172714453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172714453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172714453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:15.910632 run osmo-stp_10.42.42.5(pid=29019): stdout: | (launched: 2022-12-10_17:27:14.280760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:16.048242 run osmo-stp_10.42.42.5(pid=29019): stderr: | 20221210172714452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172714452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172714453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172714453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172714453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172714453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172714453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:16.233029 run patchelf(pid=29022): Terminating (SIGINT) 17:27:16.426260 run patchelf(pid=29022): Terminated: ok {rc=0} 17:27:16.561263 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29019): Process ended prematurely: osmo-stp_10.42.42.5(pid=29019) [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29019)] [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 17:27:16.573134 tst iperf3.py:8: Test FAILED (7.4 sec) 17:27:16.607911 run osmo-hlr_10.42.42.2(pid=29016): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29016)] 17:27:16.661064 run osmo-hlr_10.42.42.2(pid=29016): stdout: | (launched: 2022-12-10_17:27:13.348521) 17:27:16.715787 run osmo-hlr_10.42.42.2(pid=29016): stderr: | 20221210172713525 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172713525 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172713525 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172713525 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172713525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172713525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172713537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172713546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172713546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172713546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:16.771099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29011): Terminating (SIGTERM) 17:27:16.817207 run iperf3-srv_10.42.42.10(pid=29012): Terminating (SIGTERM) 17:27:16.864736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29015): Terminating (SIGTERM) 17:27:16.909706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29018): Terminating (SIGTERM) 17:27:16.956282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29021): Terminating (SIGTERM) 17:27:17.004115 --- ParallelTerminationStrategy: PID 29011 died... 17:27:17.024851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29011): Terminated: ok {rc=0} 17:27:17.076422 --- ParallelTerminationStrategy: PID 29012 died... 17:27:17.097262 run iperf3-srv_10.42.42.10(pid=29012): Terminated {rc=256} 17:27:17.146375 --- ParallelTerminationStrategy: PID 29015 died... 17:27:17.166835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29015): Terminated: ok {rc=0} 17:27:17.217146 --- ParallelTerminationStrategy: PID 29018 died... 17:27:17.237899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29018): Terminated: ok {rc=0} 17:27:17.285371 --- ParallelTerminationStrategy: PID 29021 died... 17:27:17.304837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29021): Terminated: ok {rc=0} 17:27:17.394937 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:27:18.540678 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:18.552434 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:27:18.608045 tst iperf3m4.py: using LAC 29480 17:27:18.727052 tst iperf3m4.py: using RAC 155 17:27:18.845296 tst iperf3m4.py: using CellId 29480 17:27:18.962403 tst iperf3m4.py: using BVCI 29481 17:27:19.070663 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.081756 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.092429 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.103169 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.114407 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.125091 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.135958 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.146525 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.157417 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:19.274711 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:19.393368 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:19.509314 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:19.627379 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:27:19.828499 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:20.130257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29023): Launched 17:27:20.394090 run iperf3-srv_10.42.42.10(pid=29024): Launched 17:27:20.506805 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:27:20.706448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:21.006421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29025): Launched 17:27:21.269234 run iperf3-srv_10.42.42.10(pid=29026): Launched 17:27:21.382219 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:27:21.582708 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:21.883158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29027): Launched 17:27:22.146272 run iperf3-srv_10.42.42.10(pid=29028): Launched 17:27:22.261248 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:27:22.461221 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:22.761786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29029): Launched 17:27:23.023261 run iperf3-srv_10.42.42.10(pid=29030): Launched 17:27:23.136091 tst iperf3m4.py:8: start network... 17:27:23.336003 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:23.802083 run create_hlr_db(pid=29031): Launched 17:27:23.925596 bus /gobi_6: Setting Powered False 17:27:24.985182 run create_hlr_db(pid=29031): Terminated: ok {rc=0} 17:27:25.422948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29033): Launched 17:27:25.746460 run osmo-hlr_10.42.42.2(pid=29034): Launched 17:27:25.868860 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:26.424180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29036): Launched 17:27:26.745762 run osmo-stp_10.42.42.5(pid=29037): Launched 17:27:26.869598 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:27:27.422738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29039): Launched 17:27:27.547532 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:27:27.818930 run patchelf(pid=29040): Launched 17:27:27.998734 run osmo-stp_10.42.42.5(pid=29037): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29037)] 17:27:28.134753 run osmo-stp_10.42.42.5(pid=29037): stdout: | (launched: 2022-12-10_17:27:26.686767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:28.271845 run osmo-stp_10.42.42.5(pid=29037): stderr: | 20221210172726878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172726878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172726878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172726878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172726879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172726879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172726879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:28.409872 run osmo-stp_10.42.42.5(pid=29037): stdout: | (launched: 2022-12-10_17:27:26.686767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:28.541581 run osmo-stp_10.42.42.5(pid=29037): stderr: | 20221210172726878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172726878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172726878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172726878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172726879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172726879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172726879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:28.697693 run patchelf(pid=29040): Terminating (SIGINT) 17:27:28.876345 run patchelf(pid=29040): Terminated: ok {rc=0} 17:27:29.005854 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29037): Process ended prematurely: osmo-stp_10.42.42.5(pid=29037) [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29037)] [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:27:29.015927 tst iperf3m4.py:8: Test FAILED (10.5 sec) 17:27:29.045303 run osmo-hlr_10.42.42.2(pid=29034): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29034)] 17:27:29.095668 run osmo-hlr_10.42.42.2(pid=29034): stdout: | (launched: 2022-12-10_17:27:25.686926) 17:27:29.147688 run osmo-hlr_10.42.42.2(pid=29034): stderr: | 20221210172725883 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172725884 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172725884 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172725884 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172725884 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172725884 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172725896 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172725904 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172725905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172725905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:29.199924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29023): Terminating (SIGTERM) 17:27:29.241981 run iperf3-srv_10.42.42.10(pid=29024): Terminating (SIGTERM) 17:27:29.284218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29025): Terminating (SIGTERM) 17:27:29.326387 run iperf3-srv_10.42.42.10(pid=29026): Terminating (SIGTERM) 17:27:29.368544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29027): Terminating (SIGTERM) 17:27:29.410814 run iperf3-srv_10.42.42.10(pid=29028): Terminating (SIGTERM) 17:27:29.452670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29029): Terminating (SIGTERM) 17:27:29.494817 run iperf3-srv_10.42.42.10(pid=29030): Terminating (SIGTERM) 17:27:29.536673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29033): Terminating (SIGTERM) 17:27:29.578754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29036): Terminating (SIGTERM) 17:27:29.620895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29039): Terminating (SIGTERM) 17:27:29.663190 --- ParallelTerminationStrategy: PID 29023 died... 17:27:29.683092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29023): Terminated: ok {rc=0} 17:27:29.729920 --- ParallelTerminationStrategy: PID 29024 died... 17:27:29.749364 run iperf3-srv_10.42.42.10(pid=29024): Terminated {rc=256} 17:27:29.795691 --- ParallelTerminationStrategy: PID 29025 died... 17:27:29.815256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29025): Terminated: ok {rc=0} 17:27:29.861844 --- ParallelTerminationStrategy: PID 29026 died... 17:27:29.881298 run iperf3-srv_10.42.42.10(pid=29026): Terminated {rc=256} 17:27:29.927858 --- ParallelTerminationStrategy: PID 29027 died... 17:27:29.947385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29027): Terminated: ok {rc=0} 17:27:29.993976 --- ParallelTerminationStrategy: PID 29028 died... 17:27:30.013424 run iperf3-srv_10.42.42.10(pid=29028): Terminated {rc=256} 17:27:30.060019 --- ParallelTerminationStrategy: PID 29029 died... 17:27:30.079479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29029): Terminated: ok {rc=0} 17:27:30.126236 --- ParallelTerminationStrategy: PID 29030 died... 17:27:30.145788 run iperf3-srv_10.42.42.10(pid=29030): Terminated {rc=256} 17:27:30.192100 --- ParallelTerminationStrategy: PID 29033 died... 17:27:30.211728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29033): Terminated: ok {rc=0} 17:27:30.258702 --- ParallelTerminationStrategy: PID 29036 died... 17:27:30.278638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29036): Terminated: ok {rc=0} 17:27:30.325386 --- ParallelTerminationStrategy: PID 29039 died... 17:27:30.344810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29039): Terminated: ok {rc=0} 17:27:30.432569 bus /gobi_4: Setting Powered False 17:27:31.539557 bus /gobi_4: Setting Powered False 17:27:32.670218 bus /gobi_1: Setting Powered False 17:27:33.769407 bus /gobi_1: Setting Powered False 17:27:34.888324 bus /gobi_0: Setting Powered False 17:27:35.987811 bus /gobi_0: Setting Powered False 17:27:37.106942 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:27:38.210366 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:38.222382 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:27:38.282460 tst ping.py: using LAC 29481 17:27:38.406616 tst ping.py: using RAC 156 17:27:38.530013 tst ping.py: using CellId 29481 17:27:38.653225 tst ping.py: using BVCI 29482 17:27:38.768476 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:38.779956 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:38.791114 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:38.802681 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:38.814044 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:38.825303 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:38.836727 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:38.848112 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:38.967102 tst ping.py:19: start network... 17:27:39.178621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:39.664730 run create_hlr_db(pid=29041): Launched 17:27:39.784600 bus /gobi_6: Setting Powered False 17:27:40.843197 run create_hlr_db(pid=29041): Terminated: ok {rc=0} 17:27:41.284197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29043): Launched 17:27:41.599780 run osmo-hlr_10.42.42.2(pid=29044): Launched 17:27:41.723010 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:42.267989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29046): Launched 17:27:42.584263 run osmo-stp_10.42.42.5(pid=29047): Launched 17:27:42.705055 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:27:43.248567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29049): Launched 17:27:43.370501 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:27:43.636591 run patchelf(pid=29050): Launched 17:27:43.812510 run osmo-stp_10.42.42.5(pid=29047): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29047)] 17:27:43.947079 run osmo-stp_10.42.42.5(pid=29047): stdout: | (launched: 2022-12-10_17:27:42.526503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:44.082914 run osmo-stp_10.42.42.5(pid=29047): stderr: | 20221210172742719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172742719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172742719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172742720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172742720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172742720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172742720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:44.218669 run osmo-stp_10.42.42.5(pid=29047): stdout: | (launched: 2022-12-10_17:27:42.526503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:44.348538 run osmo-stp_10.42.42.5(pid=29047): stderr: | 20221210172742719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172742719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172742719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172742720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172742720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172742720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172742720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:44.502485 run patchelf(pid=29050): Terminating (SIGINT) 17:27:44.678567 run patchelf(pid=29050): Terminated: ok {rc=0} 17:27:44.805405 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29047): Process ended prematurely: osmo-stp_10.42.42.5(pid=29047) [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29047)] [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 17:27:44.814897 tst ping.py:22: Test FAILED (6.6 sec) 17:27:44.843453 run osmo-hlr_10.42.42.2(pid=29044): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29044)] 17:27:44.894446 run osmo-hlr_10.42.42.2(pid=29044): stdout: | (launched: 2022-12-10_17:27:41.542116) 17:27:44.947056 run osmo-hlr_10.42.42.2(pid=29044): stderr: | 20221210172741742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172741742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172741742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172741742 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172741742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172741743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172741755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172741765 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172741765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172741765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:44.999793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29043): Terminating (SIGTERM) 17:27:45.042096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29046): Terminating (SIGTERM) 17:27:45.084369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29049): Terminating (SIGTERM) 17:27:45.126903 --- ParallelTerminationStrategy: PID 29043 died... 17:27:45.146846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29043): Terminated: ok {rc=0} 17:27:45.193724 --- ParallelTerminationStrategy: PID 29046 died... 17:27:45.213367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29046): Terminated: ok {rc=0} 17:27:45.259918 --- ParallelTerminationStrategy: PID 29049 died... 17:27:45.279509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29049): Terminated: ok {rc=0} 17:27:45.368232 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:27:46.459281 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:46.472222 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:27:46.537394 tst ping_idle_ping.py: using LAC 29482 17:27:46.691175 tst ping_idle_ping.py: using RAC 157 17:27:46.817368 tst ping_idle_ping.py: using CellId 29482 17:27:46.936050 tst ping_idle_ping.py: using BVCI 29483 17:27:47.063243 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.075721 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.088006 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.102068 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.114282 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.127693 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.141277 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.155613 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:47.278008 tst ping_idle_ping.py:24: start network... 17:27:47.490641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:47.986203 run create_hlr_db(pid=29051): Launched 17:27:48.108393 bus /gobi_6: Setting Powered False 17:27:49.170992 run create_hlr_db(pid=29051): Terminated: ok {rc=0} 17:27:49.609293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29053): Launched 17:27:49.924747 run osmo-hlr_10.42.42.2(pid=29054): Launched 17:27:50.048312 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:50.588879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29056): Launched 17:27:50.904621 run osmo-stp_10.42.42.5(pid=29057): Launched 17:27:51.026133 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:27:51.570292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29059): Launched 17:27:51.691314 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:27:51.957728 run patchelf(pid=29060): Launched 17:27:52.134296 run osmo-stp_10.42.42.5(pid=29057): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29057)] 17:27:52.268268 run osmo-stp_10.42.42.5(pid=29057): stdout: | (launched: 2022-12-10_17:27:50.846535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:52.403544 run osmo-stp_10.42.42.5(pid=29057): stderr: | 20221210172751038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172751038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172751038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172751038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172751039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172751039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172751039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:52.539284 run osmo-stp_10.42.42.5(pid=29057): stdout: | (launched: 2022-12-10_17:27:50.846535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:52.668729 run osmo-stp_10.42.42.5(pid=29057): stderr: | 20221210172751038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172751038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172751038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172751038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172751039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172751039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172751039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:52.822160 run patchelf(pid=29060): Terminating (SIGINT) 17:27:52.998858 run patchelf(pid=29060): Terminated: ok {rc=0} 17:27:53.126164 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29057): Process ended prematurely: osmo-stp_10.42.42.5(pid=29057) [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29057)] [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:27:53.135621 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:27:53.163978 run osmo-hlr_10.42.42.2(pid=29054): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29054)] 17:27:53.213808 run osmo-hlr_10.42.42.2(pid=29054): stdout: | (launched: 2022-12-10_17:27:49.867291) 17:27:53.265463 run osmo-hlr_10.42.42.2(pid=29054): stderr: | 20221210172750065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172750065 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172750065 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172750065 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172750065 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172750065 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172750077 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172750086 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172750086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172750086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:53.317597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29053): Terminating (SIGTERM) 17:27:53.359430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29056): Terminating (SIGTERM) 17:27:53.401357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29059): Terminating (SIGTERM) 17:27:53.443248 --- ParallelTerminationStrategy: PID 29053 died... 17:27:53.463012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29053): Terminated: ok {rc=0} 17:27:53.509193 --- ParallelTerminationStrategy: PID 29056 died... 17:27:53.528400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29056): Terminated: ok {rc=0} 17:27:53.574251 --- ParallelTerminationStrategy: PID 29059 died... 17:27:53.593517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29059): Terminated: ok {rc=0} 17:27:53.681104 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:27:54.978574 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:27:54.987353 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:27:55.009742 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:27:55.045170 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:27:55.097616 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:27:55.118533 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:27:55.153457 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:27:55.714492 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2377 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:27:55.719734 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:27:55.731213 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:27:55.787371 tst switch_tch_pdch.py: using LAC 29483 17:27:55.908723 tst switch_tch_pdch.py: using RAC 158 17:27:56.030246 tst switch_tch_pdch.py: using CellId 29483 17:27:56.152502 tst switch_tch_pdch.py: using BVCI 29484 17:27:56.265861 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:27:56.277476 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:27:56.288715 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:27:56.300245 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:27:56.311712 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:27:56.323337 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:27:56.335148 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:27:56.346679 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:27:56.461893 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:27:56.576630 tst switch_tch_pdch.py:51: start network... 17:27:56.774081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:57.231448 run create_hlr_db(pid=29064): Launched 17:27:57.354931 bus /gobi_6: Setting Powered False 17:27:58.420139 run create_hlr_db(pid=29064): Terminated: ok {rc=0} 17:27:58.857362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29066): Launched 17:27:59.171968 run osmo-hlr_10.42.42.2(pid=29067): Launched 17:27:59.292158 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:59.837434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29069): Launched 17:28:00.153361 run osmo-stp_10.42.42.5(pid=29070): Launched 17:28:00.274038 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:28:00.816535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29072): Launched 17:28:00.946408 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:28:01.216385 run patchelf(pid=29073): Launched 17:28:01.408036 run osmo-stp_10.42.42.5(pid=29070): ERR: Terminated: ERROR {rc=1} [trial-2377↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29070)] 17:28:01.544494 run osmo-stp_10.42.42.5(pid=29070): stdout: | (launched: 2022-12-10_17:28:00.095341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:01.682308 run osmo-stp_10.42.42.5(pid=29070): stderr: | 20221210172800285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172800285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172800286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172800286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172800286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172800286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172800286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:01.820360 run osmo-stp_10.42.42.5(pid=29070): stdout: | (launched: 2022-12-10_17:28:00.095341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:01.952909 run osmo-stp_10.42.42.5(pid=29070): stderr: | 20221210172800285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172800285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172800286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172800286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172800286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172800286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172800286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:02.109605 run patchelf(pid=29073): Terminating (SIGINT) 17:28:02.283075 run patchelf(pid=29073): Terminated: ok {rc=0} 17:28:02.403533 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29070): Process ended prematurely: osmo-stp_10.42.42.5(pid=29070) [trial-2377↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29070)] [trial-2377↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:28:02.412578 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 17:28:02.440149 run osmo-hlr_10.42.42.2(pid=29067): ERR: Terminated: ERROR {rc=237} [trial-2377↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29067)] 17:28:02.488776 run osmo-hlr_10.42.42.2(pid=29067): stdout: | (launched: 2022-12-10_17:27:59.114254) 17:28:02.538885 run osmo-hlr_10.42.42.2(pid=29067): stderr: | 20221210172759312 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172759312 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172759312 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172759312 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172759312 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172759312 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172759324 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172759333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172759333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172759333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:02.589457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29066): Terminating (SIGTERM) 17:28:02.629832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29069): Terminating (SIGTERM) 17:28:02.670042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29072): Terminating (SIGTERM) 17:28:02.710391 --- ParallelTerminationStrategy: PID 29066 died... 17:28:02.729588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29066): Terminated: ok {rc=0} 17:28:02.774358 --- ParallelTerminationStrategy: PID 29069 died... 17:28:02.792804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29069): Terminated: ok {rc=0} 17:28:02.837672 --- ParallelTerminationStrategy: PID 29072 died... 17:28:02.855993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29072): Terminated: ok {rc=0} 17:28:02.941093 bus /gobi_0: Setting Powered False 17:28:04.040593 bus /gobi_0: Setting Powered False 17:28:05.155337 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:28:06.396356 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:06.402645 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:28:06.424117 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:28:06.459823 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:28:06.514269 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:28:06.535272 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:28:06.570501 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:28:07.126102 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2377 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:28:07.131338 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:07.142567 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:28:07.199966 tst switch_tch_pdch.py: using LAC 29484 17:28:07.324326 tst switch_tch_pdch.py: using RAC 159 17:28:07.446414 tst switch_tch_pdch.py: using CellId 29484 17:28:07.568660 tst switch_tch_pdch.py: using BVCI 29485 17:28:07.682117 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:07.693499 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:07.704527 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:07.715842 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:07.727061 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:07.738346 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:07.749971 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:07.761368 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:28:07.877678 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:28:07.994078 tst switch_tch_pdch.py:51: start network... 17:28:08.193216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:08.625421 run create_hlr_db(pid=29077): Launched 17:28:08.746825 bus /gobi_6: Setting Powered False 17:28:09.805655 run create_hlr_db(pid=29077): Terminated: ok {rc=0} 17:28:10.210204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29079): Launched 17:28:10.524496 run osmo-hlr_10.42.42.2(pid=29080): Launched 17:28:10.645463 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:11.160922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29082): Launched 17:28:11.474290 run osmo-stp_10.42.42.5(pid=29083): Launched 17:28:11.596129 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:28:12.114651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29085): Launched 17:28:12.235272 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:28:12.499434 run patchelf(pid=29086): Launched 17:28:12.676342 run osmo-stp_10.42.42.5(pid=29083): ERR: Terminated: ERROR {rc=1} [trial-2377↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29083)] 17:28:12.809593 run osmo-stp_10.42.42.5(pid=29083): stdout: | (launched: 2022-12-10_17:28:11.417126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:12.943830 run osmo-stp_10.42.42.5(pid=29083): stderr: | 20221210172811626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172811626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172811626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172811626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172811627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172811627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172811627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:13.079219 run osmo-stp_10.42.42.5(pid=29083): stdout: | (launched: 2022-12-10_17:28:11.417126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:13.207863 run osmo-stp_10.42.42.5(pid=29083): stderr: | 20221210172811626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172811626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172811626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172811626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172811627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172811627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172811627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:13.361032 run patchelf(pid=29086): Terminating (SIGINT) 17:28:13.535895 run patchelf(pid=29086): Terminated: ok {rc=0} 17:28:13.662410 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29083): Process ended prematurely: osmo-stp_10.42.42.5(pid=29083) [trial-2377↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29083)] [trial-2377↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:28:13.671931 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 17:28:13.699982 run osmo-hlr_10.42.42.2(pid=29080): ERR: Terminated: ERROR {rc=237} [trial-2377↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29080)] 17:28:13.750061 run osmo-hlr_10.42.42.2(pid=29080): stdout: | (launched: 2022-12-10_17:28:10.466775) 17:28:13.801811 run osmo-hlr_10.42.42.2(pid=29080): stderr: | 20221210172810667 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172810667 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172810667 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172810667 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172810667 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172810667 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172810679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172810689 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172810689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172810689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:13.853891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29079): Terminating (SIGTERM) 17:28:13.895772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29082): Terminating (SIGTERM) 17:28:13.937572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29085): Terminating (SIGTERM) 17:28:13.979942 --- ParallelTerminationStrategy: PID 29079 died... 17:28:13.999888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29079): Terminated: ok {rc=0} 17:28:14.046473 --- ParallelTerminationStrategy: PID 29082 died... 17:28:14.065757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29082): Terminated: ok {rc=0} 17:28:14.111903 --- ParallelTerminationStrategy: PID 29085 died... 17:28:14.131128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29085): Terminated: ok {rc=0} 17:28:14.218493 bus /gobi_0: Setting Powered False 17:28:15.317077 bus /gobi_0: Setting Powered False 17:28:16.434815 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 nitb_sms:trx-b200 --------------------------------------------------------------------- 17:28:17.665818 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:17.669488 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 17:28:17.703381 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 17:28:17.710029 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 17:28:17.761936 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 17:28:17.795027 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 17:28:17.801683 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 17:28:18.341921 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 17:28:18.349193 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 17:28:18.360696 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 17:28:18.416487 tst mo_mt_sms.py: using LAC 29485 17:28:18.539078 tst mo_mt_sms.py: using RAC 160 17:28:18.660201 tst mo_mt_sms.py: using CellId 29485 17:28:18.781578 tst mo_mt_sms.py: using BVCI 29486 17:28:18.894961 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 17:28:19.007999 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 17:28:19.119498 tst mo_mt_sms.py:9: start nitb and bts... 17:28:19.316128 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:28:19.916778 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29090): Launched 17:28:20.212562 run osmo-nitb_10.42.42.2(pid=29091): Launched 17:28:20.375836 run osmo-nitb_10.42.42.2(pid=29091): ERR: Terminated: ERROR {rc=2} [trial-2377↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29091)] 17:28:20.508516 run osmo-nitb_10.42.42.2(pid=29091): stdout: | (launched: 2022-12-10_17:28:20.158111) 17:28:20.642246 run osmo-nitb_10.42.42.2(pid=29091): stderr: | (launched: 2022-12-10_17:28:20.201843) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:28:20.776045 run osmo-nitb_10.42.42.2(pid=29091): stdout: | (launched: 2022-12-10_17:28:20.158111) 17:28:20.904222 run osmo-nitb_10.42.42.2(pid=29091): stderr: | (launched: 2022-12-10_17:28:20.201843) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f2803594268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29091): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29091) [trial-2377↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29091)] 17:28:21.323500 tst osmo-nitb_10.42.42.2(pid=29091): stdout: | (launched: 2022-12-10_17:28:20.158111) 17:28:21.440545 tst osmo-nitb_10.42.42.2(pid=29091): stderr: | (launched: 2022-12-10_17:28:20.201843) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:28:21.580418 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=29091): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29091) [trial-2377↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29091)] [trial-2377↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 17:28:21.588790 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 17:28:21.595288 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29090): Terminating (SIGTERM) 17:28:21.803357 --- ParallelTerminationStrategy: PID 29090 died... 17:28:21.823977 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29090): Terminated: ok {rc=0} 17:28:21.909144 bus /sierra_3: Setting Powered False 17:28:23.009101 bus /sierra_3: Setting Powered False 17:28:24.124783 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 sms:trx-b200 --------------------------------------------------------------------- 17:28:25.321179 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:25.325380 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 17:28:25.358369 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 17:28:25.384647 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 17:28:25.437911 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 17:28:25.470760 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 17:28:25.496645 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 17:28:26.041995 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 17:28:26.047247 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:26.057911 tst sms:trx-b200: Using 1 x bts (candidates: 1) 17:28:26.105142 tst mo_mt_sms.py: using LAC 29486 17:28:26.219703 tst mo_mt_sms.py: using RAC 161 17:28:26.343133 tst mo_mt_sms.py: using CellId 29486 17:28:26.467890 tst mo_mt_sms.py: using BVCI 29487 17:28:26.583092 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:26.594167 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:26.605277 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:26.616370 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:26.627344 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:26.638447 tst sms:trx-b200: Using 1 x modem (candidates: 2) 17:28:26.755068 tst sms:trx-b200: Using 1 x modem (candidates: 2) 17:28:26.869128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:27.326811 run create_hlr_db(pid=29095): Launched 17:28:27.450518 bus /sierra_2: Setting Powered False 17:28:28.509733 run create_hlr_db(pid=29095): Terminated: ok {rc=0} 17:28:28.941365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29097): Launched 17:28:29.257369 run osmo-hlr_10.42.42.2(pid=29098): Launched 17:28:29.378497 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:29.923389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29100): Launched 17:28:30.239241 run osmo-stp_10.42.42.5(pid=29101): Launched 17:28:30.359535 run osmo-msc_10.42.42.6: Starting osmo-msc 17:28:30.953770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29103): Launched 17:28:31.293267 run osmo-msc_10.42.42.6(pid=29104): Launched 17:28:31.602755 run osmo-stp_10.42.42.5(pid=29101): ERR: Terminated: ERROR {rc=1} [trial-2377↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29101)] 17:28:31.797817 run osmo-stp_10.42.42.5(pid=29101): stdout: | (launched: 2022-12-10_17:28:30.181262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:32.030527 run osmo-stp_10.42.42.5(pid=29101): stderr: | 20221210172830373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172830373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172830373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172830374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172830374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172830374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172830374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:32.199867 run osmo-stp_10.42.42.5(pid=29101): stdout: | (launched: 2022-12-10_17:28:30.181262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:32.324704 run osmo-stp_10.42.42.5(pid=29101): stderr: | 20221210172830373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172830373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172830373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172830374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172830374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172830374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172830374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:32.474467 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29101): Process ended prematurely: osmo-stp_10.42.42.5(pid=29101) [trial-2377↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29101)] [trial-2377↪sms:trx-b200↪mo_mt_sms.py:16] 17:28:32.483557 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 17:28:32.511706 run osmo-hlr_10.42.42.2(pid=29098): ERR: Terminated: ERROR {rc=237} [trial-2377↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29098)] 17:28:32.562617 run osmo-hlr_10.42.42.2(pid=29098): stdout: | (launched: 2022-12-10_17:28:29.199413) 17:28:32.615211 run osmo-hlr_10.42.42.2(pid=29098): stderr: | 20221210172829398 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172829398 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172829398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172829398 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172829398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172829398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172829411 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172829422 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172829422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172829422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:32.688098 run osmo-msc_10.42.42.6(pid=29104): ERR: Terminated: ERROR {rc=2} [trial-2377↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29104)] 17:28:32.738778 run osmo-msc_10.42.42.6(pid=29104): stdout: | (launched: 2022-12-10_17:28:31.235631) 17:28:32.791108 run osmo-msc_10.42.42.6(pid=29104): stderr: | 20221210172831795 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172831795 DLGLOBAL DEBUG validating counter group 0x7fe87c4d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172831795 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172831795 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172831796 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172831796 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172831814 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172831814 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172831815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172831815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:28:32.843916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29097): Terminating (SIGTERM) 17:28:32.886237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29100): Terminating (SIGTERM) 17:28:32.928650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29103): Terminating (SIGTERM) 17:28:32.972133 --- ParallelTerminationStrategy: PID 29097 died... 17:28:32.992348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29097): Terminated: ok {rc=0} 17:28:33.039415 --- ParallelTerminationStrategy: PID 29100 died... 17:28:33.059129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29100): Terminated: ok {rc=0} 17:28:33.106140 --- ParallelTerminationStrategy: PID 29103 died... 17:28:33.125740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29103): Terminated: ok {rc=0} 17:28:33.215677 bus /sierra_3: Setting Powered False 17:28:34.313499 bus /sierra_3: Setting Powered False 17:28:35.429345 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 nitb_ussd:trx-b200 --------------------------------------------------------------------- 17:28:36.652386 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:36.655991 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 17:28:36.688784 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 17:28:36.695427 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 17:28:36.730515 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 17:28:36.762910 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 17:28:36.769460 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 17:28:37.289229 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2377 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 17:28:37.294282 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 17:28:37.305114 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 17:28:37.352467 tst assert_extension.py: using LAC 29487 17:28:37.467571 tst assert_extension.py: using RAC 162 17:28:37.583878 tst assert_extension.py: using CellId 29487 17:28:37.699361 tst assert_extension.py: using BVCI 29488 17:28:37.806946 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 17:28:37.923472 tst assert_extension.py:10: start nitb and bts... 17:28:38.135802 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:28:38.777744 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29109): Launched 17:28:39.092091 run osmo-nitb_10.42.42.2(pid=29110): Launched 17:28:39.265918 run osmo-nitb_10.42.42.2(pid=29110): ERR: Terminated: ERROR {rc=2} [trial-2377↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29110)] 17:28:39.407187 run osmo-nitb_10.42.42.2(pid=29110): stdout: | (launched: 2022-12-10_17:28:39.034243) 17:28:39.550010 run osmo-nitb_10.42.42.2(pid=29110): stderr: | (launched: 2022-12-10_17:28:39.080829) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:28:39.692666 run osmo-nitb_10.42.42.2(pid=29110): stdout: | (launched: 2022-12-10_17:28:39.034243) 17:28:39.829683 run osmo-nitb_10.42.42.2(pid=29110): stderr: | (launched: 2022-12-10_17:28:39.080829) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f2803594268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29110): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29110) [trial-2377↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29110)] 17:28:40.211151 tst osmo-nitb_10.42.42.2(pid=29110): stdout: | (launched: 2022-12-10_17:28:39.034243) 17:28:40.337708 tst osmo-nitb_10.42.42.2(pid=29110): stderr: | (launched: 2022-12-10_17:28:39.080829) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:28:40.487552 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29110): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29110) [trial-2377↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29110)] [trial-2377↪nitb_ussd:trx-b200↪assert_extension.py:12] 17:28:40.496458 tst assert_extension.py:12: Test FAILED (3.2 sec) 17:28:40.503509 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29109): Terminating (SIGTERM) 17:28:40.716203 --- ParallelTerminationStrategy: PID 29109 died... 17:28:40.737572 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29109): Terminated: ok {rc=0} 17:28:40.826030 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 ussd:trx-b200 --------------------------------------------------------------------- 17:28:42.003965 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:42.008589 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 17:28:42.044659 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 17:28:42.072481 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 17:28:42.110036 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 17:28:42.143887 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 17:28:42.171273 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 17:28:42.695388 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2377 ussd:trx-b200 assert_extension.py ---------------------------------------------- 17:28:42.700499 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:42.711135 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 17:28:42.760785 tst assert_extension.py: using LAC 29488 17:28:42.878551 tst assert_extension.py: using RAC 163 17:28:42.996074 tst assert_extension.py: using CellId 29488 17:28:43.112912 tst assert_extension.py: using BVCI 29489 17:28:43.219073 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:43.229644 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:43.239974 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:43.250925 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:43.261805 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:43.272622 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 17:28:43.389951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:43.876561 run create_hlr_db(pid=29114): Launched 17:28:43.997425 bus /sierra_2: Setting Powered False 17:28:45.059653 run create_hlr_db(pid=29114): Terminated: ok {rc=0} 17:28:45.481230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29116): Launched 17:28:45.777383 run osmo-hlr_10.42.42.2(pid=29117): Launched 17:28:45.959722 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:46.588035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29119): Launched 17:28:46.915241 run osmo-stp_10.42.42.5(pid=29120): Launched 17:28:47.070458 run osmo-msc_10.42.42.6: Starting osmo-msc 17:28:47.793746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29122): Launched 17:28:48.110670 run osmo-msc_10.42.42.6(pid=29123): Launched 17:28:48.288770 run osmo-stp_10.42.42.5(pid=29120): ERR: Terminated: ERROR {rc=1} [trial-2377↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29120)] 17:28:48.422997 run osmo-stp_10.42.42.5(pid=29120): stdout: | (launched: 2022-12-10_17:28:46.859749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:48.557246 run osmo-stp_10.42.42.5(pid=29120): stderr: | 20221210172847200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172847201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172847202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172847204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172847205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172847206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172847206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:48.690906 run osmo-stp_10.42.42.5(pid=29120): stdout: | (launched: 2022-12-10_17:28:46.859749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:48.816712 run osmo-stp_10.42.42.5(pid=29120): stderr: | 20221210172847200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172847201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172847202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172847204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172847205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172847206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172847206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:48.967796 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29120): Process ended prematurely: osmo-stp_10.42.42.5(pid=29120) [trial-2377↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29120)] [trial-2377↪ussd:trx-b200↪assert_extension.py:17] 17:28:48.977000 tst assert_extension.py:17: Test FAILED (6.3 sec) 17:28:49.006172 run osmo-hlr_10.42.42.2(pid=29117): ERR: Terminated: ERROR {rc=237} [trial-2377↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29117)] 17:28:49.058070 run osmo-hlr_10.42.42.2(pid=29117): stdout: | (launched: 2022-12-10_17:28:45.722975) 17:28:49.111124 run osmo-hlr_10.42.42.2(pid=29117): stderr: | 20221210172845932 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172845933 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172845933 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172845933 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172845933 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172845933 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172845951 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172845967 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172845967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172845967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:49.185011 run osmo-msc_10.42.42.6(pid=29123): ERR: Terminated: ERROR {rc=2} [trial-2377↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29123)] 17:28:49.236336 run osmo-msc_10.42.42.6(pid=29123): stdout: | (launched: 2022-12-10_17:28:48.052776) 17:28:49.289628 run osmo-msc_10.42.42.6(pid=29123): stderr: | 20221210172848376 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172848376 DLGLOBAL DEBUG validating counter group 0x7f96054bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172848376 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172848376 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172848377 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172848377 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172848378 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172848379 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172848379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172848379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:28:49.343476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29116): Terminating (SIGTERM) 17:28:49.386684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29119): Terminating (SIGTERM) 17:28:49.429832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29122): Terminating (SIGTERM) 17:28:49.473175 --- ParallelTerminationStrategy: PID 29116 died... 17:28:49.493501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29116): Terminated: ok {rc=0} 17:28:49.541832 --- ParallelTerminationStrategy: PID 29119 died... 17:28:49.561645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29119): Terminated: ok {rc=0} 17:28:49.609954 --- ParallelTerminationStrategy: PID 29122 died... 17:28:49.629824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29122): Terminated: ok {rc=0} 17:28:49.719898 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:28:50.941202 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:50.949963 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:28:50.986716 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:28:51.014623 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:28:51.067364 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:28:51.100258 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:28:51.126347 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:28:51.677529 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:28:51.726056 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:28:51.737350 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:28:51.809811 tst mo_mt_call.py: using LAC 29489 17:28:51.926786 tst mo_mt_call.py: using RAC 164 17:28:52.044209 tst mo_mt_call.py: using CellId 29489 17:28:52.160474 tst mo_mt_call.py: using BVCI 29490 17:28:52.269675 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:28:52.280607 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:28:52.291398 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:28:52.302353 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:28:52.313219 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:28:52.323902 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:28:52.440526 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:28:52.560070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:53.056570 run create_hlr_db(pid=29128): Launched 17:28:53.181526 bus /sierra_2: Setting Powered False 17:28:54.244674 run create_hlr_db(pid=29128): Terminated: ok {rc=0} 17:28:54.674500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29130): Launched 17:28:54.975110 run osmo-hlr_10.42.42.2(pid=29131): Launched 17:28:55.089836 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:55.620910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29133): Launched 17:28:55.920804 run osmo-stp_10.42.42.5(pid=29134): Launched 17:28:56.034852 run osmo-msc_10.42.42.6: Starting osmo-msc 17:28:56.577620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29136): Launched 17:28:56.878532 run osmo-msc_10.42.42.6(pid=29137): Launched 17:28:57.046411 run osmo-stp_10.42.42.5(pid=29134): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29134)] 17:28:57.172665 run osmo-stp_10.42.42.5(pid=29134): stdout: | (launched: 2022-12-10_17:28:55.865990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:57.299279 run osmo-stp_10.42.42.5(pid=29134): stderr: | 20221210172856038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172856038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172856038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172856039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172856039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172856039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172856039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:57.424085 run osmo-stp_10.42.42.5(pid=29134): stdout: | (launched: 2022-12-10_17:28:55.865990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:57.543376 run osmo-stp_10.42.42.5(pid=29134): stderr: | 20221210172856038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172856038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172856038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172856039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172856039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172856039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172856039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:57.686203 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29134): Process ended prematurely: osmo-stp_10.42.42.5(pid=29134) [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29134)] [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:28:57.695125 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:28:57.721289 run osmo-hlr_10.42.42.2(pid=29131): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29131)] 17:28:57.768755 run osmo-hlr_10.42.42.2(pid=29131): stdout: | (launched: 2022-12-10_17:28:54.919243) 17:28:57.817824 run osmo-hlr_10.42.42.2(pid=29131): stderr: | 20221210172855095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172855095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172855095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172855095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172855095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172855095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172855108 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172855118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172855119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172855119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:57.886360 run osmo-msc_10.42.42.6(pid=29137): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29137)] 17:28:57.933833 run osmo-msc_10.42.42.6(pid=29137): stdout: | (launched: 2022-12-10_17:28:56.822590) 17:28:57.982646 run osmo-msc_10.42.42.6(pid=29137): stderr: | 20221210172857094 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172857094 DLGLOBAL DEBUG validating counter group 0x7f575c8dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172857094 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172857095 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172857095 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172857095 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172857097 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172857097 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172857097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172857097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:28:58.031908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29130): Terminating (SIGTERM) 17:28:58.071211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29133): Terminating (SIGTERM) 17:28:58.110477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29136): Terminating (SIGTERM) 17:28:58.150088 --- ParallelTerminationStrategy: PID 29130 died... 17:28:58.169086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29130): Terminated: ok {rc=0} 17:28:58.212731 --- ParallelTerminationStrategy: PID 29133 died... 17:28:58.231197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29133): Terminated: ok {rc=0} 17:28:58.274681 --- ParallelTerminationStrategy: PID 29136 died... 17:28:58.293539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29136): Terminated: ok {rc=0} 17:28:58.377311 bus /sierra_3: Setting Powered False 17:28:59.473409 bus /sierra_3: Setting Powered False 17:29:00.588482 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:29:01.770287 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:01.783592 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:29:01.860324 tst mo_mt_call_osmux.py: using LAC 29490 17:29:02.031987 tst mo_mt_call_osmux.py: using RAC 165 17:29:02.197216 tst mo_mt_call_osmux.py: using CellId 29490 17:29:02.323651 tst mo_mt_call_osmux.py: using BVCI 29491 17:29:02.432386 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:02.443678 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:02.454725 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:02.465952 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:02.477335 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:02.488452 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:29:02.605714 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:29:02.720894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:03.185206 run create_hlr_db(pid=29139): Launched 17:29:03.311608 bus /sierra_2: Setting Powered False 17:29:04.375272 run create_hlr_db(pid=29139): Terminated: ok {rc=0} 17:29:04.819227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29141): Launched 17:29:05.141699 run osmo-hlr_10.42.42.2(pid=29142): Launched 17:29:05.264353 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:05.814151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29144): Launched 17:29:06.135542 run osmo-stp_10.42.42.5(pid=29145): Launched 17:29:06.258633 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:06.838393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29147): Launched 17:29:07.159673 run osmo-msc_10.42.42.6(pid=29148): Launched 17:29:07.338757 run osmo-stp_10.42.42.5(pid=29145): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29145)] 17:29:07.473253 run osmo-stp_10.42.42.5(pid=29145): stdout: | (launched: 2022-12-10_17:29:06.077096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:07.609389 run osmo-stp_10.42.42.5(pid=29145): stderr: | 20221210172906267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172906267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172906267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172906268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172906270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172906270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172906270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:07.744266 run osmo-stp_10.42.42.5(pid=29145): stdout: | (launched: 2022-12-10_17:29:06.077096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:07.871654 run osmo-stp_10.42.42.5(pid=29145): stderr: | 20221210172906267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172906267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172906267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172906268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172906270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172906270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172906270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:08.024691 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29145): Process ended prematurely: osmo-stp_10.42.42.5(pid=29145) [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29145)] [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:29:08.034432 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:29:08.062616 run osmo-hlr_10.42.42.2(pid=29142): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29142)] 17:29:08.113386 run osmo-hlr_10.42.42.2(pid=29142): stdout: | (launched: 2022-12-10_17:29:05.082898) 17:29:08.165951 run osmo-hlr_10.42.42.2(pid=29142): stderr: | 20221210172905282 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172905282 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172905282 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172905282 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172905282 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172905282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172905295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172905303 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172905303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172905303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:08.238842 run osmo-msc_10.42.42.6(pid=29148): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29148)] 17:29:08.289426 run osmo-msc_10.42.42.6(pid=29148): stdout: | (launched: 2022-12-10_17:29:07.100891) 17:29:08.341741 run osmo-msc_10.42.42.6(pid=29148): stderr: | 20221210172907425 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172907425 DLGLOBAL DEBUG validating counter group 0x7f5c7657ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172907425 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172907425 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172907425 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172907426 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172907427 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172907428 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172907428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172907428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:08.394694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29141): Terminating (SIGTERM) 17:29:08.436715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29144): Terminating (SIGTERM) 17:29:08.479050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29147): Terminating (SIGTERM) 17:29:08.521507 --- ParallelTerminationStrategy: PID 29141 died... 17:29:08.541471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29141): Terminated: ok {rc=0} 17:29:08.588220 --- ParallelTerminationStrategy: PID 29144 died... 17:29:08.607689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29144): Terminated: ok {rc=0} 17:29:08.654596 --- ParallelTerminationStrategy: PID 29147 died... 17:29:08.674118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29147): Terminated: ok {rc=0} 17:29:08.763130 bus /sierra_3: Setting Powered False 17:29:09.861554 bus /sierra_3: Setting Powered False 17:29:10.977075 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:29:12.233957 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:29:12.242722 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:29:12.277609 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:29:12.304877 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:29:12.355669 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:29:12.389616 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:29:12.417153 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:29:12.966927 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:29:13.017131 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:13.028240 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:29:13.096681 tst mo_mt_call.py: using LAC 29491 17:29:13.212496 tst mo_mt_call.py: using RAC 166 17:29:13.329353 tst mo_mt_call.py: using CellId 29491 17:29:13.446673 tst mo_mt_call.py: using BVCI 29492 17:29:13.555833 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:13.566898 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:13.577837 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:13.589466 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:13.600808 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:13.612142 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:29:13.731823 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:29:13.851974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:14.349604 run create_hlr_db(pid=29153): Launched 17:29:14.473147 bus /sierra_2: Setting Powered False 17:29:15.536304 run create_hlr_db(pid=29153): Terminated: ok {rc=0} 17:29:15.985718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29155): Launched 17:29:16.334403 run osmo-hlr_10.42.42.2(pid=29156): Launched 17:29:16.512669 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:17.195551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29158): Launched 17:29:17.511197 run osmo-stp_10.42.42.5(pid=29159): Launched 17:29:17.627364 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:18.170570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29161): Launched 17:29:18.473775 run osmo-msc_10.42.42.6(pid=29162): Launched 17:29:18.643349 run osmo-stp_10.42.42.5(pid=29159): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29159)] 17:29:18.770165 run osmo-stp_10.42.42.5(pid=29159): stdout: | (launched: 2022-12-10_17:29:17.455934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:18.897906 run osmo-stp_10.42.42.5(pid=29159): stderr: | 20221210172917626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172917626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172917627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172917627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172917628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172917628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172917628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:19.022537 run osmo-stp_10.42.42.5(pid=29159): stdout: | (launched: 2022-12-10_17:29:17.455934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:19.141776 run osmo-stp_10.42.42.5(pid=29159): stderr: | 20221210172917626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172917626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172917627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172917627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172917628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172917628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172917628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:19.284037 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29159): Process ended prematurely: osmo-stp_10.42.42.5(pid=29159) [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29159)] [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:29:19.293095 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:29:19.319269 run osmo-hlr_10.42.42.2(pid=29156): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29156)] 17:29:19.366486 run osmo-hlr_10.42.42.2(pid=29156): stdout: | (launched: 2022-12-10_17:29:16.271261) 17:29:19.415354 run osmo-hlr_10.42.42.2(pid=29156): stderr: | 20221210172916669 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172916669 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172916669 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172916669 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172916669 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172916669 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172916688 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172916705 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172916705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172916705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:19.483808 run osmo-msc_10.42.42.6(pid=29162): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29162)] 17:29:19.531269 run osmo-msc_10.42.42.6(pid=29162): stdout: | (launched: 2022-12-10_17:29:18.417406) 17:29:19.580213 run osmo-msc_10.42.42.6(pid=29162): stderr: | 20221210172918690 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172918690 DLGLOBAL DEBUG validating counter group 0x7fd599049c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172918691 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172918691 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172918691 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172918691 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172918695 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172918695 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172918695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172918695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:19.629407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29155): Terminating (SIGTERM) 17:29:19.668587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29158): Terminating (SIGTERM) 17:29:19.707839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29161): Terminating (SIGTERM) 17:29:19.747147 --- ParallelTerminationStrategy: PID 29155 died... 17:29:19.766021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29155): Terminated: ok {rc=0} 17:29:19.809586 --- ParallelTerminationStrategy: PID 29158 died... 17:29:19.828020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29158): Terminated: ok {rc=0} 17:29:19.871300 --- ParallelTerminationStrategy: PID 29161 died... 17:29:19.889832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29161): Terminated: ok {rc=0} 17:29:19.973656 bus /sierra_3: Setting Powered False 17:29:21.071887 bus /sierra_3: Setting Powered False 17:29:22.191369 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:29:23.343032 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:23.355798 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:29:23.428178 tst mo_mt_call_osmux.py: using LAC 29492 17:29:23.555282 tst mo_mt_call_osmux.py: using RAC 167 17:29:23.682505 tst mo_mt_call_osmux.py: using CellId 29492 17:29:23.809746 tst mo_mt_call_osmux.py: using BVCI 29493 17:29:23.926449 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:23.938222 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:23.949812 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:23.961873 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:23.973877 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:23.986365 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:29:24.106678 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:29:24.223436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:24.690745 run create_hlr_db(pid=29165): Launched 17:29:24.815506 bus /sierra_2: Setting Powered False 17:29:25.874562 run create_hlr_db(pid=29165): Terminated: ok {rc=0} 17:29:26.312383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29167): Launched 17:29:26.634490 run osmo-hlr_10.42.42.2(pid=29168): Launched 17:29:26.758050 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:27.308606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29170): Launched 17:29:27.628882 run osmo-stp_10.42.42.5(pid=29171): Launched 17:29:27.753448 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:28.339800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29173): Launched 17:29:28.662498 run osmo-msc_10.42.42.6(pid=29174): Launched 17:29:28.842238 run osmo-stp_10.42.42.5(pid=29171): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29171)] 17:29:28.978077 run osmo-stp_10.42.42.5(pid=29171): stdout: | (launched: 2022-12-10_17:29:27.570477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:29.114886 run osmo-stp_10.42.42.5(pid=29171): stderr: | 20221210172927765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172927765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172927765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172927766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172927766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172927766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172927766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:29.252313 run osmo-stp_10.42.42.5(pid=29171): stdout: | (launched: 2022-12-10_17:29:27.570477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:29.380644 run osmo-stp_10.42.42.5(pid=29171): stderr: | 20221210172927765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172927765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172927765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172927766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172927766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172927766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172927766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:29.534729 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29171): Process ended prematurely: osmo-stp_10.42.42.5(pid=29171) [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29171)] [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:29:29.544558 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:29:29.573657 run osmo-hlr_10.42.42.2(pid=29168): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29168)] 17:29:29.624258 run osmo-hlr_10.42.42.2(pid=29168): stdout: | (launched: 2022-12-10_17:29:26.575900) 17:29:29.676760 run osmo-hlr_10.42.42.2(pid=29168): stderr: | 20221210172926772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172926772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172926772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172926772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172926772 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172926772 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172926788 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172926797 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172926797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172926797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:29.749975 run osmo-msc_10.42.42.6(pid=29174): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29174)] 17:29:29.800555 run osmo-msc_10.42.42.6(pid=29174): stdout: | (launched: 2022-12-10_17:29:28.603764) 17:29:29.852367 run osmo-msc_10.42.42.6(pid=29174): stderr: | 20221210172928927 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172928927 DLGLOBAL DEBUG validating counter group 0x7fbfb0925c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172928927 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172928927 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172928927 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172928927 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172928929 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172928929 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172928930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172928930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:29.904571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29167): Terminating (SIGTERM) 17:29:29.946282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29170): Terminating (SIGTERM) 17:29:29.988321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29173): Terminating (SIGTERM) 17:29:30.030325 --- ParallelTerminationStrategy: PID 29167 died... 17:29:30.050363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29167): Terminated: ok {rc=0} 17:29:30.097418 --- ParallelTerminationStrategy: PID 29170 died... 17:29:30.116880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29170): Terminated: ok {rc=0} 17:29:30.163458 --- ParallelTerminationStrategy: PID 29173 died... 17:29:30.182958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29173): Terminated: ok {rc=0} 17:29:30.271002 bus /sierra_3: Setting Powered False 17:29:31.371577 bus /sierra_3: Setting Powered False 17:29:32.500937 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:29:33.748205 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:29:33.754631 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:29:33.787652 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:29:33.814182 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:29:33.866537 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:29:33.899220 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:29:33.925104 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:29:34.474903 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:29:34.523082 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:34.534345 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:29:34.603510 tst mo_mt_call.py: using LAC 29493 17:29:34.723015 tst mo_mt_call.py: using RAC 168 17:29:34.842237 tst mo_mt_call.py: using CellId 29493 17:29:34.962290 tst mo_mt_call.py: using BVCI 29494 17:29:35.072469 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:35.083583 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:35.094466 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:35.105296 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:35.116162 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:35.127043 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:29:35.244816 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:29:35.359877 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:35.856563 run create_hlr_db(pid=29179): Launched 17:29:35.979921 bus /sierra_2: Setting Powered False 17:29:37.044273 run create_hlr_db(pid=29179): Terminated: ok {rc=0} 17:29:37.473045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29181): Launched 17:29:37.775047 run osmo-hlr_10.42.42.2(pid=29182): Launched 17:29:37.889521 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:38.407652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29184): Launched 17:29:38.710480 run osmo-stp_10.42.42.5(pid=29185): Launched 17:29:38.826108 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:39.372732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29187): Launched 17:29:39.675107 run osmo-msc_10.42.42.6(pid=29188): Launched 17:29:39.844071 run osmo-stp_10.42.42.5(pid=29185): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29185)] 17:29:39.972786 run osmo-stp_10.42.42.5(pid=29185): stdout: | (launched: 2022-12-10_17:29:38.655085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:40.100063 run osmo-stp_10.42.42.5(pid=29185): stderr: | 20221210172938825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172938825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172938826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172938826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172938827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172938827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172938827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:40.225530 run osmo-stp_10.42.42.5(pid=29185): stdout: | (launched: 2022-12-10_17:29:38.655085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:40.345349 run osmo-stp_10.42.42.5(pid=29185): stderr: | 20221210172938825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172938825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172938826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172938826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172938827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172938827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172938827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:40.488718 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29185): Process ended prematurely: osmo-stp_10.42.42.5(pid=29185) [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29185)] [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:29:40.497788 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:29:40.523937 run osmo-hlr_10.42.42.2(pid=29182): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29182)] 17:29:40.571164 run osmo-hlr_10.42.42.2(pid=29182): stdout: | (launched: 2022-12-10_17:29:37.719667) 17:29:40.620389 run osmo-hlr_10.42.42.2(pid=29182): stderr: | 20221210172937898 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172937898 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172937898 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172937898 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172937898 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172937898 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172937917 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172937926 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172937926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172937926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:40.688770 run osmo-msc_10.42.42.6(pid=29188): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29188)] 17:29:40.735991 run osmo-msc_10.42.42.6(pid=29188): stdout: | (launched: 2022-12-10_17:29:39.619724) 17:29:40.784437 run osmo-msc_10.42.42.6(pid=29188): stderr: | 20221210172939891 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172939891 DLGLOBAL DEBUG validating counter group 0x7f0555ba5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172939891 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172939891 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172939891 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172939892 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172939893 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172939895 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172939895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172939895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:40.834031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29181): Terminating (SIGTERM) 17:29:40.873138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29184): Terminating (SIGTERM) 17:29:40.912223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29187): Terminating (SIGTERM) 17:29:40.951551 --- ParallelTerminationStrategy: PID 29181 died... 17:29:40.970452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29181): Terminated: ok {rc=0} 17:29:41.013882 --- ParallelTerminationStrategy: PID 29184 died... 17:29:41.032380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29184): Terminated: ok {rc=0} 17:29:41.076163 --- ParallelTerminationStrategy: PID 29187 died... 17:29:41.094682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29187): Terminated: ok {rc=0} 17:29:41.180064 bus /sierra_3: Setting Powered False 17:29:42.279758 bus /sierra_3: Setting Powered False 17:29:43.395698 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:29:44.545125 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:44.557529 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:29:44.629568 tst mo_mt_call_osmux.py: using LAC 29494 17:29:44.749355 tst mo_mt_call_osmux.py: using RAC 169 17:29:44.867868 tst mo_mt_call_osmux.py: using CellId 29494 17:29:44.988719 tst mo_mt_call_osmux.py: using BVCI 29495 17:29:45.107929 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:45.119708 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:45.131251 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:45.143305 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:45.155340 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:45.167312 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:29:45.285534 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:29:45.405335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:45.922285 run create_hlr_db(pid=29190): Launched 17:29:46.067250 bus /sierra_2: Setting Powered False 17:29:47.127442 run create_hlr_db(pid=29190): Terminated: ok {rc=0} 17:29:47.551993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29192): Launched 17:29:47.876202 run osmo-hlr_10.42.42.2(pid=29193): Launched 17:29:47.999255 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:48.555556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29195): Launched 17:29:48.877360 run osmo-stp_10.42.42.5(pid=29196): Launched 17:29:49.001837 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:49.583422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29198): Launched 17:29:49.905333 run osmo-msc_10.42.42.6(pid=29199): Launched 17:29:50.086588 run osmo-stp_10.42.42.5(pid=29196): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29196)] 17:29:50.222169 run osmo-stp_10.42.42.5(pid=29196): stdout: | (launched: 2022-12-10_17:29:48.818880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:50.358730 run osmo-stp_10.42.42.5(pid=29196): stderr: | 20221210172949010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172949010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172949011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172949011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172949012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172949012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172949012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:50.494264 run osmo-stp_10.42.42.5(pid=29196): stdout: | (launched: 2022-12-10_17:29:48.818880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:50.622355 run osmo-stp_10.42.42.5(pid=29196): stderr: | 20221210172949010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210172949010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210172949011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210172949011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210172949012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210172949012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210172949012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:50.775962 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29196): Process ended prematurely: osmo-stp_10.42.42.5(pid=29196) [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29196)] [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:29:50.785669 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:29:50.814151 run osmo-hlr_10.42.42.2(pid=29193): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29193)] 17:29:50.864408 run osmo-hlr_10.42.42.2(pid=29193): stdout: | (launched: 2022-12-10_17:29:47.817292) 17:29:50.916343 run osmo-hlr_10.42.42.2(pid=29193): stderr: | 20221210172948018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172948018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172948019 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172948019 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172948019 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172948019 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172948032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172948042 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172948042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172948042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:50.988550 run osmo-msc_10.42.42.6(pid=29199): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29199)] 17:29:51.039284 run osmo-msc_10.42.42.6(pid=29199): stdout: | (launched: 2022-12-10_17:29:49.846601) 17:29:51.091272 run osmo-msc_10.42.42.6(pid=29199): stderr: | 20221210172950169 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210172950169 DLGLOBAL DEBUG validating counter group 0x7f97b36c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210172950170 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210172950170 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210172950170 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210172950170 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210172950172 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210172950172 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210172950172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210172950172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:51.143640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29192): Terminating (SIGTERM) 17:29:51.185479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29195): Terminating (SIGTERM) 17:29:51.227378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29198): Terminating (SIGTERM) 17:29:51.269744 --- ParallelTerminationStrategy: PID 29192 died... 17:29:51.289618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29192): Terminated: ok {rc=0} 17:29:51.336088 --- ParallelTerminationStrategy: PID 29195 died... 17:29:51.355471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29195): Terminated: ok {rc=0} 17:29:51.401834 --- ParallelTerminationStrategy: PID 29198 died... 17:29:51.421664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29198): Terminated: ok {rc=0} 17:29:51.510213 bus /sierra_3: Setting Powered False 17:29:52.609161 bus /sierra_3: Setting Powered False 17:29:53.725269 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:29:54.979864 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:29:54.986837 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:29:55.021665 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:29:55.049342 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:29:55.103638 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:29:55.137737 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:29:55.165246 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:29:55.715057 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:29:55.766752 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:29:55.778314 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:29:55.849302 tst mo_mt_call.py: using LAC 29495 17:29:55.977993 tst mo_mt_call.py: using RAC 170 17:29:56.109370 tst mo_mt_call.py: using CellId 29495 17:29:56.234570 tst mo_mt_call.py: using BVCI 29496 17:29:56.351118 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:29:56.362658 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:29:56.373933 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:29:56.385432 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:29:56.397044 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:29:56.408552 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:29:56.523629 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:29:56.641577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:57.142305 run create_hlr_db(pid=29205): Launched 17:29:57.264675 bus /sierra_2: Setting Powered False 17:29:58.328445 run create_hlr_db(pid=29205): Terminated: ok {rc=0} 17:29:58.775641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29207): Launched 17:29:59.098379 run osmo-hlr_10.42.42.2(pid=29208): Launched 17:29:59.222771 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:59.776087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29210): Launched 17:30:00.097702 run osmo-stp_10.42.42.5(pid=29211): Launched 17:30:00.220846 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:00.805162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29213): Launched 17:30:01.170733 run osmo-msc_10.42.42.6(pid=29214): Launched 17:30:01.431643 run osmo-stp_10.42.42.5(pid=29211): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29211)] 17:30:01.755807 run osmo-stp_10.42.42.5(pid=29211): stdout: | (launched: 2022-12-10_17:30:00.038759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:01.981585 run osmo-stp_10.42.42.5(pid=29211): stderr: | 20221210173000231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173000232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173000232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173000232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173000235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173000235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173000235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:02.135677 run osmo-stp_10.42.42.5(pid=29211): stdout: | (launched: 2022-12-10_17:30:00.038759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:02.268669 run osmo-stp_10.42.42.5(pid=29211): stderr: | 20221210173000231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173000232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173000232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173000232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173000235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173000235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173000235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:02.425229 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29211): Process ended prematurely: osmo-stp_10.42.42.5(pid=29211) [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29211)] [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:30:02.435121 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 17:30:02.464285 run osmo-hlr_10.42.42.2(pid=29208): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29208)] 17:30:02.515143 run osmo-hlr_10.42.42.2(pid=29208): stdout: | (launched: 2022-12-10_17:29:59.039574) 17:30:02.567335 run osmo-hlr_10.42.42.2(pid=29208): stderr: | 20221210172959237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210172959237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210172959237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210172959237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210172959237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210172959237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210172959256 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210172959265 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210172959266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210172959266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:02.639739 run osmo-msc_10.42.42.6(pid=29214): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29214)] 17:30:02.690406 run osmo-msc_10.42.42.6(pid=29214): stdout: | (launched: 2022-12-10_17:30:01.108906) 17:30:02.742825 run osmo-msc_10.42.42.6(pid=29214): stderr: | 20221210173001588 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173001588 DLGLOBAL DEBUG validating counter group 0x7fa607af5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173001588 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173001588 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173001588 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173001589 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173001590 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173001591 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173001591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173001591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:02.795771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29207): Terminating (SIGTERM) 17:30:02.838140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29210): Terminating (SIGTERM) 17:30:02.880283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29213): Terminating (SIGTERM) 17:30:02.922756 --- ParallelTerminationStrategy: PID 29207 died... 17:30:02.942803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29207): Terminated: ok {rc=0} 17:30:02.989793 --- ParallelTerminationStrategy: PID 29210 died... 17:30:03.009807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29210): Terminated: ok {rc=0} 17:30:03.056530 --- ParallelTerminationStrategy: PID 29213 died... 17:30:03.076129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29213): Terminated: ok {rc=0} 17:30:03.165277 bus /sierra_3: Setting Powered False 17:30:04.264520 bus /sierra_3: Setting Powered False 17:30:05.381089 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:30:06.530303 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:06.542504 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:30:06.614600 tst mo_mt_call_osmux.py: using LAC 29496 17:30:06.742122 tst mo_mt_call_osmux.py: using RAC 171 17:30:06.867449 tst mo_mt_call_osmux.py: using CellId 29496 17:30:06.994527 tst mo_mt_call_osmux.py: using BVCI 29497 17:30:07.111541 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:07.123081 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:07.134471 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:07.146062 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:07.157767 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:07.169454 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:30:07.286818 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:30:07.400919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:07.868332 run create_hlr_db(pid=29219): Launched 17:30:07.991948 bus /sierra_2: Setting Powered False 17:30:09.052318 run create_hlr_db(pid=29219): Terminated: ok {rc=0} 17:30:09.470300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29221): Launched 17:30:09.772630 run osmo-hlr_10.42.42.2(pid=29222): Launched 17:30:09.886076 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:10.415021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29224): Launched 17:30:10.715178 run osmo-stp_10.42.42.5(pid=29225): Launched 17:30:10.829082 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:11.373078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29227): Launched 17:30:11.673080 run osmo-msc_10.42.42.6(pid=29228): Launched 17:30:11.849886 run osmo-stp_10.42.42.5(pid=29225): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29225)] 17:30:11.976416 run osmo-stp_10.42.42.5(pid=29225): stdout: | (launched: 2022-12-10_17:30:10.660009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:12.104724 run osmo-stp_10.42.42.5(pid=29225): stderr: | 20221210173010831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173010831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173010832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173010832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173010833 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173010833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173010833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:12.230560 run osmo-stp_10.42.42.5(pid=29225): stdout: | (launched: 2022-12-10_17:30:10.660009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:12.349972 run osmo-stp_10.42.42.5(pid=29225): stderr: | 20221210173010831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173010831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173010832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173010832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173010833 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173010833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173010833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:12.492760 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29225): Process ended prematurely: osmo-stp_10.42.42.5(pid=29225) [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29225)] [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:30:12.501698 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 17:30:12.528007 run osmo-hlr_10.42.42.2(pid=29222): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29222)] 17:30:12.575987 run osmo-hlr_10.42.42.2(pid=29222): stdout: | (launched: 2022-12-10_17:30:09.717268) 17:30:12.625476 run osmo-hlr_10.42.42.2(pid=29222): stderr: | 20221210173009895 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173009895 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173009895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173009895 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173009895 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173009895 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173009907 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173009918 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173009918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173009918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:12.694650 run osmo-msc_10.42.42.6(pid=29228): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29228)] 17:30:12.742488 run osmo-msc_10.42.42.6(pid=29228): stdout: | (launched: 2022-12-10_17:30:11.617798) 17:30:12.791853 run osmo-msc_10.42.42.6(pid=29228): stderr: | 20221210173011901 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173011901 DLGLOBAL DEBUG validating counter group 0x7fe1515b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173011901 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173011901 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173011901 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173011903 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173011904 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173011905 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173011905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173011905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:12.841744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29221): Terminating (SIGTERM) 17:30:12.881848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29224): Terminating (SIGTERM) 17:30:12.921832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29227): Terminating (SIGTERM) 17:30:12.961734 --- ParallelTerminationStrategy: PID 29221 died... 17:30:12.980626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29221): Terminated: ok {rc=0} 17:30:13.025009 --- ParallelTerminationStrategy: PID 29224 died... 17:30:13.044007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29224): Terminated: ok {rc=0} 17:30:13.088230 --- ParallelTerminationStrategy: PID 29227 died... 17:30:13.106952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29227): Terminated: ok {rc=0} 17:30:13.193622 bus /sierra_3: Setting Powered False 17:30:14.292814 bus /sierra_3: Setting Powered False 17:30:15.408327 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:30:16.666571 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:30:16.673769 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:30:16.710596 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:30:16.742063 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:30:16.796272 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:30:16.833425 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:30:16.863994 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:30:17.409820 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:30:17.462063 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:17.473718 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:30:17.545190 tst mo_mt_call.py: using LAC 29497 17:30:17.672404 tst mo_mt_call.py: using RAC 172 17:30:17.800267 tst mo_mt_call.py: using CellId 29497 17:30:17.920814 tst mo_mt_call.py: using BVCI 29498 17:30:18.029623 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:18.040755 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:18.051753 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:18.062820 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:18.074011 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:18.084691 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:30:18.201945 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:30:18.320892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:18.818883 run create_hlr_db(pid=29233): Launched 17:30:18.943508 bus /sierra_2: Setting Powered False 17:30:20.006920 run create_hlr_db(pid=29233): Terminated: ok {rc=0} 17:30:20.436481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29235): Launched 17:30:20.740159 run osmo-hlr_10.42.42.2(pid=29236): Launched 17:30:20.854337 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:21.371829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29238): Launched 17:30:21.673558 run osmo-stp_10.42.42.5(pid=29239): Launched 17:30:21.788119 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:22.330159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29241): Launched 17:30:22.630312 run osmo-msc_10.42.42.6(pid=29242): Launched 17:30:22.800072 run osmo-stp_10.42.42.5(pid=29239): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29239)] 17:30:22.926120 run osmo-stp_10.42.42.5(pid=29239): stdout: | (launched: 2022-12-10_17:30:21.617536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:23.053290 run osmo-stp_10.42.42.5(pid=29239): stderr: | 20221210173021788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173021788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173021788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173021789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173021789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173021789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173021789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:23.178038 run osmo-stp_10.42.42.5(pid=29239): stdout: | (launched: 2022-12-10_17:30:21.617536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:23.296755 run osmo-stp_10.42.42.5(pid=29239): stderr: | 20221210173021788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173021788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173021788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173021789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173021789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173021789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173021789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:23.439093 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29239): Process ended prematurely: osmo-stp_10.42.42.5(pid=29239) [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29239)] [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:30:23.447999 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:30:23.474256 run osmo-hlr_10.42.42.2(pid=29236): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29236)] 17:30:23.521639 run osmo-hlr_10.42.42.2(pid=29236): stdout: | (launched: 2022-12-10_17:30:20.684908) 17:30:23.570413 run osmo-hlr_10.42.42.2(pid=29236): stderr: | 20221210173020861 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173020861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173020861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173020861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173020861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173020861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173020873 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173020882 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173020882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173020882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:23.638595 run osmo-msc_10.42.42.6(pid=29242): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29242)] 17:30:23.685733 run osmo-msc_10.42.42.6(pid=29242): stdout: | (launched: 2022-12-10_17:30:22.574962) 17:30:23.734488 run osmo-msc_10.42.42.6(pid=29242): stderr: | 20221210173022846 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173022846 DLGLOBAL DEBUG validating counter group 0x7fd03fc06c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173022846 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173022846 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173022846 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173022847 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173022848 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173022849 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173022850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173022850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:23.783606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29235): Terminating (SIGTERM) 17:30:23.822745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29238): Terminating (SIGTERM) 17:30:23.861770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29241): Terminating (SIGTERM) 17:30:23.901090 --- ParallelTerminationStrategy: PID 29235 died... 17:30:23.919832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29235): Terminated: ok {rc=0} 17:30:23.963165 --- ParallelTerminationStrategy: PID 29238 died... 17:30:23.981430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29238): Terminated: ok {rc=0} 17:30:24.025514 --- ParallelTerminationStrategy: PID 29241 died... 17:30:24.043835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29241): Terminated: ok {rc=0} 17:30:24.129629 bus /sierra_3: Setting Powered False 17:30:25.229869 bus /sierra_3: Setting Powered False 17:30:26.346347 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:30:27.492649 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:27.504413 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:30:27.574493 tst mo_mt_call_osmux.py: using LAC 29498 17:30:27.693169 tst mo_mt_call_osmux.py: using RAC 173 17:30:27.815242 tst mo_mt_call_osmux.py: using CellId 29498 17:30:27.933095 tst mo_mt_call_osmux.py: using BVCI 29499 17:30:28.041299 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:28.052216 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:28.063010 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:28.073892 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:28.084860 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:28.095683 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:30:28.210509 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:30:28.330016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:28.830168 run create_hlr_db(pid=29244): Launched 17:30:28.953301 bus /sierra_2: Setting Powered False 17:30:30.012873 run create_hlr_db(pid=29244): Terminated: ok {rc=0} 17:30:30.461548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29246): Launched 17:30:30.786430 run osmo-hlr_10.42.42.2(pid=29247): Launched 17:30:30.950592 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:31.641754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29249): Launched 17:30:31.960901 run osmo-stp_10.42.42.5(pid=29250): Launched 17:30:32.141372 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:32.755194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29252): Launched 17:30:33.078396 run osmo-msc_10.42.42.6(pid=29253): Launched 17:30:33.257119 run osmo-stp_10.42.42.5(pid=29250): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29250)] 17:30:33.392480 run osmo-stp_10.42.42.5(pid=29250): stdout: | (launched: 2022-12-10_17:30:31.904090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:33.529200 run osmo-stp_10.42.42.5(pid=29250): stderr: | 20221210173032273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173032273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173032273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173032274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173032274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173032274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173032274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:33.664750 run osmo-stp_10.42.42.5(pid=29250): stdout: | (launched: 2022-12-10_17:30:31.904090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:33.792811 run osmo-stp_10.42.42.5(pid=29250): stderr: | 20221210173032273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173032273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173032273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173032274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173032274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173032274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173032274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:33.946002 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29250): Process ended prematurely: osmo-stp_10.42.42.5(pid=29250) [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29250)] [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:30:33.955703 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:30:33.984196 run osmo-hlr_10.42.42.2(pid=29247): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29247)] 17:30:34.035666 run osmo-hlr_10.42.42.2(pid=29247): stdout: | (launched: 2022-12-10_17:30:30.727179) 17:30:34.088388 run osmo-hlr_10.42.42.2(pid=29247): stderr: | 20221210173031047 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173031047 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173031047 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173031047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173031047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173031047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173031068 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173031087 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173031088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173031088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:34.161867 run osmo-msc_10.42.42.6(pid=29253): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29253)] 17:30:34.212627 run osmo-msc_10.42.42.6(pid=29253): stdout: | (launched: 2022-12-10_17:30:33.019334) 17:30:34.265108 run osmo-msc_10.42.42.6(pid=29253): stderr: | 20221210173033341 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173033341 DLGLOBAL DEBUG validating counter group 0x7f4f236b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173033341 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173033341 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173033341 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173033342 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173033343 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173033344 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173033344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173033344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:34.317817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29246): Terminating (SIGTERM) 17:30:34.360232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29249): Terminating (SIGTERM) 17:30:34.402593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29252): Terminating (SIGTERM) 17:30:34.445154 --- ParallelTerminationStrategy: PID 29246 died... 17:30:34.465330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29246): Terminated: ok {rc=0} 17:30:34.512415 --- ParallelTerminationStrategy: PID 29249 died... 17:30:34.532055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29249): Terminated: ok {rc=0} 17:30:34.578794 --- ParallelTerminationStrategy: PID 29252 died... 17:30:34.598818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29252): Terminated: ok {rc=0} 17:30:34.686952 bus /sierra_3: Setting Powered False 17:30:35.786285 bus /sierra_3: Setting Powered False 17:30:36.902452 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:30:38.156581 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:30:38.163706 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:30:38.198607 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:30:38.225963 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:30:38.280480 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:30:38.314788 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:30:38.342302 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:30:38.895786 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:30:38.947267 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:38.958929 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:30:39.030410 tst mo_mt_call.py: using LAC 29499 17:30:39.157415 tst mo_mt_call.py: using RAC 174 17:30:39.285382 tst mo_mt_call.py: using CellId 29499 17:30:39.412784 tst mo_mt_call.py: using BVCI 29500 17:30:39.531048 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:39.542704 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:39.554062 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:39.565649 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:39.577317 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:39.588838 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:30:39.703148 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:30:39.820293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:40.290058 run create_hlr_db(pid=29258): Launched 17:30:40.416188 bus /sierra_2: Setting Powered False 17:30:41.475395 run create_hlr_db(pid=29258): Terminated: ok {rc=0} 17:30:41.914683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29260): Launched 17:30:42.239256 run osmo-hlr_10.42.42.2(pid=29261): Launched 17:30:42.363038 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:42.920390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29263): Launched 17:30:43.242571 run osmo-stp_10.42.42.5(pid=29264): Launched 17:30:43.366928 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:43.948827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29266): Launched 17:30:44.273694 run osmo-msc_10.42.42.6(pid=29267): Launched 17:30:44.454920 run osmo-stp_10.42.42.5(pid=29264): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29264)] 17:30:44.590733 run osmo-stp_10.42.42.5(pid=29264): stdout: | (launched: 2022-12-10_17:30:43.183822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:44.727048 run osmo-stp_10.42.42.5(pid=29264): stderr: | 20221210173043375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173043375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173043375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173043376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173043376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173043376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173043376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:44.862968 run osmo-stp_10.42.42.5(pid=29264): stdout: | (launched: 2022-12-10_17:30:43.183822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:44.991306 run osmo-stp_10.42.42.5(pid=29264): stderr: | 20221210173043375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173043375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173043375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173043376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173043376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173043376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173043376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:45.145548 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29264): Process ended prematurely: osmo-stp_10.42.42.5(pid=29264) [trial-2377↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29264)] [trial-2377↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:30:45.155147 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:30:45.183760 run osmo-hlr_10.42.42.2(pid=29261): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29261)] 17:30:45.234476 run osmo-hlr_10.42.42.2(pid=29261): stdout: | (launched: 2022-12-10_17:30:42.180387) 17:30:45.286594 run osmo-hlr_10.42.42.2(pid=29261): stderr: | 20221210173042378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173042378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173042378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173042378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173042378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173042379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173042402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173042412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173042412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173042412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:45.359145 run osmo-msc_10.42.42.6(pid=29267): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29267)] 17:30:45.410038 run osmo-msc_10.42.42.6(pid=29267): stdout: | (launched: 2022-12-10_17:30:44.214736) 17:30:45.462182 run osmo-msc_10.42.42.6(pid=29267): stderr: | 20221210173044536 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173044537 DLGLOBAL DEBUG validating counter group 0x7f0cbbddbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173044537 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173044537 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173044537 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173044537 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173044539 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173044539 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173044539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173044539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:45.514631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29260): Terminating (SIGTERM) 17:30:45.556681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29263): Terminating (SIGTERM) 17:30:45.598763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29266): Terminating (SIGTERM) 17:30:45.640904 --- ParallelTerminationStrategy: PID 29260 died... 17:30:45.660879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29260): Terminated: ok {rc=0} 17:30:45.707471 --- ParallelTerminationStrategy: PID 29263 died... 17:30:45.727063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29263): Terminated: ok {rc=0} 17:30:45.773599 --- ParallelTerminationStrategy: PID 29266 died... 17:30:45.793290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29266): Terminated: ok {rc=0} 17:30:45.892756 bus /sierra_3: Setting Powered False 17:30:46.986985 bus /sierra_3: Setting Powered False 17:30:48.099932 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:30:49.249382 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:49.261836 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:30:49.335042 tst mo_mt_call_osmux.py: using LAC 29500 17:30:49.461571 tst mo_mt_call_osmux.py: using RAC 175 17:30:49.582149 tst mo_mt_call_osmux.py: using CellId 29500 17:30:49.701913 tst mo_mt_call_osmux.py: using BVCI 29501 17:30:49.810846 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:49.822233 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:49.833315 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:49.844567 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:49.855864 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:49.866940 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:30:49.984068 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:30:50.105156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:50.604586 run create_hlr_db(pid=29269): Launched 17:30:50.728173 bus /sierra_2: Setting Powered False 17:30:51.792206 run create_hlr_db(pid=29269): Terminated: ok {rc=0} 17:30:52.222623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29271): Launched 17:30:52.526976 run osmo-hlr_10.42.42.2(pid=29272): Launched 17:30:52.645353 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:53.177382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29274): Launched 17:30:53.478986 run osmo-stp_10.42.42.5(pid=29275): Launched 17:30:53.594979 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:54.139891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29277): Launched 17:30:54.441112 run osmo-msc_10.42.42.6(pid=29278): Launched 17:30:54.610227 run osmo-stp_10.42.42.5(pid=29275): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29275)] 17:30:54.736670 run osmo-stp_10.42.42.5(pid=29275): stdout: | (launched: 2022-12-10_17:30:53.423945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:54.863550 run osmo-stp_10.42.42.5(pid=29275): stderr: | 20221210173053592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173053592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173053592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173053592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173053595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173053595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173053595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:54.989097 run osmo-stp_10.42.42.5(pid=29275): stdout: | (launched: 2022-12-10_17:30:53.423945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:55.108302 run osmo-stp_10.42.42.5(pid=29275): stderr: | 20221210173053592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173053592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173053592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173053592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173053595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173053595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173053595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:55.252308 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29275): Process ended prematurely: osmo-stp_10.42.42.5(pid=29275) [trial-2377↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29275)] [trial-2377↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:30:55.261413 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:30:55.288030 run osmo-hlr_10.42.42.2(pid=29272): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29272)] 17:30:55.335753 run osmo-hlr_10.42.42.2(pid=29272): stdout: | (launched: 2022-12-10_17:30:52.471704) 17:30:55.385237 run osmo-hlr_10.42.42.2(pid=29272): stderr: | 20221210173052650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173052650 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173052650 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173052650 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173052650 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173052650 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173052663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173052673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173052674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173052674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:55.454150 run osmo-msc_10.42.42.6(pid=29278): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29278)] 17:30:55.501705 run osmo-msc_10.42.42.6(pid=29278): stdout: | (launched: 2022-12-10_17:30:54.385642) 17:30:55.550795 run osmo-msc_10.42.42.6(pid=29278): stderr: | 20221210173054659 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173054659 DLGLOBAL DEBUG validating counter group 0x7f9d60457c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173054659 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173054659 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173054659 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173054659 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173054662 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173054663 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173054663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173054663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:55.599955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29271): Terminating (SIGTERM) 17:30:55.639013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29274): Terminating (SIGTERM) 17:30:55.678486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29277): Terminating (SIGTERM) 17:30:55.718072 --- ParallelTerminationStrategy: PID 29271 died... 17:30:55.737237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29271): Terminated: ok {rc=0} 17:30:55.781313 --- ParallelTerminationStrategy: PID 29274 died... 17:30:55.799768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29274): Terminated: ok {rc=0} 17:30:55.843455 --- ParallelTerminationStrategy: PID 29277 died... 17:30:55.862073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29277): Terminated: ok {rc=0} 17:30:55.946478 bus /sierra_3: Setting Powered False 17:30:57.045339 bus /sierra_3: Setting Powered False 17:30:58.160456 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:30:59.411441 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:30:59.417212 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:30:59.450709 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:30:59.477578 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:30:59.532539 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:30:59.566270 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:30:59.592626 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:31:00.137868 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:31:00.191553 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:00.203181 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:31:00.276741 tst mo_mt_call.py: using LAC 29501 17:31:00.402264 tst mo_mt_call.py: using RAC 176 17:31:00.530139 tst mo_mt_call.py: using CellId 29501 17:31:00.648716 tst mo_mt_call.py: using BVCI 29502 17:31:00.758387 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:00.769515 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:00.780169 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:00.791593 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:00.803160 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:00.814627 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:31:00.956193 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:31:01.092128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:01.603589 run create_hlr_db(pid=29283): Launched 17:31:01.765670 bus /sierra_2: Setting Powered False 17:31:02.828830 run create_hlr_db(pid=29283): Terminated: ok {rc=0} 17:31:03.258409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29285): Launched 17:31:03.561134 run osmo-hlr_10.42.42.2(pid=29286): Launched 17:31:03.674982 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:04.189620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29288): Launched 17:31:04.490501 run osmo-stp_10.42.42.5(pid=29289): Launched 17:31:04.604849 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:05.148685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29291): Launched 17:31:05.451660 run osmo-msc_10.42.42.6(pid=29292): Launched 17:31:05.619940 run osmo-stp_10.42.42.5(pid=29289): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29289)] 17:31:05.746137 run osmo-stp_10.42.42.5(pid=29289): stdout: | (launched: 2022-12-10_17:31:04.435120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:05.873544 run osmo-stp_10.42.42.5(pid=29289): stderr: | 20221210173104608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173104608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173104608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173104608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173104609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173104609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173104609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:05.998685 run osmo-stp_10.42.42.5(pid=29289): stdout: | (launched: 2022-12-10_17:31:04.435120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:06.118379 run osmo-stp_10.42.42.5(pid=29289): stderr: | 20221210173104608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173104608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173104608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173104608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173104609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173104609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173104609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:06.261633 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29289): Process ended prematurely: osmo-stp_10.42.42.5(pid=29289) [trial-2377↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29289)] [trial-2377↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:31:06.270543 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:31:06.297035 run osmo-hlr_10.42.42.2(pid=29286): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29286)] 17:31:06.344397 run osmo-hlr_10.42.42.2(pid=29286): stdout: | (launched: 2022-12-10_17:31:03.505655) 17:31:06.393332 run osmo-hlr_10.42.42.2(pid=29286): stderr: | 20221210173103684 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173103684 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173103684 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173103684 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173103684 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173103684 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173103699 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173103708 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173103708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173103708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:06.461878 run osmo-msc_10.42.42.6(pid=29292): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29292)] 17:31:06.509006 run osmo-msc_10.42.42.6(pid=29292): stdout: | (launched: 2022-12-10_17:31:05.395699) 17:31:06.557630 run osmo-msc_10.42.42.6(pid=29292): stderr: | 20221210173105669 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173105670 DLGLOBAL DEBUG validating counter group 0x7f9a108d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173105670 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173105670 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173105670 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173105670 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173105672 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173105672 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173105672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173105672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:06.607006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29285): Terminating (SIGTERM) 17:31:06.645933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29288): Terminating (SIGTERM) 17:31:06.685069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29291): Terminating (SIGTERM) 17:31:06.724835 --- ParallelTerminationStrategy: PID 29285 died... 17:31:06.743887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29285): Terminated: ok {rc=0} 17:31:06.787948 --- ParallelTerminationStrategy: PID 29288 died... 17:31:06.806587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29288): Terminated: ok {rc=0} 17:31:06.850560 --- ParallelTerminationStrategy: PID 29291 died... 17:31:06.869123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29291): Terminated: ok {rc=0} 17:31:06.955024 bus /sierra_3: Setting Powered False 17:31:08.053813 bus /sierra_3: Setting Powered False 17:31:09.168563 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:31:10.313672 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:10.325100 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:31:10.398194 tst mo_mt_call_osmux.py: using LAC 29502 17:31:10.514909 tst mo_mt_call_osmux.py: using RAC 177 17:31:10.633360 tst mo_mt_call_osmux.py: using CellId 29502 17:31:10.750086 tst mo_mt_call_osmux.py: using BVCI 29503 17:31:10.861119 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:10.872037 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:10.882808 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:10.893485 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:10.904134 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:10.914884 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:31:11.034131 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:31:11.154580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:11.656251 run create_hlr_db(pid=29294): Launched 17:31:11.781514 bus /sierra_2: Setting Powered False 17:31:12.841711 run create_hlr_db(pid=29294): Terminated: ok {rc=0} 17:31:13.260342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29296): Launched 17:31:13.562587 run osmo-hlr_10.42.42.2(pid=29297): Launched 17:31:13.676429 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:14.210109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29299): Launched 17:31:14.511220 run osmo-stp_10.42.42.5(pid=29300): Launched 17:31:14.626546 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:15.170241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29302): Launched 17:31:15.472664 run osmo-msc_10.42.42.6(pid=29303): Launched 17:31:15.642102 run osmo-stp_10.42.42.5(pid=29300): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29300)] 17:31:15.770143 run osmo-stp_10.42.42.5(pid=29300): stdout: | (launched: 2022-12-10_17:31:14.455675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:15.929948 run osmo-stp_10.42.42.5(pid=29300): stderr: | 20221210173114629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173114629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173114629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173114630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173114630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173114630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173114630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:16.070572 run osmo-stp_10.42.42.5(pid=29300): stdout: | (launched: 2022-12-10_17:31:14.455675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:16.203042 run osmo-stp_10.42.42.5(pid=29300): stderr: | 20221210173114629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173114629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173114629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173114630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173114630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173114630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173114630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:16.363261 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29300): Process ended prematurely: osmo-stp_10.42.42.5(pid=29300) [trial-2377↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29300)] [trial-2377↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:31:16.374031 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:31:16.405831 run osmo-hlr_10.42.42.2(pid=29297): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29297)] 17:31:16.460931 run osmo-hlr_10.42.42.2(pid=29297): stdout: | (launched: 2022-12-10_17:31:13.507226) 17:31:16.516080 run osmo-hlr_10.42.42.2(pid=29297): stderr: | 20221210173113684 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173113684 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173113684 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173113684 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173113684 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173113684 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173113701 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173113711 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173113711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173113711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:16.592318 run osmo-msc_10.42.42.6(pid=29303): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29303)] 17:31:16.646137 run osmo-msc_10.42.42.6(pid=29303): stdout: | (launched: 2022-12-10_17:31:15.416797) 17:31:16.700704 run osmo-msc_10.42.42.6(pid=29303): stderr: | 20221210173115692 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173115692 DLGLOBAL DEBUG validating counter group 0x7f1df708bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173115692 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173115692 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173115693 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173115693 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173115695 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173115695 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173115695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173115695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:16.755754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29296): Terminating (SIGTERM) 17:31:16.801647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29299): Terminating (SIGTERM) 17:31:16.848253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29302): Terminating (SIGTERM) 17:31:16.894824 --- ParallelTerminationStrategy: PID 29296 died... 17:31:16.915606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29296): Terminated: ok {rc=0} 17:31:16.966364 --- ParallelTerminationStrategy: PID 29299 died... 17:31:16.987206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29299): Terminated: ok {rc=0} 17:31:17.037834 --- ParallelTerminationStrategy: PID 29302 died... 17:31:17.058301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29302): Terminated: ok {rc=0} 17:31:17.149728 bus /sierra_3: Setting Powered False 17:31:18.251127 bus /sierra_3: Setting Powered False 17:31:19.363676 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 17:31:20.613474 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:31:20.618276 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 17:31:20.650895 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 17:31:20.676862 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 17:31:20.728354 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 17:31:20.760656 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 17:31:20.786740 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 17:31:21.336004 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 17:31:21.383680 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:21.394595 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 17:31:21.444801 tst mo_mt_call.py: using LAC 29503 17:31:21.562287 tst mo_mt_call.py: using RAC 178 17:31:21.679822 tst mo_mt_call.py: using CellId 29503 17:31:21.797809 tst mo_mt_call.py: using BVCI 29504 17:31:21.915085 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:21.926664 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:21.937856 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:21.949486 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:21.960713 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:21.972225 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 17:31:22.090447 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 17:31:22.205375 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:22.672355 run create_hlr_db(pid=29309): Launched 17:31:22.795951 bus /sierra_2: Setting Powered False 17:31:23.855456 run create_hlr_db(pid=29309): Terminated: ok {rc=0} 17:31:24.293754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29311): Launched 17:31:24.617484 run osmo-hlr_10.42.42.2(pid=29312): Launched 17:31:24.740543 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:25.298740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29314): Launched 17:31:25.621335 run osmo-stp_10.42.42.5(pid=29315): Launched 17:31:25.745007 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:26.329126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29317): Launched 17:31:26.650078 run osmo-msc_10.42.42.6(pid=29318): Launched 17:31:26.832214 run osmo-stp_10.42.42.5(pid=29315): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29315)] 17:31:26.968679 run osmo-stp_10.42.42.5(pid=29315): stdout: | (launched: 2022-12-10_17:31:25.562688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:27.104730 run osmo-stp_10.42.42.5(pid=29315): stderr: | 20221210173125753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173125753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173125754 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173125754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173125756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173125756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173125757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:27.239692 run osmo-stp_10.42.42.5(pid=29315): stdout: | (launched: 2022-12-10_17:31:25.562688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:27.367695 run osmo-stp_10.42.42.5(pid=29315): stderr: | 20221210173125753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173125753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173125754 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173125754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173125756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173125756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173125757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:27.521568 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29315): Process ended prematurely: osmo-stp_10.42.42.5(pid=29315) [trial-2377↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29315)] [trial-2377↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 17:31:27.531220 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:31:27.559584 run osmo-hlr_10.42.42.2(pid=29312): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29312)] 17:31:27.609850 run osmo-hlr_10.42.42.2(pid=29312): stdout: | (launched: 2022-12-10_17:31:24.558774) 17:31:27.661895 run osmo-hlr_10.42.42.2(pid=29312): stderr: | 20221210173124759 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173124759 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173124759 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173124759 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173124759 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173124759 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173124771 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173124779 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173124779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173124779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:27.734362 run osmo-msc_10.42.42.6(pid=29318): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29318)] 17:31:27.784789 run osmo-msc_10.42.42.6(pid=29318): stdout: | (launched: 2022-12-10_17:31:26.591359) 17:31:27.836814 run osmo-msc_10.42.42.6(pid=29318): stderr: | 20221210173126914 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173126914 DLGLOBAL DEBUG validating counter group 0x7f0afd425c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173126914 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173126914 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173126914 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173126915 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173126916 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173126917 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173126917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173126917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:27.889296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29311): Terminating (SIGTERM) 17:31:27.931279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29314): Terminating (SIGTERM) 17:31:27.973407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29317): Terminating (SIGTERM) 17:31:28.015772 --- ParallelTerminationStrategy: PID 29311 died... 17:31:28.035826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29311): Terminated: ok {rc=0} 17:31:28.083281 --- ParallelTerminationStrategy: PID 29314 died... 17:31:28.102997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29314): Terminated: ok {rc=0} 17:31:28.149689 --- ParallelTerminationStrategy: PID 29317 died... 17:31:28.169133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29317): Terminated: ok {rc=0} 17:31:28.256676 bus /sierra_3: Setting Powered False 17:31:29.355109 bus /sierra_3: Setting Powered False 17:31:30.470670 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 17:31:31.646690 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:31.660847 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 17:31:31.725306 tst mo_mt_call_osmux.py: using LAC 29504 17:31:31.883282 tst mo_mt_call_osmux.py: using RAC 179 17:31:32.018279 tst mo_mt_call_osmux.py: using CellId 29504 17:31:32.152116 tst mo_mt_call_osmux.py: using BVCI 29505 17:31:32.275480 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:32.290874 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:32.303493 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:32.316018 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:32.328476 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:32.341831 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 17:31:32.460578 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 17:31:32.577381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:33.049301 run create_hlr_db(pid=29320): Launched 17:31:33.173372 bus /sierra_2: Setting Powered False 17:31:34.233548 run create_hlr_db(pid=29320): Terminated: ok {rc=0} 17:31:34.674548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29322): Launched 17:31:34.998164 run osmo-hlr_10.42.42.2(pid=29323): Launched 17:31:35.123197 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:35.682577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29325): Launched 17:31:36.005931 run osmo-stp_10.42.42.5(pid=29326): Launched 17:31:36.130362 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:36.717251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29328): Launched 17:31:37.039313 run osmo-msc_10.42.42.6(pid=29329): Launched 17:31:37.220854 run osmo-stp_10.42.42.5(pid=29326): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29326)] 17:31:37.355333 run osmo-stp_10.42.42.5(pid=29326): stdout: | (launched: 2022-12-10_17:31:35.946698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:37.490737 run osmo-stp_10.42.42.5(pid=29326): stderr: | 20221210173136140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173136140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173136141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173136141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173136141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173136142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173136142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:37.625964 run osmo-stp_10.42.42.5(pid=29326): stdout: | (launched: 2022-12-10_17:31:35.946698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:37.754087 run osmo-stp_10.42.42.5(pid=29326): stderr: | 20221210173136140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173136140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173136141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173136141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173136141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173136142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173136142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:37.907171 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29326): Process ended prematurely: osmo-stp_10.42.42.5(pid=29326) [trial-2377↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29326)] [trial-2377↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 17:31:37.916586 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:31:37.945044 run osmo-hlr_10.42.42.2(pid=29323): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29323)] 17:31:37.994980 run osmo-hlr_10.42.42.2(pid=29323): stdout: | (launched: 2022-12-10_17:31:34.939631) 17:31:38.046543 run osmo-hlr_10.42.42.2(pid=29323): stderr: | 20221210173135137 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173135137 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173135137 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173135137 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173135137 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173135137 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173135150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173135158 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173135158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173135158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:38.118462 run osmo-msc_10.42.42.6(pid=29329): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29329)] 17:31:38.168591 run osmo-msc_10.42.42.6(pid=29329): stdout: | (launched: 2022-12-10_17:31:36.980395) 17:31:38.220119 run osmo-msc_10.42.42.6(pid=29329): stderr: | 20221210173137302 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173137302 DLGLOBAL DEBUG validating counter group 0x7f94f9cc1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173137302 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173137302 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173137302 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173137303 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173137304 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173137305 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173137305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173137305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:38.271911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29322): Terminating (SIGTERM) 17:31:38.313757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29325): Terminating (SIGTERM) 17:31:38.355471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29328): Terminating (SIGTERM) 17:31:38.397306 --- ParallelTerminationStrategy: PID 29322 died... 17:31:38.417166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29322): Terminated: ok {rc=0} 17:31:38.463352 --- ParallelTerminationStrategy: PID 29325 died... 17:31:38.482733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29325): Terminated: ok {rc=0} 17:31:38.528755 --- ParallelTerminationStrategy: PID 29328 died... 17:31:38.548075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29328): Terminated: ok {rc=0} 17:31:38.634828 bus /sierra_3: Setting Powered False 17:31:39.732281 bus /sierra_3: Setting Powered False 17:31:40.846322 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 17:31:42.092536 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:31:42.098522 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 17:31:42.132774 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 17:31:42.159333 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 17:31:42.216264 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 17:31:42.250734 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 17:31:42.277600 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 17:31:42.822699 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 17:31:42.872158 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:42.883612 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:31:42.937316 tst mo_mt_call.py: using LAC 29505 17:31:43.062741 tst mo_mt_call.py: using RAC 180 17:31:43.189159 tst mo_mt_call.py: using CellId 29505 17:31:43.313696 tst mo_mt_call.py: using BVCI 29506 17:31:43.431296 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:43.443094 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:43.455081 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:43.467216 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:43.478954 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:43.490789 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:31:43.604667 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:31:43.720000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:44.188351 run create_hlr_db(pid=29334): Launched 17:31:44.313067 bus /sierra_2: Setting Powered False 17:31:45.373906 run create_hlr_db(pid=29334): Terminated: ok {rc=0} 17:31:45.794351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29336): Launched 17:31:46.141622 run osmo-hlr_10.42.42.2(pid=29337): Launched 17:31:46.460915 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:47.073651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29339): Launched 17:31:47.426081 run osmo-stp_10.42.42.5(pid=29340): Launched 17:31:47.550572 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:48.134859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29342): Launched 17:31:48.458377 run osmo-msc_10.42.42.6(pid=29343): Launched 17:31:48.638065 run osmo-stp_10.42.42.5(pid=29340): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29340)] 17:31:48.773781 run osmo-stp_10.42.42.5(pid=29340): stdout: | (launched: 2022-12-10_17:31:47.366810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:48.909822 run osmo-stp_10.42.42.5(pid=29340): stderr: | 20221210173147557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173147557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173147558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173147558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173147560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173147560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173147561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:49.044938 run osmo-stp_10.42.42.5(pid=29340): stdout: | (launched: 2022-12-10_17:31:47.366810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:49.173881 run osmo-stp_10.42.42.5(pid=29340): stderr: | 20221210173147557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173147557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173147558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173147558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173147560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173147560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173147561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:49.327032 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29340): Process ended prematurely: osmo-stp_10.42.42.5(pid=29340) [trial-2377↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29340)] [trial-2377↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 17:31:49.336779 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 17:31:49.365716 run osmo-hlr_10.42.42.2(pid=29337): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29337)] 17:31:49.416256 run osmo-hlr_10.42.42.2(pid=29337): stdout: | (launched: 2022-12-10_17:31:46.083181) 17:31:49.468622 run osmo-hlr_10.42.42.2(pid=29337): stderr: | 20221210173146340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173146340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173146340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173146340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173146340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173146341 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173146359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173146368 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173146368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173146368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:49.541361 run osmo-msc_10.42.42.6(pid=29343): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29343)] 17:31:49.591609 run osmo-msc_10.42.42.6(pid=29343): stdout: | (launched: 2022-12-10_17:31:48.398559) 17:31:49.643306 run osmo-msc_10.42.42.6(pid=29343): stderr: | 20221210173148722 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173148723 DLGLOBAL DEBUG validating counter group 0x7f844686cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173148723 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173148723 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173148723 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173148723 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173148725 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173148725 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173148725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173148726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:49.696041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29336): Terminating (SIGTERM) 17:31:49.738170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29339): Terminating (SIGTERM) 17:31:49.780317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29342): Terminating (SIGTERM) 17:31:49.822838 --- ParallelTerminationStrategy: PID 29336 died... 17:31:49.842809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29336): Terminated: ok {rc=0} 17:31:49.889827 --- ParallelTerminationStrategy: PID 29339 died... 17:31:49.909437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29339): Terminated: ok {rc=0} 17:31:49.956130 --- ParallelTerminationStrategy: PID 29342 died... 17:31:49.975631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29342): Terminated: ok {rc=0} 17:31:50.064743 bus /sierra_3: Setting Powered False 17:31:51.163233 bus /sierra_3: Setting Powered False 17:31:52.278172 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 17:31:53.426869 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:53.439476 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:31:53.493209 tst mo_mt_call_osmux.py: using LAC 29506 17:31:53.617132 tst mo_mt_call_osmux.py: using RAC 181 17:31:53.741440 tst mo_mt_call_osmux.py: using CellId 29506 17:31:53.859610 tst mo_mt_call_osmux.py: using BVCI 29507 17:31:53.969011 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:53.980491 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:53.991967 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:54.003366 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:54.014848 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:54.026191 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:31:54.145303 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:31:54.269941 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:54.769446 run create_hlr_db(pid=29345): Launched 17:31:54.893404 bus /sierra_2: Setting Powered False 17:31:55.957516 run create_hlr_db(pid=29345): Terminated: ok {rc=0} 17:31:56.405071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29347): Launched 17:31:56.727875 run osmo-hlr_10.42.42.2(pid=29348): Launched 17:31:56.851110 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:57.407928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29350): Launched 17:31:57.730195 run osmo-stp_10.42.42.5(pid=29351): Launched 17:31:57.852554 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:58.431681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29353): Launched 17:31:58.752633 run osmo-msc_10.42.42.6(pid=29354): Launched 17:31:58.934220 run osmo-stp_10.42.42.5(pid=29351): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29351)] 17:31:59.070577 run osmo-stp_10.42.42.5(pid=29351): stdout: | (launched: 2022-12-10_17:31:57.670589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:59.207436 run osmo-stp_10.42.42.5(pid=29351): stderr: | 20221210173157865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173157865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173157865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173157865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173157866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173157866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173157866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:59.343407 run osmo-stp_10.42.42.5(pid=29351): stdout: | (launched: 2022-12-10_17:31:57.670589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:59.471449 run osmo-stp_10.42.42.5(pid=29351): stderr: | 20221210173157865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173157865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173157865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173157865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173157866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173157866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173157866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:59.624722 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29351): Process ended prematurely: osmo-stp_10.42.42.5(pid=29351) [trial-2377↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29351)] [trial-2377↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 17:31:59.634609 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:31:59.662848 run osmo-hlr_10.42.42.2(pid=29348): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29348)] 17:31:59.712885 run osmo-hlr_10.42.42.2(pid=29348): stdout: | (launched: 2022-12-10_17:31:56.669222) 17:31:59.765221 run osmo-hlr_10.42.42.2(pid=29348): stderr: | 20221210173156869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173156869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173156869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173156869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173156869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173156870 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173156882 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173156890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173156890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173156890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:59.837247 run osmo-msc_10.42.42.6(pid=29354): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29354)] 17:31:59.887096 run osmo-msc_10.42.42.6(pid=29354): stdout: | (launched: 2022-12-10_17:31:58.693883) 17:31:59.938833 run osmo-msc_10.42.42.6(pid=29354): stderr: | 20221210173159014 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173159014 DLGLOBAL DEBUG validating counter group 0x7f455e9e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173159015 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173159015 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173159015 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173159015 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173159017 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173159018 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173159018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173159018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:59.990857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29347): Terminating (SIGTERM) 17:32:00.032634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29350): Terminating (SIGTERM) 17:32:00.074852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29353): Terminating (SIGTERM) 17:32:00.117121 --- ParallelTerminationStrategy: PID 29347 died... 17:32:00.137041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29347): Terminated: ok {rc=0} 17:32:00.183353 --- ParallelTerminationStrategy: PID 29350 died... 17:32:00.202767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29350): Terminated: ok {rc=0} 17:32:00.248908 --- ParallelTerminationStrategy: PID 29353 died... 17:32:00.268342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29353): Terminated: ok {rc=0} 17:32:00.354778 bus /sierra_3: Setting Powered False 17:32:01.454736 bus /sierra_3: Setting Powered False 17:32:02.584189 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 emergency:trx-b200 --------------------------------------------------------------------- 17:32:03.838726 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:32:03.843471 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 17:32:03.878242 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 17:32:03.905683 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 17:32:03.994443 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 17:32:04.028863 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 17:32:04.056227 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 17:32:04.636942 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2377 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 17:32:04.642388 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:04.653563 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 17:32:04.704090 tst emergency_mo_mt_call.py: using LAC 29507 17:32:04.827501 tst emergency_mo_mt_call.py: using RAC 182 17:32:04.952006 tst emergency_mo_mt_call.py: using CellId 29507 17:32:05.075206 tst emergency_mo_mt_call.py: using BVCI 29508 17:32:05.189723 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:05.200796 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:05.211679 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:05.222868 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:05.234284 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:05.245623 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:05.359145 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:05.472339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:32:05.931475 run create_hlr_db(pid=29359): Launched 17:32:06.054008 bus /sierra_2: Setting Powered False 17:32:07.113154 run create_hlr_db(pid=29359): Terminated: ok {rc=0} 17:32:07.545402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29361): Launched 17:32:07.863958 run osmo-hlr_10.42.42.2(pid=29362): Launched 17:32:07.984776 run osmo-stp_10.42.42.5: Starting osmo-stp 17:32:08.531224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29364): Launched 17:32:08.849513 run osmo-stp_10.42.42.5(pid=29365): Launched 17:32:08.980556 tst emergency_mo_mt_call.py: using MSISDN 7821 17:32:09.143241 run osmo-msc_10.42.42.6: Starting osmo-msc 17:32:09.710016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29367): Launched 17:32:10.025620 run osmo-msc_10.42.42.6(pid=29368): Launched 17:32:10.202630 run osmo-stp_10.42.42.5(pid=29365): ERR: Terminated: ERROR {rc=1} [trial-2377↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29365)] 17:32:10.336598 run osmo-stp_10.42.42.5(pid=29365): stdout: | (launched: 2022-12-10_17:32:08.791234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:10.471285 run osmo-stp_10.42.42.5(pid=29365): stderr: | 20221210173208982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173208983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173208983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173208983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173208984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173208984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173208984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:10.605446 run osmo-stp_10.42.42.5(pid=29365): stdout: | (launched: 2022-12-10_17:32:08.791234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:10.731557 run osmo-stp_10.42.42.5(pid=29365): stderr: | 20221210173208982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173208983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173208983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173208983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173208984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173208984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173208984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:10.882281 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=29365): Process ended prematurely: osmo-stp_10.42.42.5(pid=29365) [trial-2377↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29365)] [trial-2377↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 17:32:10.891501 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 17:32:10.919898 run osmo-hlr_10.42.42.2(pid=29362): ERR: Terminated: ERROR {rc=237} [trial-2377↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29362)] 17:32:10.970210 run osmo-hlr_10.42.42.2(pid=29362): stdout: | (launched: 2022-12-10_17:32:07.805932) 17:32:11.022275 run osmo-hlr_10.42.42.2(pid=29362): stderr: | 20221210173208001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173208002 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173208002 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173208002 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173208002 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173208002 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173208015 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173208026 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173208026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173208026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:32:11.095028 run osmo-msc_10.42.42.6(pid=29368): ERR: Terminated: ERROR {rc=2} [trial-2377↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29368)] 17:32:11.145473 run osmo-msc_10.42.42.6(pid=29368): stdout: | (launched: 2022-12-10_17:32:09.967327) 17:32:11.197333 run osmo-msc_10.42.42.6(pid=29368): stderr: | 20221210173210289 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173210289 DLGLOBAL DEBUG validating counter group 0x7fd30f6f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173210289 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173210289 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173210290 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173210290 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173210291 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173210292 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173210292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173210292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:32:11.249541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29361): Terminating (SIGTERM) 17:32:11.291409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29364): Terminating (SIGTERM) 17:32:11.333598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29367): Terminating (SIGTERM) 17:32:11.375832 --- ParallelTerminationStrategy: PID 29361 died... 17:32:11.395765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29361): Terminated: ok {rc=0} 17:32:11.442797 --- ParallelTerminationStrategy: PID 29364 died... 17:32:11.462226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29364): Terminated: ok {rc=0} 17:32:11.508550 --- ParallelTerminationStrategy: PID 29367 died... 17:32:11.528027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29367): Terminated: ok {rc=0} 17:32:11.615929 bus /sierra_3: Setting Powered False 17:32:12.712398 bus /sierra_3: Setting Powered False 17:32:13.828689 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 17:32:14.916164 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:14.928203 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 17:32:14.983045 tst emergency_preemptive_call.py: using LAC 29508 17:32:15.109358 tst emergency_preemptive_call.py: using RAC 183 17:32:15.233392 tst emergency_preemptive_call.py: using CellId 29508 17:32:15.357395 tst emergency_preemptive_call.py: using BVCI 29509 17:32:15.472003 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:15.483392 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:15.494477 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:15.505676 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:15.516817 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:15.528026 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:15.642210 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:15.760513 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:15.877286 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:16.000137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:32:16.504034 run create_hlr_db(pid=29370): Launched 17:32:16.666491 bus /sierra_2: Setting Powered False 17:32:17.729115 run create_hlr_db(pid=29370): Terminated: ok {rc=0} 17:32:18.154499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29372): Launched 17:32:18.450886 run osmo-hlr_10.42.42.2(pid=29373): Launched 17:32:18.563917 run osmo-stp_10.42.42.5: Starting osmo-stp 17:32:19.074078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29375): Launched 17:32:19.370047 run osmo-stp_10.42.42.5(pid=29376): Launched 17:32:19.495016 tst emergency_preemptive_call.py: using MSISDN 7822 17:32:19.645212 run osmo-msc_10.42.42.6: Starting osmo-msc 17:32:20.176009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29378): Launched 17:32:20.472480 run osmo-msc_10.42.42.6(pid=29379): Launched 17:32:20.639369 run osmo-stp_10.42.42.5(pid=29376): ERR: Terminated: ERROR {rc=1} [trial-2377↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29376)] 17:32:20.765713 run osmo-stp_10.42.42.5(pid=29376): stdout: | (launched: 2022-12-10_17:32:19.315133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:20.892233 run osmo-stp_10.42.42.5(pid=29376): stderr: | 20221210173219485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173219485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173219485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173219486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173219488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173219488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173219488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:21.015955 run osmo-stp_10.42.42.5(pid=29376): stdout: | (launched: 2022-12-10_17:32:19.315133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:21.133911 run osmo-stp_10.42.42.5(pid=29376): stderr: | 20221210173219485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173219485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173219485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173219486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173219488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173219488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173219488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:21.274465 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=29376): Process ended prematurely: osmo-stp_10.42.42.5(pid=29376) [trial-2377↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29376)] [trial-2377↪emergency:trx-b200↪emergency_preemptive_call.py:32] 17:32:21.282976 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 17:32:21.309395 run osmo-hlr_10.42.42.2(pid=29373): ERR: Terminated: ERROR {rc=237} [trial-2377↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29373)] 17:32:21.357821 run osmo-hlr_10.42.42.2(pid=29373): stdout: | (launched: 2022-12-10_17:32:18.396520) 17:32:21.407645 run osmo-hlr_10.42.42.2(pid=29373): stderr: | 20221210173218572 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173218572 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173218572 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173218572 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173218572 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173218573 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173218585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173218596 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173218596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173218596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:32:21.477530 run osmo-msc_10.42.42.6(pid=29379): ERR: Terminated: ERROR {rc=2} [trial-2377↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29379)] 17:32:21.525491 run osmo-msc_10.42.42.6(pid=29379): stdout: | (launched: 2022-12-10_17:32:20.417845) 17:32:21.575181 run osmo-msc_10.42.42.6(pid=29379): stderr: | 20221210173220688 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173220688 DLGLOBAL DEBUG validating counter group 0x7f40de7cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173220689 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173220689 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173220689 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173220689 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173220692 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173220692 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173220692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173220693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:32:21.625597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29372): Terminating (SIGTERM) 17:32:21.665638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29375): Terminating (SIGTERM) 17:32:21.705675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29378): Terminating (SIGTERM) 17:32:21.746141 --- ParallelTerminationStrategy: PID 29372 died... 17:32:21.765263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29372): Terminated: ok {rc=0} 17:32:21.809613 --- ParallelTerminationStrategy: PID 29375 died... 17:32:21.828216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29375): Terminated: ok {rc=0} 17:32:21.872258 --- ParallelTerminationStrategy: PID 29378 died... 17:32:21.891091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29378): Terminated: ok {rc=0} 17:32:21.977322 bus /sierra_9: Setting Powered False 17:32:23.077335 bus /sierra_9: Setting Powered False 17:32:24.193381 bus /sierra_8: Setting Powered False 17:32:25.292845 bus /sierra_8: Setting Powered False 17:32:26.408089 bus /sierra_3: Setting Powered False 17:32:27.508769 bus /sierra_3: Setting Powered False 17:32:28.625334 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-b200 --------------------------------------------------------------------- 17:32:29.903811 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:32:29.908081 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 17:32:29.941135 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 17:32:29.979634 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 17:32:30.066484 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 17:32:30.099014 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 17:32:30.136580 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 17:32:30.725687 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 17:32:30.774695 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:30.785357 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 17:32:30.841213 tst cs_paging_gprs_active.py: using LAC 29509 17:32:30.995261 tst cs_paging_gprs_active.py: using RAC 184 17:32:31.128534 tst cs_paging_gprs_active.py: using CellId 29509 17:32:31.280838 tst cs_paging_gprs_active.py: using BVCI 29510 17:32:31.394045 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:31.404708 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:31.416159 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:31.428455 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:31.439268 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:31.450503 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:31.461852 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:31.472661 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:31.484101 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:31.599572 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:31.743803 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:32:31.992578 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:32.309201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29385): Launched 17:32:32.592880 run iperf3-srv_10.42.42.10(pid=29386): Launched 17:32:32.717097 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:32:32.934765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:33.258846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29387): Launched 17:32:33.542168 run iperf3-srv_10.42.42.10(pid=29388): Launched 17:32:33.665675 tst cs_paging_gprs_active.py:38: start network... 17:32:33.882533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:32:34.382604 run create_hlr_db(pid=29389): Launched 17:32:34.508144 bus /sierra_2: Setting Powered False 17:32:35.571396 run create_hlr_db(pid=29389): Terminated: ok {rc=0} 17:32:36.022680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29392): Launched 17:32:36.325878 run osmo-hlr_10.42.42.2(pid=29393): Launched 17:32:36.441715 run osmo-stp_10.42.42.5: Starting osmo-stp 17:32:36.976135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29395): Launched 17:32:37.278543 run osmo-stp_10.42.42.5(pid=29396): Launched 17:32:37.393977 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:32:37.918069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29398): Launched 17:32:38.034354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:32:38.289718 run patchelf(pid=29399): Launched 17:32:38.459019 run osmo-stp_10.42.42.5(pid=29396): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29396)] 17:32:38.589260 run osmo-stp_10.42.42.5(pid=29396): stdout: | (launched: 2022-12-10_17:32:37.222436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:38.718468 run osmo-stp_10.42.42.5(pid=29396): stderr: | 20221210173237393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173237393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173237393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173237394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173237394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173237394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173237394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:38.847837 run osmo-stp_10.42.42.5(pid=29396): stdout: | (launched: 2022-12-10_17:32:37.222436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:38.971595 run osmo-stp_10.42.42.5(pid=29396): stderr: | 20221210173237393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173237393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173237393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173237394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173237394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173237394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173237394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:39.118602 run patchelf(pid=29399): Terminating (SIGINT) 17:32:39.287409 run patchelf(pid=29399): Terminated: ok {rc=0} 17:32:39.408789 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29396): Process ended prematurely: osmo-stp_10.42.42.5(pid=29396) [trial-2377↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29396)] [trial-2377↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 17:32:39.418380 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:32:39.445194 run osmo-hlr_10.42.42.2(pid=29393): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29393)] 17:32:39.492631 run osmo-hlr_10.42.42.2(pid=29393): stdout: | (launched: 2022-12-10_17:32:36.269850) 17:32:39.541359 run osmo-hlr_10.42.42.2(pid=29393): stderr: | 20221210173236446 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173236446 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173236446 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173236446 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173236446 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173236446 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173236459 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173236468 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173236468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173236468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:32:39.590608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29385): Terminating (SIGTERM) 17:32:39.630194 run iperf3-srv_10.42.42.10(pid=29386): Terminating (SIGTERM) 17:32:39.669600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29387): Terminating (SIGTERM) 17:32:39.708920 run iperf3-srv_10.42.42.10(pid=29388): Terminating (SIGTERM) 17:32:39.748169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29392): Terminating (SIGTERM) 17:32:39.787443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29395): Terminating (SIGTERM) 17:32:39.826905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29398): Terminating (SIGTERM) 17:32:39.866842 --- ParallelTerminationStrategy: PID 29385 died... 17:32:39.885887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29385): Terminated: ok {rc=0} 17:32:39.929771 --- ParallelTerminationStrategy: PID 29386 died... 17:32:39.948313 run iperf3-srv_10.42.42.10(pid=29386): Terminated {rc=256} 17:32:39.992140 --- ParallelTerminationStrategy: PID 29387 died... 17:32:40.010411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29387): Terminated: ok {rc=0} 17:32:40.054547 --- ParallelTerminationStrategy: PID 29388 died... 17:32:40.073144 run iperf3-srv_10.42.42.10(pid=29388): Terminated {rc=256} 17:32:40.116447 --- ParallelTerminationStrategy: PID 29392 died... 17:32:40.135032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29392): Terminated: ok {rc=0} 17:32:40.178329 --- ParallelTerminationStrategy: PID 29395 died... 17:32:40.196712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29395): Terminated: ok {rc=0} 17:32:40.240357 --- ParallelTerminationStrategy: PID 29398 died... 17:32:40.258930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29398): Terminated: ok {rc=0} 17:32:40.343848 bus /gobi_0: Setting Powered False 17:32:41.442494 bus /gobi_0: Setting Powered False 17:32:42.557238 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200 iperf3.py ---------------------------------------------- 17:32:43.703650 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:43.714844 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 17:32:43.766979 tst iperf3.py: using LAC 29510 17:32:43.887760 tst iperf3.py: using RAC 185 17:32:44.007815 tst iperf3.py: using CellId 29510 17:32:44.126630 tst iperf3.py: using BVCI 29511 17:32:44.237554 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:44.248089 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:44.258456 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:44.268683 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:44.278925 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:44.289166 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:44.299554 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:44.309909 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:44.320267 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:44.433119 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:32:44.635190 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:44.937525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29400): Launched 17:32:45.200182 run iperf3-srv_10.42.42.10(pid=29401): Launched 17:32:45.314154 tst iperf3.py:8: start network... 17:32:45.515659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:32:45.993171 run create_hlr_db(pid=29402): Launched 17:32:46.151690 bus /gobi_6: Setting Powered False 17:32:47.221341 run create_hlr_db(pid=29402): Terminated: ok {rc=0} 17:32:47.659412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29404): Launched 17:32:47.960260 run osmo-hlr_10.42.42.2(pid=29405): Launched 17:32:48.074444 run osmo-stp_10.42.42.5: Starting osmo-stp 17:32:48.610929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29407): Launched 17:32:48.914092 run osmo-stp_10.42.42.5(pid=29408): Launched 17:32:49.028721 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:32:49.548839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29410): Launched 17:32:49.664491 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:32:49.922138 run patchelf(pid=29411): Launched 17:32:50.090645 run osmo-stp_10.42.42.5(pid=29408): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29408)] 17:32:50.218780 run osmo-stp_10.42.42.5(pid=29408): stdout: | (launched: 2022-12-10_17:32:48.858189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:50.348120 run osmo-stp_10.42.42.5(pid=29408): stderr: | 20221210173249031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173249031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173249031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173249032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173249032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173249032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173249032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:50.477278 run osmo-stp_10.42.42.5(pid=29408): stdout: | (launched: 2022-12-10_17:32:48.858189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:50.600841 run osmo-stp_10.42.42.5(pid=29408): stderr: | 20221210173249031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173249031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173249031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173249032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173249032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173249032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173249032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:50.747052 run patchelf(pid=29411): Terminating (SIGINT) 17:32:50.915853 run patchelf(pid=29411): Terminated: ok {rc=0} 17:32:51.037096 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29408): Process ended prematurely: osmo-stp_10.42.42.5(pid=29408) [trial-2377↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29408)] [trial-2377↪gprs:trx-b200↪iperf3.py:8] 17:32:51.046747 tst iperf3.py:8: Test FAILED (7.4 sec) 17:32:51.073545 run osmo-hlr_10.42.42.2(pid=29405): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29405)] 17:32:51.120739 run osmo-hlr_10.42.42.2(pid=29405): stdout: | (launched: 2022-12-10_17:32:47.904309) 17:32:51.169499 run osmo-hlr_10.42.42.2(pid=29405): stderr: | 20221210173248083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173248083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173248083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173248083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173248084 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173248084 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173248096 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173248105 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173248105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173248105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:32:51.218599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29400): Terminating (SIGTERM) 17:32:51.258245 run iperf3-srv_10.42.42.10(pid=29401): Terminating (SIGTERM) 17:32:51.297608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29404): Terminating (SIGTERM) 17:32:51.336898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29407): Terminating (SIGTERM) 17:32:51.376179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29410): Terminating (SIGTERM) 17:32:51.415786 --- ParallelTerminationStrategy: PID 29400 died... 17:32:51.434896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29400): Terminated: ok {rc=0} 17:32:51.478523 --- ParallelTerminationStrategy: PID 29401 died... 17:32:51.496979 run iperf3-srv_10.42.42.10(pid=29401): Terminated {rc=256} 17:32:51.540385 --- ParallelTerminationStrategy: PID 29404 died... 17:32:51.558969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29404): Terminated: ok {rc=0} 17:32:51.602376 --- ParallelTerminationStrategy: PID 29407 died... 17:32:51.620775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29407): Terminated: ok {rc=0} 17:32:51.664025 --- ParallelTerminationStrategy: PID 29410 died... 17:32:51.682561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29410): Terminated: ok {rc=0} 17:32:51.767646 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 17:32:52.913793 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:52.925098 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 17:32:52.975709 tst iperf3m4.py: using LAC 29511 17:32:53.095070 tst iperf3m4.py: using RAC 186 17:32:53.214886 tst iperf3m4.py: using CellId 29511 17:32:53.337315 tst iperf3m4.py: using BVCI 29512 17:32:53.448250 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:53.458944 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:53.469328 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:53.479621 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:53.489894 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:53.500075 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:53.510520 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:53.520780 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:53.531227 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:53.649688 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:53.773355 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:53.892324 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:54.013646 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:32:54.231977 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:54.555649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29412): Launched 17:32:54.839749 run iperf3-srv_10.42.42.10(pid=29413): Launched 17:32:54.962020 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:32:55.180315 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:55.505851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29414): Launched 17:32:55.786983 run iperf3-srv_10.42.42.10(pid=29415): Launched 17:32:55.910472 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:32:56.128522 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:56.453534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29416): Launched 17:32:56.735193 run iperf3-srv_10.42.42.10(pid=29417): Launched 17:32:56.858665 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:32:57.075983 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:57.401462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29418): Launched 17:32:57.683933 run iperf3-srv_10.42.42.10(pid=29419): Launched 17:32:57.806025 tst iperf3m4.py:8: start network... 17:32:58.023412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:32:58.526728 run create_hlr_db(pid=29420): Launched 17:32:58.652533 bus /gobi_6: Setting Powered False 17:32:59.716628 run create_hlr_db(pid=29420): Terminated: ok {rc=0} 17:33:00.148244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29422): Launched 17:33:00.452644 run osmo-hlr_10.42.42.2(pid=29423): Launched 17:33:00.568718 run osmo-stp_10.42.42.5: Starting osmo-stp 17:33:01.160653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29425): Launched 17:33:01.479225 run osmo-stp_10.42.42.5(pid=29427): Launched 17:33:01.754216 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:33:02.394163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29429): Launched 17:33:02.519870 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:33:02.792225 run patchelf(pid=29430): Launched 17:33:02.973693 run osmo-stp_10.42.42.5(pid=29427): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29427)] 17:33:03.111411 run osmo-stp_10.42.42.5(pid=29427): stdout: | (launched: 2022-12-10_17:33:01.422382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:03.250240 run osmo-stp_10.42.42.5(pid=29427): stderr: | 20221210173301663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173301663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173301664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173301664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173301665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173301665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173301665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:03.389024 run osmo-stp_10.42.42.5(pid=29427): stdout: | (launched: 2022-12-10_17:33:01.422382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:03.521996 run osmo-stp_10.42.42.5(pid=29427): stderr: | 20221210173301663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173301663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173301664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173301664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173301665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173301665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173301665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:03.679846 run patchelf(pid=29430): Terminating (SIGINT) 17:33:03.860428 run patchelf(pid=29430): Terminated: ok {rc=0} 17:33:03.991190 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29427): Process ended prematurely: osmo-stp_10.42.42.5(pid=29427) [trial-2377↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29427)] [trial-2377↪gprs:trx-b200↪iperf3m4.py:8] 17:33:04.001565 tst iperf3m4.py:8: Test FAILED (11.1 sec) 17:33:04.031203 run osmo-hlr_10.42.42.2(pid=29423): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29423)] 17:33:04.082202 run osmo-hlr_10.42.42.2(pid=29423): stdout: | (launched: 2022-12-10_17:33:00.396816) 17:33:04.134800 run osmo-hlr_10.42.42.2(pid=29423): stderr: | 20221210173300571 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173300571 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173300572 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173300572 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173300572 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173300572 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173300584 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173300593 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173300593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173300593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:33:04.187596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29412): Terminating (SIGTERM) 17:33:04.230141 run iperf3-srv_10.42.42.10(pid=29413): Terminating (SIGTERM) 17:33:04.273047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29414): Terminating (SIGTERM) 17:33:04.315467 run iperf3-srv_10.42.42.10(pid=29415): Terminating (SIGTERM) 17:33:04.357825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29416): Terminating (SIGTERM) 17:33:04.400176 run iperf3-srv_10.42.42.10(pid=29417): Terminating (SIGTERM) 17:33:04.442338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29418): Terminating (SIGTERM) 17:33:04.484251 run iperf3-srv_10.42.42.10(pid=29419): Terminating (SIGTERM) 17:33:04.526307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29422): Terminating (SIGTERM) 17:33:04.568071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29425): Terminating (SIGTERM) 17:33:04.609978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29429): Terminating (SIGTERM) 17:33:04.652214 --- ParallelTerminationStrategy: PID 29412 died... 17:33:04.671736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29412): Terminated: ok {rc=0} 17:33:04.718370 --- ParallelTerminationStrategy: PID 29413 died... 17:33:04.737985 run iperf3-srv_10.42.42.10(pid=29413): Terminated {rc=256} 17:33:04.784396 --- ParallelTerminationStrategy: PID 29414 died... 17:33:04.804000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29414): Terminated: ok {rc=0} 17:33:04.850450 --- ParallelTerminationStrategy: PID 29415 died... 17:33:04.869974 run iperf3-srv_10.42.42.10(pid=29415): Terminated {rc=256} 17:33:04.916248 --- ParallelTerminationStrategy: PID 29416 died... 17:33:04.935637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29416): Terminated: ok {rc=0} 17:33:04.981962 --- ParallelTerminationStrategy: PID 29417 died... 17:33:05.001572 run iperf3-srv_10.42.42.10(pid=29417): Terminated {rc=256} 17:33:05.048308 --- ParallelTerminationStrategy: PID 29418 died... 17:33:05.067893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29418): Terminated: ok {rc=0} 17:33:05.114584 --- ParallelTerminationStrategy: PID 29419 died... 17:33:05.134117 run iperf3-srv_10.42.42.10(pid=29419): Terminated {rc=256} 17:33:05.180359 --- ParallelTerminationStrategy: PID 29422 died... 17:33:05.200069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29422): Terminated: ok {rc=0} 17:33:05.246310 --- ParallelTerminationStrategy: PID 29425 died... 17:33:05.266071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29425): Terminated: ok {rc=0} 17:33:05.312527 --- ParallelTerminationStrategy: PID 29429 died... 17:33:05.332281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29429): Terminated: ok {rc=0} 17:33:05.420912 bus /gobi_4: Setting Powered False 17:33:06.519635 bus /gobi_4: Setting Powered False 17:33:07.635259 bus /gobi_1: Setting Powered False 17:33:08.733334 bus /gobi_1: Setting Powered False 17:33:09.851778 bus /gobi_0: Setting Powered False 17:33:10.950820 bus /gobi_0: Setting Powered False 17:33:12.066538 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200 ping.py ---------------------------------------------- 17:33:13.170522 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:13.181855 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 17:33:13.230257 tst ping.py: using LAC 29512 17:33:13.346658 tst ping.py: using RAC 187 17:33:13.465059 tst ping.py: using CellId 29512 17:33:13.580682 tst ping.py: using BVCI 29513 17:33:13.687814 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:13.698487 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:13.708917 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:13.719356 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:13.729653 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:13.739977 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:13.750530 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:13.760904 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:33:13.873762 tst ping.py:19: start network... 17:33:14.071065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:33:14.532189 run create_hlr_db(pid=29431): Launched 17:33:14.653354 bus /gobi_6: Setting Powered False 17:33:15.713040 run create_hlr_db(pid=29431): Terminated: ok {rc=0} 17:33:16.208747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29433): Launched 17:33:16.526460 run osmo-hlr_10.42.42.2(pid=29434): Launched 17:33:16.766353 run osmo-stp_10.42.42.5: Starting osmo-stp 17:33:17.548093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29436): Launched 17:33:17.846994 run osmo-stp_10.42.42.5(pid=29437): Launched 17:33:17.959326 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:33:18.468750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29439): Launched 17:33:18.582279 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:33:18.832340 run patchelf(pid=29440): Launched 17:33:18.997954 run osmo-stp_10.42.42.5(pid=29437): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29437)] 17:33:19.123870 run osmo-stp_10.42.42.5(pid=29437): stdout: | (launched: 2022-12-10_17:33:17.791691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:19.250930 run osmo-stp_10.42.42.5(pid=29437): stderr: | 20221210173317962 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173317962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173317962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173317962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173317963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173317963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173317963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:19.377834 run osmo-stp_10.42.42.5(pid=29437): stdout: | (launched: 2022-12-10_17:33:17.791691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:19.499501 run osmo-stp_10.42.42.5(pid=29437): stderr: | 20221210173317962 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173317962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173317962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173317962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173317963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173317963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173317963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:19.644176 run patchelf(pid=29440): Terminating (SIGINT) 17:33:19.810443 run patchelf(pid=29440): Terminated: ok {rc=0} 17:33:19.930445 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29437): Process ended prematurely: osmo-stp_10.42.42.5(pid=29437) [trial-2377↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29437)] [trial-2377↪gprs:trx-b200↪ping.py:22] 17:33:19.939179 tst ping.py:22: Test FAILED (6.8 sec) 17:33:19.966114 run osmo-hlr_10.42.42.2(pid=29434): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29434)] 17:33:20.013767 run osmo-hlr_10.42.42.2(pid=29434): stdout: | (launched: 2022-12-10_17:33:16.471257) 17:33:20.063149 run osmo-hlr_10.42.42.2(pid=29434): stderr: | 20221210173316687 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173316687 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173316687 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173316687 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173316687 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173316687 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173316709 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173316724 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173316724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173316724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:33:20.112915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29433): Terminating (SIGTERM) 17:33:20.152604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29436): Terminating (SIGTERM) 17:33:20.192411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29439): Terminating (SIGTERM) 17:33:20.232547 --- ParallelTerminationStrategy: PID 29433 died... 17:33:20.251550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29433): Terminated: ok {rc=0} 17:33:20.295358 --- ParallelTerminationStrategy: PID 29436 died... 17:33:20.314107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29436): Terminated: ok {rc=0} 17:33:20.357758 --- ParallelTerminationStrategy: PID 29439 died... 17:33:20.376668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29439): Terminated: ok {rc=0} 17:33:20.460605 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 17:33:21.547439 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:21.559381 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 17:33:21.613381 tst ping_idle_ping.py: using LAC 29513 17:33:21.738213 tst ping_idle_ping.py: using RAC 188 17:33:21.862196 tst ping_idle_ping.py: using CellId 29513 17:33:21.986449 tst ping_idle_ping.py: using BVCI 29514 17:33:22.102125 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:22.113268 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:22.124233 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:22.135844 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:22.147379 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:22.159026 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:22.171075 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:22.182799 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:33:22.300806 tst ping_idle_ping.py:24: start network... 17:33:22.514288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:33:23.007643 run create_hlr_db(pid=29441): Launched 17:33:23.128814 bus /gobi_6: Setting Powered False 17:33:24.192267 run create_hlr_db(pid=29441): Terminated: ok {rc=0} 17:33:24.618548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29443): Launched 17:33:24.915814 run osmo-hlr_10.42.42.2(pid=29444): Launched 17:33:25.028374 run osmo-stp_10.42.42.5: Starting osmo-stp 17:33:25.575688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29446): Launched 17:33:25.892908 run osmo-stp_10.42.42.5(pid=29447): Launched 17:33:26.014103 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:33:26.562408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29449): Launched 17:33:26.685942 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:33:26.953349 run patchelf(pid=29450): Launched 17:33:27.132123 run osmo-stp_10.42.42.5(pid=29447): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29447)] 17:33:27.266834 run osmo-stp_10.42.42.5(pid=29447): stdout: | (launched: 2022-12-10_17:33:25.834980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:27.402994 run osmo-stp_10.42.42.5(pid=29447): stderr: | 20221210173326026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173326026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173326027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173326027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173326027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173326027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173326028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:27.539450 run osmo-stp_10.42.42.5(pid=29447): stdout: | (launched: 2022-12-10_17:33:25.834980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:27.669530 run osmo-stp_10.42.42.5(pid=29447): stderr: | 20221210173326026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173326026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173326027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173326027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173326027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173326027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173326028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:27.823719 run patchelf(pid=29450): Terminating (SIGINT) 17:33:28.001128 run patchelf(pid=29450): Terminated: ok {rc=0} 17:33:28.129563 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29447): Process ended prematurely: osmo-stp_10.42.42.5(pid=29447) [trial-2377↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29447)] [trial-2377↪gprs:trx-b200↪ping_idle_ping.py:27] 17:33:28.139177 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 17:33:28.167701 run osmo-hlr_10.42.42.2(pid=29444): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29444)] 17:33:28.217876 run osmo-hlr_10.42.42.2(pid=29444): stdout: | (launched: 2022-12-10_17:33:24.861584) 17:33:28.269588 run osmo-hlr_10.42.42.2(pid=29444): stderr: | 20221210173325035 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173325035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173325035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173325035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173325035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173325035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173325050 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173325060 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173325060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173325060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:33:28.321486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29443): Terminating (SIGTERM) 17:33:28.363262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29446): Terminating (SIGTERM) 17:33:28.404885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29449): Terminating (SIGTERM) 17:33:28.446908 --- ParallelTerminationStrategy: PID 29443 died... 17:33:28.466912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29443): Terminated: ok {rc=0} 17:33:28.513162 --- ParallelTerminationStrategy: PID 29446 died... 17:33:28.532384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29446): Terminated: ok {rc=0} 17:33:28.578690 --- ParallelTerminationStrategy: PID 29449 died... 17:33:28.598499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29449): Terminated: ok {rc=0} 17:33:28.686756 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 17:33:29.991491 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:33:29.998683 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:33:30.034565 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:33:30.074148 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:33:30.162852 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:33:30.196755 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:33:30.238549 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:33:30.837474 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:33:30.900246 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:30.912759 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:33:30.967684 tst cs_paging_gprs_active.py: using LAC 29514 17:33:31.100002 tst cs_paging_gprs_active.py: using RAC 189 17:33:31.229995 tst cs_paging_gprs_active.py: using CellId 29514 17:33:31.402451 tst cs_paging_gprs_active.py: using BVCI 29515 17:33:31.523336 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:31.537987 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:31.554781 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:31.570745 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:31.587371 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:31.603756 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:31.619300 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:31.635590 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:31.651531 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:31.799172 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:31.930232 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:33:32.138387 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:32.446031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29455): Launched 17:33:32.714248 run iperf3-srv_10.42.42.10(pid=29456): Launched 17:33:32.828840 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:33:33.032383 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:33.336778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29457): Launched 17:33:33.604197 run iperf3-srv_10.42.42.10(pid=29458): Launched 17:33:33.719153 tst cs_paging_gprs_active.py:38: start network... 17:33:33.921795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:33:34.390142 run create_hlr_db(pid=29459): Launched 17:33:34.516407 bus /gobi_6: Setting Powered False 17:33:35.579480 run create_hlr_db(pid=29459): Terminated: ok {rc=0} 17:33:36.028075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29461): Launched 17:33:36.352030 run osmo-hlr_10.42.42.2(pid=29462): Launched 17:33:36.475462 run osmo-stp_10.42.42.5: Starting osmo-stp 17:33:37.036884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29464): Launched 17:33:37.361042 run osmo-stp_10.42.42.5(pid=29465): Launched 17:33:37.485210 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:33:38.042252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29467): Launched 17:33:38.169047 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:33:38.442125 run patchelf(pid=29468): Launched 17:33:38.624634 run osmo-stp_10.42.42.5(pid=29465): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29465)] 17:33:38.761913 run osmo-stp_10.42.42.5(pid=29465): stdout: | (launched: 2022-12-10_17:33:37.301898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:38.899860 run osmo-stp_10.42.42.5(pid=29465): stderr: | 20221210173337496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173337496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173337497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173337497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173337497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173337498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173337498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:39.038805 run osmo-stp_10.42.42.5(pid=29465): stdout: | (launched: 2022-12-10_17:33:37.301898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:39.172090 run osmo-stp_10.42.42.5(pid=29465): stderr: | 20221210173337496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173337496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173337497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173337497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173337497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173337498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173337498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:39.330077 run patchelf(pid=29468): Terminating (SIGINT) 17:33:39.511209 run patchelf(pid=29468): Terminated: ok {rc=0} 17:33:39.641420 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29465): Process ended prematurely: osmo-stp_10.42.42.5(pid=29465) [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29465)] [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:33:39.651538 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 17:33:39.680512 run osmo-hlr_10.42.42.2(pid=29462): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29462)] 17:33:39.731082 run osmo-hlr_10.42.42.2(pid=29462): stdout: | (launched: 2022-12-10_17:33:36.292781) 17:33:39.782810 run osmo-hlr_10.42.42.2(pid=29462): stderr: | 20221210173336492 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173336492 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173336492 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173336492 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173336492 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173336492 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173336504 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173336512 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173336513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173336513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:33:39.834986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29455): Terminating (SIGTERM) 17:33:39.876906 run iperf3-srv_10.42.42.10(pid=29456): Terminating (SIGTERM) 17:33:39.918776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29457): Terminating (SIGTERM) 17:33:39.960569 run iperf3-srv_10.42.42.10(pid=29458): Terminating (SIGTERM) 17:33:40.002490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29461): Terminating (SIGTERM) 17:33:40.044413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29464): Terminating (SIGTERM) 17:33:40.086508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29467): Terminating (SIGTERM) 17:33:40.128809 --- ParallelTerminationStrategy: PID 29455 died... 17:33:40.148752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29455): Terminated: ok {rc=0} 17:33:40.195088 --- ParallelTerminationStrategy: PID 29456 died... 17:33:40.214657 run iperf3-srv_10.42.42.10(pid=29456): Terminated {rc=256} 17:33:40.260782 --- ParallelTerminationStrategy: PID 29457 died... 17:33:40.280517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29457): Terminated: ok {rc=0} 17:33:40.326855 --- ParallelTerminationStrategy: PID 29458 died... 17:33:40.346333 run iperf3-srv_10.42.42.10(pid=29458): Terminated {rc=256} 17:33:40.392387 --- ParallelTerminationStrategy: PID 29461 died... 17:33:40.411842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29461): Terminated: ok {rc=0} 17:33:40.458064 --- ParallelTerminationStrategy: PID 29464 died... 17:33:40.477385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29464): Terminated: ok {rc=0} 17:33:40.523606 --- ParallelTerminationStrategy: PID 29467 died... 17:33:40.543153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29467): Terminated: ok {rc=0} 17:33:40.630726 bus /gobi_0: Setting Powered False 17:33:41.729246 bus /gobi_0: Setting Powered False 17:33:42.844516 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:33:43.992452 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:44.004416 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:33:44.058570 tst iperf3.py: using LAC 29515 17:33:44.186899 tst iperf3.py: using RAC 190 17:33:44.314143 tst iperf3.py: using CellId 29515 17:33:44.440143 tst iperf3.py: using BVCI 29516 17:33:44.557741 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:44.569633 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:44.580766 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:44.592094 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:44.603369 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:44.614643 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:44.626183 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:44.637367 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:44.648768 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:44.767417 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:33:44.985132 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:45.310156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29469): Launched 17:33:45.594089 run iperf3-srv_10.42.42.10(pid=29470): Launched 17:33:45.715814 tst iperf3.py:8: start network... 17:33:45.957553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:33:46.441726 run create_hlr_db(pid=29471): Launched 17:33:46.605569 bus /gobi_6: Setting Powered False 17:33:47.666246 run create_hlr_db(pid=29471): Terminated: ok {rc=0} 17:33:48.106331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29473): Launched 17:33:48.430492 run osmo-hlr_10.42.42.2(pid=29474): Launched 17:33:48.553247 run osmo-stp_10.42.42.5: Starting osmo-stp 17:33:49.108555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29476): Launched 17:33:49.433653 run osmo-stp_10.42.42.5(pid=29477): Launched 17:33:49.556738 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:33:50.112616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29479): Launched 17:33:50.237040 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:33:50.509237 run patchelf(pid=29480): Launched 17:33:50.689284 run osmo-stp_10.42.42.5(pid=29477): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29477)] 17:33:50.825712 run osmo-stp_10.42.42.5(pid=29477): stdout: | (launched: 2022-12-10_17:33:49.374223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:50.963590 run osmo-stp_10.42.42.5(pid=29477): stderr: | 20221210173349566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173349566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173349566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173349566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173349569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173349569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173349569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:51.102016 run osmo-stp_10.42.42.5(pid=29477): stdout: | (launched: 2022-12-10_17:33:49.374223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:51.235009 run osmo-stp_10.42.42.5(pid=29477): stderr: | 20221210173349566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173349566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173349566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173349566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173349569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173349569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173349569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:51.391441 run patchelf(pid=29480): Terminating (SIGINT) 17:33:51.571907 run patchelf(pid=29480): Terminated: ok {rc=0} 17:33:51.701866 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29477): Process ended prematurely: osmo-stp_10.42.42.5(pid=29477) [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29477)] [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 17:33:51.712006 tst iperf3.py:8: Test FAILED (7.8 sec) 17:33:51.741115 run osmo-hlr_10.42.42.2(pid=29474): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29474)] 17:33:51.791051 run osmo-hlr_10.42.42.2(pid=29474): stdout: | (launched: 2022-12-10_17:33:48.371689) 17:33:51.842949 run osmo-hlr_10.42.42.2(pid=29474): stderr: | 20221210173348569 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173348569 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173348569 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173348569 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173348569 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173348569 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173348580 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173348589 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173348589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173348589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:33:51.895235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29469): Terminating (SIGTERM) 17:33:51.937156 run iperf3-srv_10.42.42.10(pid=29470): Terminating (SIGTERM) 17:33:51.978544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29473): Terminating (SIGTERM) 17:33:52.020682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29476): Terminating (SIGTERM) 17:33:52.062630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29479): Terminating (SIGTERM) 17:33:52.104613 --- ParallelTerminationStrategy: PID 29469 died... 17:33:52.124798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29469): Terminated: ok {rc=0} 17:33:52.171644 --- ParallelTerminationStrategy: PID 29470 died... 17:33:52.191139 run iperf3-srv_10.42.42.10(pid=29470): Terminated {rc=256} 17:33:52.237958 --- ParallelTerminationStrategy: PID 29473 died... 17:33:52.257371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29473): Terminated: ok {rc=0} 17:33:52.303451 --- ParallelTerminationStrategy: PID 29476 died... 17:33:52.322792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29476): Terminated: ok {rc=0} 17:33:52.369044 --- ParallelTerminationStrategy: PID 29479 died... 17:33:52.388487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29479): Terminated: ok {rc=0} 17:33:52.476049 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:33:53.625242 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:53.637494 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:33:53.689453 tst iperf3m4.py: using LAC 29516 17:33:53.816489 tst iperf3m4.py: using RAC 191 17:33:53.942366 tst iperf3m4.py: using CellId 29516 17:33:54.068286 tst iperf3m4.py: using BVCI 29517 17:33:54.178613 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:54.190002 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:54.200656 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:54.211371 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:54.221893 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:54.232493 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:54.243282 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:54.254006 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:54.264881 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:54.384940 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:54.503346 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:54.622024 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:54.741337 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:33:54.943943 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:55.246846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29481): Launched 17:33:55.510386 run iperf3-srv_10.42.42.10(pid=29482): Launched 17:33:55.625937 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:33:55.827543 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:56.129571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29483): Launched 17:33:56.391904 run iperf3-srv_10.42.42.10(pid=29484): Launched 17:33:56.505640 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:33:56.707008 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:57.009314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29485): Launched 17:33:57.271919 run iperf3-srv_10.42.42.10(pid=29486): Launched 17:33:57.385573 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:33:57.586684 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:57.888820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29487): Launched 17:33:58.151776 run iperf3-srv_10.42.42.10(pid=29488): Launched 17:33:58.264664 tst iperf3m4.py:8: start network... 17:33:58.465361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:33:58.932607 run create_hlr_db(pid=29489): Launched 17:33:59.056214 bus /gobi_6: Setting Powered False 17:34:00.117163 run create_hlr_db(pid=29489): Terminated: ok {rc=0} 17:34:00.558511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29491): Launched 17:34:00.892599 run osmo-hlr_10.42.42.2(pid=29492): Launched 17:34:01.124808 run osmo-stp_10.42.42.5: Starting osmo-stp 17:34:01.854219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29494): Launched 17:34:02.182409 run osmo-stp_10.42.42.5(pid=29495): Launched 17:34:02.467281 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:34:03.028474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29497): Launched 17:34:03.153491 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:34:03.427880 run patchelf(pid=29498): Launched 17:34:03.610186 run osmo-stp_10.42.42.5(pid=29495): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29495)] 17:34:03.747036 run osmo-stp_10.42.42.5(pid=29495): stdout: | (launched: 2022-12-10_17:34:02.123051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:03.885413 run osmo-stp_10.42.42.5(pid=29495): stderr: | 20221210173402310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173402311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173402311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173402312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173402312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173402313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173402313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:04.023601 run osmo-stp_10.42.42.5(pid=29495): stdout: | (launched: 2022-12-10_17:34:02.123051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:04.156379 run osmo-stp_10.42.42.5(pid=29495): stderr: | 20221210173402310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173402311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173402311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173402312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173402312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173402313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173402313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:04.313717 run patchelf(pid=29498): Terminating (SIGINT) 17:34:04.494918 run patchelf(pid=29498): Terminated: ok {rc=0} 17:34:04.625450 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29495): Process ended prematurely: osmo-stp_10.42.42.5(pid=29495) [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29495)] [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 17:34:04.635676 tst iperf3m4.py:8: Test FAILED (11.0 sec) 17:34:04.665360 run osmo-hlr_10.42.42.2(pid=29492): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29492)] 17:34:04.716033 run osmo-hlr_10.42.42.2(pid=29492): stdout: | (launched: 2022-12-10_17:34:00.825084) 17:34:04.768139 run osmo-hlr_10.42.42.2(pid=29492): stderr: | 20221210173401148 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173401148 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173401148 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173401148 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173401148 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173401148 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173401166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173401184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173401184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173401184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:34:04.820786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29481): Terminating (SIGTERM) 17:34:04.863153 run iperf3-srv_10.42.42.10(pid=29482): Terminating (SIGTERM) 17:34:04.905418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29483): Terminating (SIGTERM) 17:34:04.947753 run iperf3-srv_10.42.42.10(pid=29484): Terminating (SIGTERM) 17:34:04.989712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29485): Terminating (SIGTERM) 17:34:05.031992 run iperf3-srv_10.42.42.10(pid=29486): Terminating (SIGTERM) 17:34:05.074138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29487): Terminating (SIGTERM) 17:34:05.116331 run iperf3-srv_10.42.42.10(pid=29488): Terminating (SIGTERM) 17:34:05.158700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29491): Terminating (SIGTERM) 17:34:05.200936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29494): Terminating (SIGTERM) 17:34:05.243091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29497): Terminating (SIGTERM) 17:34:05.285478 --- ParallelTerminationStrategy: PID 29481 died... 17:34:05.305465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29481): Terminated: ok {rc=0} 17:34:05.352256 --- ParallelTerminationStrategy: PID 29482 died... 17:34:05.371866 run iperf3-srv_10.42.42.10(pid=29482): Terminated {rc=256} 17:34:05.418464 --- ParallelTerminationStrategy: PID 29483 died... 17:34:05.438099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29483): Terminated: ok {rc=0} 17:34:05.484696 --- ParallelTerminationStrategy: PID 29484 died... 17:34:05.504311 run iperf3-srv_10.42.42.10(pid=29484): Terminated {rc=256} 17:34:05.550838 --- ParallelTerminationStrategy: PID 29485 died... 17:34:05.570537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29485): Terminated: ok {rc=0} 17:34:05.617454 --- ParallelTerminationStrategy: PID 29486 died... 17:34:05.636930 run iperf3-srv_10.42.42.10(pid=29486): Terminated {rc=256} 17:34:05.683540 --- ParallelTerminationStrategy: PID 29487 died... 17:34:05.703109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29487): Terminated: ok {rc=0} 17:34:05.749746 --- ParallelTerminationStrategy: PID 29488 died... 17:34:05.769388 run iperf3-srv_10.42.42.10(pid=29488): Terminated {rc=256} 17:34:05.816105 --- ParallelTerminationStrategy: PID 29491 died... 17:34:05.835773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29491): Terminated: ok {rc=0} 17:34:05.882417 --- ParallelTerminationStrategy: PID 29494 died... 17:34:05.902038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29494): Terminated: ok {rc=0} 17:34:05.949265 --- ParallelTerminationStrategy: PID 29497 died... 17:34:05.968901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29497): Terminated: ok {rc=0} 17:34:06.057925 bus /gobi_4: Setting Powered False 17:34:07.157465 bus /gobi_4: Setting Powered False 17:34:08.273223 bus /gobi_1: Setting Powered False 17:34:09.370459 bus /gobi_1: Setting Powered False 17:34:10.486002 bus /gobi_0: Setting Powered False 17:34:11.583770 bus /gobi_0: Setting Powered False 17:34:12.700393 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 17:34:13.800703 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:13.812335 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:34:13.868450 tst ping.py: using LAC 29517 17:34:13.988718 tst ping.py: using RAC 192 17:34:14.104223 tst ping.py: using CellId 29517 17:34:14.219351 tst ping.py: using BVCI 29518 17:34:14.326893 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:14.337918 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:14.348728 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:14.359688 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:14.370500 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:14.381326 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:14.392291 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:14.403194 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:34:14.522244 tst ping.py:19: start network... 17:34:14.734647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:34:15.225791 run create_hlr_db(pid=29499): Launched 17:34:15.348870 bus /gobi_6: Setting Powered False 17:34:16.409259 run create_hlr_db(pid=29499): Terminated: ok {rc=0} 17:34:16.874412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29501): Launched 17:34:17.193395 run osmo-hlr_10.42.42.2(pid=29502): Launched 17:34:17.306974 run osmo-stp_10.42.42.5: Starting osmo-stp 17:34:17.820740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29504): Launched 17:34:18.116086 run osmo-stp_10.42.42.5(pid=29505): Launched 17:34:18.229725 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:34:18.739768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29507): Launched 17:34:18.854141 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:34:19.103857 run patchelf(pid=29508): Launched 17:34:19.269388 run osmo-stp_10.42.42.5(pid=29505): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29505)] 17:34:19.394615 run osmo-stp_10.42.42.5(pid=29505): stdout: | (launched: 2022-12-10_17:34:18.061393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:19.521258 run osmo-stp_10.42.42.5(pid=29505): stderr: | 20221210173418232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173418232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173418232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173418233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173418233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173418233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173418233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:19.647814 run osmo-stp_10.42.42.5(pid=29505): stdout: | (launched: 2022-12-10_17:34:18.061393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:19.768799 run osmo-stp_10.42.42.5(pid=29505): stderr: | 20221210173418232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173418232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173418232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173418233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173418233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173418233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173418233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:19.912264 run patchelf(pid=29508): Terminating (SIGINT) 17:34:20.077330 run patchelf(pid=29508): Terminated: ok {rc=0} 17:34:20.196482 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29505): Process ended prematurely: osmo-stp_10.42.42.5(pid=29505) [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29505)] [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 17:34:20.205526 tst ping.py:22: Test FAILED (6.4 sec) 17:34:20.232179 run osmo-hlr_10.42.42.2(pid=29502): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29502)] 17:34:20.279199 run osmo-hlr_10.42.42.2(pid=29502): stdout: | (launched: 2022-12-10_17:34:17.137090) 17:34:20.327849 run osmo-hlr_10.42.42.2(pid=29502): stderr: | 20221210173417313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173417313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173417313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173417313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173417313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173417313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173417325 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173417334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173417334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173417334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:34:20.376872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29501): Terminating (SIGTERM) 17:34:20.416434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29504): Terminating (SIGTERM) 17:34:20.455860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29507): Terminating (SIGTERM) 17:34:20.495664 --- ParallelTerminationStrategy: PID 29501 died... 17:34:20.514669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29501): Terminated: ok {rc=0} 17:34:20.558685 --- ParallelTerminationStrategy: PID 29504 died... 17:34:20.576810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29504): Terminated: ok {rc=0} 17:34:20.620025 --- ParallelTerminationStrategy: PID 29507 died... 17:34:20.638416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29507): Terminated: ok {rc=0} 17:34:20.721010 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:34:21.807224 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:21.819819 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:34:21.874713 tst ping_idle_ping.py: using LAC 29518 17:34:22.000637 tst ping_idle_ping.py: using RAC 193 17:34:22.125387 tst ping_idle_ping.py: using CellId 29518 17:34:22.247756 tst ping_idle_ping.py: using BVCI 29519 17:34:22.356779 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:22.367788 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:22.378441 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:22.389087 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:22.399701 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:22.410301 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:22.420917 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:22.431473 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:34:22.549312 tst ping_idle_ping.py:24: start network... 17:34:22.763439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:34:23.256886 run create_hlr_db(pid=29509): Launched 17:34:23.381251 bus /gobi_6: Setting Powered False 17:34:24.445188 run create_hlr_db(pid=29509): Terminated: ok {rc=0} 17:34:24.887282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29511): Launched 17:34:25.206360 run osmo-hlr_10.42.42.2(pid=29512): Launched 17:34:25.328609 run osmo-stp_10.42.42.5: Starting osmo-stp 17:34:25.880226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29514): Launched 17:34:26.199868 run osmo-stp_10.42.42.5(pid=29515): Launched 17:34:26.321760 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:34:26.870848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29517): Launched 17:34:26.994825 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:34:27.264498 run patchelf(pid=29519): Launched 17:34:27.441774 run osmo-stp_10.42.42.5(pid=29515): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29515)] 17:34:27.577199 run osmo-stp_10.42.42.5(pid=29515): stdout: | (launched: 2022-12-10_17:34:26.141378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:27.713581 run osmo-stp_10.42.42.5(pid=29515): stderr: | 20221210173426331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173426331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173426332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173426332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173426334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173426335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173426335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:27.850038 run osmo-stp_10.42.42.5(pid=29515): stdout: | (launched: 2022-12-10_17:34:26.141378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:27.980664 run osmo-stp_10.42.42.5(pid=29515): stderr: | 20221210173426331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173426331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173426332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173426332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173426334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173426335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173426335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:28.135516 run patchelf(pid=29519): Terminating (SIGINT) 17:34:28.314352 run patchelf(pid=29519): Terminated: ok {rc=0} 17:34:28.443326 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29515): Process ended prematurely: osmo-stp_10.42.42.5(pid=29515) [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29515)] [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 17:34:28.452864 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 17:34:28.481826 run osmo-hlr_10.42.42.2(pid=29512): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29512)] 17:34:28.532152 run osmo-hlr_10.42.42.2(pid=29512): stdout: | (launched: 2022-12-10_17:34:25.148008) 17:34:28.584138 run osmo-hlr_10.42.42.2(pid=29512): stderr: | 20221210173425345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173425345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173425345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173425345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173425345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173425345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173425357 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173425368 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173425368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173425368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:34:28.636545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29511): Terminating (SIGTERM) 17:34:28.678583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29514): Terminating (SIGTERM) 17:34:28.720629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29517): Terminating (SIGTERM) 17:34:28.763893 --- ParallelTerminationStrategy: PID 29511 died... 17:34:28.783952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29511): Terminated: ok {rc=0} 17:34:28.830960 --- ParallelTerminationStrategy: PID 29514 died... 17:34:28.850705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29514): Terminated: ok {rc=0} 17:34:28.897702 --- ParallelTerminationStrategy: PID 29517 died... 17:34:28.917391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29517): Terminated: ok {rc=0} 17:34:29.005253 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:34:30.319394 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:34:30.326347 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:34:30.361445 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:34:30.400818 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:34:30.490386 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:34:30.523965 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:34:30.563100 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:34:31.164595 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:34:31.238686 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:31.254554 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:34:31.346220 tst cs_paging_gprs_active.py: using LAC 29519 17:34:31.522551 tst cs_paging_gprs_active.py: using RAC 194 17:34:31.649242 tst cs_paging_gprs_active.py: using CellId 29519 17:34:31.771386 tst cs_paging_gprs_active.py: using BVCI 29520 17:34:31.909876 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:31.921836 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:31.934260 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:31.946650 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:31.960059 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:31.972130 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:31.985109 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:31.998309 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:32.010207 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:32.130894 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:32.244354 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:34:32.450904 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:32.755953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29523): Launched 17:34:33.021911 run iperf3-srv_10.42.42.10(pid=29524): Launched 17:34:33.138869 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:34:33.342555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:33.646941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29525): Launched 17:34:33.910870 run iperf3-srv_10.42.42.10(pid=29526): Launched 17:34:34.026944 tst cs_paging_gprs_active.py:38: start network... 17:34:34.228890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:34:34.697591 run create_hlr_db(pid=29527): Launched 17:34:34.822145 bus /gobi_6: Setting Powered False 17:34:35.887183 run create_hlr_db(pid=29527): Terminated: ok {rc=0} 17:34:36.320071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29529): Launched 17:34:36.624372 run osmo-hlr_10.42.42.2(pid=29530): Launched 17:34:36.739858 run osmo-stp_10.42.42.5: Starting osmo-stp 17:34:37.264568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29532): Launched 17:34:37.568715 run osmo-stp_10.42.42.5(pid=29533): Launched 17:34:37.684581 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:34:38.205902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29535): Launched 17:34:38.321562 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:34:38.577181 run patchelf(pid=29536): Launched 17:34:38.745515 run osmo-stp_10.42.42.5(pid=29533): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29533)] 17:34:38.873668 run osmo-stp_10.42.42.5(pid=29533): stdout: | (launched: 2022-12-10_17:34:37.512461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:39.003872 run osmo-stp_10.42.42.5(pid=29533): stderr: | 20221210173437685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173437686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173437686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173437686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173437687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173437687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173437687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:39.133851 run osmo-stp_10.42.42.5(pid=29533): stdout: | (launched: 2022-12-10_17:34:37.512461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:39.258327 run osmo-stp_10.42.42.5(pid=29533): stderr: | 20221210173437685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173437686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173437686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173437686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173437687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173437687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173437687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:39.405662 run patchelf(pid=29536): Terminating (SIGINT) 17:34:39.575271 run patchelf(pid=29536): Terminated: ok {rc=0} 17:34:39.697354 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29533): Process ended prematurely: osmo-stp_10.42.42.5(pid=29533) [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29533)] [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:34:39.706698 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 17:34:39.733644 run osmo-hlr_10.42.42.2(pid=29530): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29530)] 17:34:39.780602 run osmo-hlr_10.42.42.2(pid=29530): stdout: | (launched: 2022-12-10_17:34:36.568125) 17:34:39.829549 run osmo-hlr_10.42.42.2(pid=29530): stderr: | 20221210173436748 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173436748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173436748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173436748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173436748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173436748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173436760 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173436770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173436770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173436770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:34:39.878906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29523): Terminating (SIGTERM) 17:34:39.918716 run iperf3-srv_10.42.42.10(pid=29524): Terminating (SIGTERM) 17:34:39.958250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29525): Terminating (SIGTERM) 17:34:39.997669 run iperf3-srv_10.42.42.10(pid=29526): Terminating (SIGTERM) 17:34:40.037058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29529): Terminating (SIGTERM) 17:34:40.076437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29532): Terminating (SIGTERM) 17:34:40.115906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29535): Terminating (SIGTERM) 17:34:40.155516 --- ParallelTerminationStrategy: PID 29523 died... 17:34:40.174532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29523): Terminated: ok {rc=0} 17:34:40.218170 --- ParallelTerminationStrategy: PID 29524 died... 17:34:40.236617 run iperf3-srv_10.42.42.10(pid=29524): Terminated {rc=256} 17:34:40.280027 --- ParallelTerminationStrategy: PID 29525 died... 17:34:40.298645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29525): Terminated: ok {rc=0} 17:34:40.341818 --- ParallelTerminationStrategy: PID 29526 died... 17:34:40.360195 run iperf3-srv_10.42.42.10(pid=29526): Terminated {rc=256} 17:34:40.403451 --- ParallelTerminationStrategy: PID 29529 died... 17:34:40.421624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29529): Terminated: ok {rc=0} 17:34:40.464719 --- ParallelTerminationStrategy: PID 29532 died... 17:34:40.483190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29532): Terminated: ok {rc=0} 17:34:40.526394 --- ParallelTerminationStrategy: PID 29535 died... 17:34:40.544856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29535): Terminated: ok {rc=0} 17:34:40.627785 bus /gobi_0: Setting Powered False 17:34:41.725365 bus /gobi_0: Setting Powered False 17:34:42.841211 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:34:43.990353 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:44.002401 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:34:44.077303 tst iperf3.py: using LAC 29520 17:34:44.205725 tst iperf3.py: using RAC 195 17:34:44.333524 tst iperf3.py: using CellId 29520 17:34:44.453644 tst iperf3.py: using BVCI 29521 17:34:44.565199 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:44.576198 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:44.586802 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:44.597668 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:44.608340 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:44.618951 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:44.629712 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:44.640210 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:44.651015 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:44.768403 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:34:44.986191 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:45.309895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29537): Launched 17:34:45.592721 run iperf3-srv_10.42.42.10(pid=29538): Launched 17:34:45.714301 tst iperf3.py:8: start network... 17:34:45.943481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:34:46.453420 run create_hlr_db(pid=29539): Launched 17:34:46.611906 bus /gobi_6: Setting Powered False 17:34:47.675350 run create_hlr_db(pid=29539): Terminated: ok {rc=0} 17:34:48.124251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29541): Launched 17:34:48.447388 run osmo-hlr_10.42.42.2(pid=29542): Launched 17:34:48.573266 run osmo-stp_10.42.42.5: Starting osmo-stp 17:34:49.133650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29544): Launched 17:34:49.459093 run osmo-stp_10.42.42.5(pid=29545): Launched 17:34:49.582674 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:34:50.141388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29547): Launched 17:34:50.267353 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:34:50.540504 run patchelf(pid=29548): Launched 17:34:50.720713 run osmo-stp_10.42.42.5(pid=29545): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29545)] 17:34:50.857670 run osmo-stp_10.42.42.5(pid=29545): stdout: | (launched: 2022-12-10_17:34:49.399562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:50.996097 run osmo-stp_10.42.42.5(pid=29545): stderr: | 20221210173449591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173449591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173449592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173449592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173449593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173449593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173449593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:51.135416 run osmo-stp_10.42.42.5(pid=29545): stdout: | (launched: 2022-12-10_17:34:49.399562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:51.268859 run osmo-stp_10.42.42.5(pid=29545): stderr: | 20221210173449591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173449591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173449592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173449592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173449593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173449593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173449593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:51.426275 run patchelf(pid=29548): Terminating (SIGINT) 17:34:51.607666 run patchelf(pid=29548): Terminated: ok {rc=0} 17:34:51.739258 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29545): Process ended prematurely: osmo-stp_10.42.42.5(pid=29545) [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29545)] [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 17:34:51.749518 tst iperf3.py:8: Test FAILED (7.8 sec) 17:34:51.779329 run osmo-hlr_10.42.42.2(pid=29542): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29542)] 17:34:51.830363 run osmo-hlr_10.42.42.2(pid=29542): stdout: | (launched: 2022-12-10_17:34:48.388475) 17:34:51.883086 run osmo-hlr_10.42.42.2(pid=29542): stderr: | 20221210173448587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173448587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173448587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173448587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173448587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173448587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173448599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173448607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173448607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173448607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:34:51.936375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29537): Terminating (SIGTERM) 17:34:51.979152 run iperf3-srv_10.42.42.10(pid=29538): Terminating (SIGTERM) 17:34:52.021651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29541): Terminating (SIGTERM) 17:34:52.064337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29544): Terminating (SIGTERM) 17:34:52.107092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29547): Terminating (SIGTERM) 17:34:52.150328 --- ParallelTerminationStrategy: PID 29537 died... 17:34:52.170523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29537): Terminated: ok {rc=0} 17:34:52.218040 --- ParallelTerminationStrategy: PID 29538 died... 17:34:52.237834 run iperf3-srv_10.42.42.10(pid=29538): Terminated {rc=256} 17:34:52.284748 --- ParallelTerminationStrategy: PID 29541 died... 17:34:52.304563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29541): Terminated: ok {rc=0} 17:34:52.351799 --- ParallelTerminationStrategy: PID 29544 died... 17:34:52.371583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29544): Terminated: ok {rc=0} 17:34:52.418366 --- ParallelTerminationStrategy: PID 29547 died... 17:34:52.437992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29547): Terminated: ok {rc=0} 17:34:52.526211 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:34:53.676889 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:53.689212 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:34:53.761371 tst iperf3m4.py: using LAC 29521 17:34:53.890009 tst iperf3m4.py: using RAC 196 17:34:54.018511 tst iperf3m4.py: using CellId 29521 17:34:54.145296 tst iperf3m4.py: using BVCI 29522 17:34:54.264485 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:54.276094 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:54.287547 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:54.299205 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:54.310819 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:54.322621 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:54.334215 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:54.345742 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:54.357356 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:54.479081 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:54.599123 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:54.717512 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:54.837859 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:34:55.056356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:55.382938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29549): Launched 17:34:55.665418 run iperf3-srv_10.42.42.10(pid=29550): Launched 17:34:55.789111 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:34:56.007010 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:56.332553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29551): Launched 17:34:56.614828 run iperf3-srv_10.42.42.10(pid=29552): Launched 17:34:56.738902 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:34:56.956094 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:57.282163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29553): Launched 17:34:57.563390 run iperf3-srv_10.42.42.10(pid=29554): Launched 17:34:57.686515 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:34:57.904033 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:58.228023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29555): Launched 17:34:58.509790 run iperf3-srv_10.42.42.10(pid=29556): Launched 17:34:58.631411 tst iperf3m4.py:8: start network... 17:34:58.849094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:34:59.351624 run create_hlr_db(pid=29557): Launched 17:34:59.475534 bus /gobi_6: Setting Powered False 17:35:00.538874 run create_hlr_db(pid=29557): Terminated: ok {rc=0} 17:35:01.005710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29559): Launched 17:35:01.327897 run osmo-hlr_10.42.42.2(pid=29560): Launched 17:35:01.562890 run osmo-stp_10.42.42.5: Starting osmo-stp 17:35:02.373997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29565): Launched 17:35:02.699501 run osmo-stp_10.42.42.5(pid=29566): Launched 17:35:02.823278 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:35:03.381900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29568): Launched 17:35:03.507338 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:35:03.780602 run patchelf(pid=29569): Launched 17:35:03.962426 run osmo-stp_10.42.42.5(pid=29566): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29566)] 17:35:04.099494 run osmo-stp_10.42.42.5(pid=29566): stdout: | (launched: 2022-12-10_17:35:02.640084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:04.238609 run osmo-stp_10.42.42.5(pid=29566): stderr: | 20221210173502830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173502830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173502830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173502831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173502831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173502831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173502831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:04.377234 run osmo-stp_10.42.42.5(pid=29566): stdout: | (launched: 2022-12-10_17:35:02.640084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:04.509933 run osmo-stp_10.42.42.5(pid=29566): stderr: | 20221210173502830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173502830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173502830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173502831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173502831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173502831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173502831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:04.667107 run patchelf(pid=29569): Terminating (SIGINT) 17:35:04.848381 run patchelf(pid=29569): Terminated: ok {rc=0} 17:35:04.979042 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29566): Process ended prematurely: osmo-stp_10.42.42.5(pid=29566) [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29566)] [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:35:04.989166 tst iperf3m4.py:8: Test FAILED (11.4 sec) 17:35:05.019067 run osmo-hlr_10.42.42.2(pid=29560): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29560)] 17:35:05.070470 run osmo-hlr_10.42.42.2(pid=29560): stdout: | (launched: 2022-12-10_17:35:01.270390) 17:35:05.123091 run osmo-hlr_10.42.42.2(pid=29560): stderr: | 20221210173501615 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173501615 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173501615 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173501615 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173501615 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173501615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173501636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173501644 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173501649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173501649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:35:05.176603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29549): Terminating (SIGTERM) 17:35:05.219747 run iperf3-srv_10.42.42.10(pid=29550): Terminating (SIGTERM) 17:35:05.262589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29551): Terminating (SIGTERM) 17:35:05.305487 run iperf3-srv_10.42.42.10(pid=29552): Terminating (SIGTERM) 17:35:05.348173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29553): Terminating (SIGTERM) 17:35:05.391205 run iperf3-srv_10.42.42.10(pid=29554): Terminating (SIGTERM) 17:35:05.433666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29555): Terminating (SIGTERM) 17:35:05.476434 run iperf3-srv_10.42.42.10(pid=29556): Terminating (SIGTERM) 17:35:05.519130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29559): Terminating (SIGTERM) 17:35:05.561858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29565): Terminating (SIGTERM) 17:35:05.604531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29568): Terminating (SIGTERM) 17:35:05.647599 --- ParallelTerminationStrategy: PID 29549 died... 17:35:05.667691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29549): Terminated: ok {rc=0} 17:35:05.715725 --- ParallelTerminationStrategy: PID 29550 died... 17:35:05.735687 run iperf3-srv_10.42.42.10(pid=29550): Terminated {rc=256} 17:35:05.782828 --- ParallelTerminationStrategy: PID 29551 died... 17:35:05.802697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29551): Terminated: ok {rc=0} 17:35:05.849852 --- ParallelTerminationStrategy: PID 29552 died... 17:35:05.869683 run iperf3-srv_10.42.42.10(pid=29552): Terminated {rc=256} 17:35:05.916728 --- ParallelTerminationStrategy: PID 29553 died... 17:35:05.936623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29553): Terminated: ok {rc=0} 17:35:05.983698 --- ParallelTerminationStrategy: PID 29554 died... 17:35:06.003526 run iperf3-srv_10.42.42.10(pid=29554): Terminated {rc=256} 17:35:06.050625 --- ParallelTerminationStrategy: PID 29555 died... 17:35:06.070581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29555): Terminated: ok {rc=0} 17:35:06.117849 --- ParallelTerminationStrategy: PID 29556 died... 17:35:06.137757 run iperf3-srv_10.42.42.10(pid=29556): Terminated {rc=256} 17:35:06.185277 --- ParallelTerminationStrategy: PID 29559 died... 17:35:06.205253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29559): Terminated: ok {rc=0} 17:35:06.252287 --- ParallelTerminationStrategy: PID 29565 died... 17:35:06.272324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29565): Terminated: ok {rc=0} 17:35:06.319159 --- ParallelTerminationStrategy: PID 29568 died... 17:35:06.338952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29568): Terminated: ok {rc=0} 17:35:06.427446 bus /gobi_4: Setting Powered False 17:35:07.527217 bus /gobi_4: Setting Powered False 17:35:08.644577 bus /gobi_1: Setting Powered False 17:35:09.743255 bus /gobi_1: Setting Powered False 17:35:10.858750 bus /gobi_0: Setting Powered False 17:35:11.956931 bus /gobi_0: Setting Powered False 17:35:13.074212 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:35:14.176508 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:14.188545 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:35:14.261463 tst ping.py: using LAC 29522 17:35:14.386430 tst ping.py: using RAC 197 17:35:14.510679 tst ping.py: using CellId 29522 17:35:14.636060 tst ping.py: using BVCI 29523 17:35:14.751154 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:14.762732 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:14.774163 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:14.785810 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:14.797359 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:14.808771 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:14.820740 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:14.832045 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:35:14.950462 tst ping.py:19: start network... 17:35:15.164275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:35:15.654841 run create_hlr_db(pid=29570): Launched 17:35:15.777629 bus /gobi_6: Setting Powered False 17:35:16.859720 run create_hlr_db(pid=29570): Terminated: ok {rc=0} 17:35:17.322283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29572): Launched 17:35:17.643827 run osmo-hlr_10.42.42.2(pid=29573): Launched 17:35:17.766717 run osmo-stp_10.42.42.5: Starting osmo-stp 17:35:18.318768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29575): Launched 17:35:18.637606 run osmo-stp_10.42.42.5(pid=29576): Launched 17:35:18.758477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:35:19.307027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29578): Launched 17:35:19.431127 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:35:19.698933 run patchelf(pid=29579): Launched 17:35:19.877366 run osmo-stp_10.42.42.5(pid=29576): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29576)] 17:35:20.011992 run osmo-stp_10.42.42.5(pid=29576): stdout: | (launched: 2022-12-10_17:35:18.579646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:20.148110 run osmo-stp_10.42.42.5(pid=29576): stderr: | 20221210173518771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173518771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173518771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173518771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173518772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173518772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173518772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:20.285111 run osmo-stp_10.42.42.5(pid=29576): stdout: | (launched: 2022-12-10_17:35:18.579646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:20.415329 run osmo-stp_10.42.42.5(pid=29576): stderr: | 20221210173518771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173518771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173518771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173518771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173518772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173518772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173518772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:20.569543 run patchelf(pid=29579): Terminating (SIGINT) 17:35:20.746917 run patchelf(pid=29579): Terminated: ok {rc=0} 17:35:20.875207 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29576): Process ended prematurely: osmo-stp_10.42.42.5(pid=29576) [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29576)] [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 17:35:20.884682 tst ping.py:22: Test FAILED (6.7 sec) 17:35:20.913637 run osmo-hlr_10.42.42.2(pid=29573): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29573)] 17:35:20.964264 run osmo-hlr_10.42.42.2(pid=29573): stdout: | (launched: 2022-12-10_17:35:17.584793) 17:35:21.016549 run osmo-hlr_10.42.42.2(pid=29573): stderr: | 20221210173517783 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173517783 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173517783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173517783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173517783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173517783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173517795 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173517803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173517803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173517803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:35:21.069631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29572): Terminating (SIGTERM) 17:35:21.111819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29575): Terminating (SIGTERM) 17:35:21.154059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29578): Terminating (SIGTERM) 17:35:21.196803 --- ParallelTerminationStrategy: PID 29572 died... 17:35:21.217130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29572): Terminated: ok {rc=0} 17:35:21.264205 --- ParallelTerminationStrategy: PID 29575 died... 17:35:21.283910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29575): Terminated: ok {rc=0} 17:35:21.330973 --- ParallelTerminationStrategy: PID 29578 died... 17:35:21.350944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29578): Terminated: ok {rc=0} 17:35:21.439453 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:35:22.526474 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:22.539048 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:35:22.612544 tst ping_idle_ping.py: using LAC 29523 17:35:22.737277 tst ping_idle_ping.py: using RAC 198 17:35:22.864108 tst ping_idle_ping.py: using CellId 29523 17:35:22.988155 tst ping_idle_ping.py: using BVCI 29524 17:35:23.102790 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:23.114280 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:23.125411 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:23.136846 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:23.148685 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:23.160675 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:23.172357 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:23.184018 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:35:23.301057 tst ping_idle_ping.py:24: start network... 17:35:23.502140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:35:23.971066 run create_hlr_db(pid=29580): Launched 17:35:24.093750 bus /gobi_6: Setting Powered False 17:35:25.154533 run create_hlr_db(pid=29580): Terminated: ok {rc=0} 17:35:25.591648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29582): Launched 17:35:25.910245 run osmo-hlr_10.42.42.2(pid=29583): Launched 17:35:26.033844 run osmo-stp_10.42.42.5: Starting osmo-stp 17:35:26.586176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29585): Launched 17:35:26.906086 run osmo-stp_10.42.42.5(pid=29586): Launched 17:35:27.027344 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:35:27.575465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29588): Launched 17:35:27.699135 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:35:27.968230 run patchelf(pid=29589): Launched 17:35:28.146301 run osmo-stp_10.42.42.5(pid=29586): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29586)] 17:35:28.282749 run osmo-stp_10.42.42.5(pid=29586): stdout: | (launched: 2022-12-10_17:35:26.847511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:28.419923 run osmo-stp_10.42.42.5(pid=29586): stderr: | 20221210173527039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173527039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173527040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173527040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173527040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173527040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173527041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:28.557330 run osmo-stp_10.42.42.5(pid=29586): stdout: | (launched: 2022-12-10_17:35:26.847511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:28.688320 run osmo-stp_10.42.42.5(pid=29586): stderr: | 20221210173527039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173527039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173527040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173527040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173527040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173527040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173527041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:28.843379 run patchelf(pid=29589): Terminating (SIGINT) 17:35:29.022054 run patchelf(pid=29589): Terminated: ok {rc=0} 17:35:29.150557 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29586): Process ended prematurely: osmo-stp_10.42.42.5(pid=29586) [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29586)] [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:35:29.160502 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 17:35:29.189574 run osmo-hlr_10.42.42.2(pid=29583): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29583)] 17:35:29.240795 run osmo-hlr_10.42.42.2(pid=29583): stdout: | (launched: 2022-12-10_17:35:25.852171) 17:35:29.293716 run osmo-hlr_10.42.42.2(pid=29583): stderr: | 20221210173526051 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173526051 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173526051 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173526051 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173526051 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173526051 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173526067 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173526077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173526077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173526077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:35:29.347067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29582): Terminating (SIGTERM) 17:35:29.389808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29585): Terminating (SIGTERM) 17:35:29.432670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29588): Terminating (SIGTERM) 17:35:29.476001 --- ParallelTerminationStrategy: PID 29582 died... 17:35:29.496223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29582): Terminated: ok {rc=0} 17:35:29.543778 --- ParallelTerminationStrategy: PID 29585 died... 17:35:29.563536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29585): Terminated: ok {rc=0} 17:35:29.610112 --- ParallelTerminationStrategy: PID 29588 died... 17:35:29.629734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29588): Terminated: ok {rc=0} 17:35:29.717691 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:35:31.031369 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:35:31.040263 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:35:31.078662 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:35:31.119230 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:35:31.209484 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:35:31.254624 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:35:31.305987 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:35:31.877176 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:35:31.941066 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:31.953134 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:35:32.026857 tst cs_paging_gprs_active.py: using LAC 29524 17:35:32.165062 tst cs_paging_gprs_active.py: using RAC 199 17:35:32.292536 tst cs_paging_gprs_active.py: using CellId 29524 17:35:32.420875 tst cs_paging_gprs_active.py: using BVCI 29525 17:35:32.538487 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:32.549841 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:32.560891 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:32.572365 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:32.583453 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:32.594731 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:32.606217 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:32.617529 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:32.628781 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:32.748527 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:32.863693 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:35:33.067085 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:33.371194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29594): Launched 17:35:33.637753 run iperf3-srv_10.42.42.10(pid=29595): Launched 17:35:33.752659 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:35:33.955568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:34.259410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29596): Launched 17:35:34.524157 run iperf3-srv_10.42.42.10(pid=29597): Launched 17:35:34.638927 tst cs_paging_gprs_active.py:38: start network... 17:35:34.841643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:35:35.310757 run create_hlr_db(pid=29598): Launched 17:35:35.436213 bus /gobi_6: Setting Powered False 17:35:36.495625 run create_hlr_db(pid=29598): Terminated: ok {rc=0} 17:35:36.935887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29600): Launched 17:35:37.261150 run osmo-hlr_10.42.42.2(pid=29601): Launched 17:35:37.385320 run osmo-stp_10.42.42.5: Starting osmo-stp 17:35:37.945571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29603): Launched 17:35:38.269144 run osmo-stp_10.42.42.5(pid=29604): Launched 17:35:38.393517 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:35:38.951074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29606): Launched 17:35:39.076786 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:35:39.351839 run patchelf(pid=29607): Launched 17:35:39.531832 run osmo-stp_10.42.42.5(pid=29604): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29604)] 17:35:39.668784 run osmo-stp_10.42.42.5(pid=29604): stdout: | (launched: 2022-12-10_17:35:38.209827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:39.806645 run osmo-stp_10.42.42.5(pid=29604): stderr: | 20221210173538403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173538403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173538404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173538404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173538405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173538405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173538405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:39.945147 run osmo-stp_10.42.42.5(pid=29604): stdout: | (launched: 2022-12-10_17:35:38.209827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:40.078095 run osmo-stp_10.42.42.5(pid=29604): stderr: | 20221210173538403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173538403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173538404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173538404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173538405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173538405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173538405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:40.236077 run patchelf(pid=29607): Terminating (SIGINT) 17:35:40.416320 run patchelf(pid=29607): Terminated: ok {rc=0} 17:35:40.546865 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29604): Process ended prematurely: osmo-stp_10.42.42.5(pid=29604) [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29604)] [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:35:40.557023 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:35:40.585850 run osmo-hlr_10.42.42.2(pid=29601): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29601)] 17:35:40.636565 run osmo-hlr_10.42.42.2(pid=29601): stdout: | (launched: 2022-12-10_17:35:37.201543) 17:35:40.688803 run osmo-hlr_10.42.42.2(pid=29601): stderr: | 20221210173537402 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173537402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173537402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173537402 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173537402 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173537402 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173537415 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173537423 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173537423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173537424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:35:40.741247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29594): Terminating (SIGTERM) 17:35:40.783200 run iperf3-srv_10.42.42.10(pid=29595): Terminating (SIGTERM) 17:35:40.825057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29596): Terminating (SIGTERM) 17:35:40.867048 run iperf3-srv_10.42.42.10(pid=29597): Terminating (SIGTERM) 17:35:40.908820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29600): Terminating (SIGTERM) 17:35:40.951392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29603): Terminating (SIGTERM) 17:35:40.993373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29606): Terminating (SIGTERM) 17:35:41.035526 --- ParallelTerminationStrategy: PID 29594 died... 17:35:41.055420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29594): Terminated: ok {rc=0} 17:35:41.101956 --- ParallelTerminationStrategy: PID 29595 died... 17:35:41.121377 run iperf3-srv_10.42.42.10(pid=29595): Terminated {rc=256} 17:35:41.167934 --- ParallelTerminationStrategy: PID 29596 died... 17:35:41.187621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29596): Terminated: ok {rc=0} 17:35:41.234018 --- ParallelTerminationStrategy: PID 29597 died... 17:35:41.253378 run iperf3-srv_10.42.42.10(pid=29597): Terminated {rc=256} 17:35:41.299322 --- ParallelTerminationStrategy: PID 29600 died... 17:35:41.318584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29600): Terminated: ok {rc=0} 17:35:41.364883 --- ParallelTerminationStrategy: PID 29603 died... 17:35:41.384679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29603): Terminated: ok {rc=0} 17:35:41.430841 --- ParallelTerminationStrategy: PID 29606 died... 17:35:41.450509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29606): Terminated: ok {rc=0} 17:35:41.538526 bus /gobi_0: Setting Powered False 17:35:42.636580 bus /gobi_0: Setting Powered False 17:35:43.751269 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:35:44.895962 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:44.907334 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:35:44.978729 tst iperf3.py: using LAC 29525 17:35:45.096651 tst iperf3.py: using RAC 200 17:35:45.214418 tst iperf3.py: using CellId 29525 17:35:45.334165 tst iperf3.py: using BVCI 29526 17:35:45.444527 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:45.455495 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:45.466124 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:45.476736 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:45.487338 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:45.498341 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:45.509070 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:45.519974 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:45.530926 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:45.648000 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:35:45.866497 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:46.196347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29608): Launched 17:35:46.501817 run iperf3-srv_10.42.42.10(pid=29609): Launched 17:35:46.635532 tst iperf3.py:8: start network... 17:35:46.843849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:35:47.319961 run create_hlr_db(pid=29610): Launched 17:35:47.442924 bus /gobi_6: Setting Powered False 17:35:48.502319 run create_hlr_db(pid=29610): Terminated: ok {rc=0} 17:35:48.941114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29612): Launched 17:35:49.264179 run osmo-hlr_10.42.42.2(pid=29613): Launched 17:35:49.388569 run osmo-stp_10.42.42.5: Starting osmo-stp 17:35:49.947785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29615): Launched 17:35:50.271318 run osmo-stp_10.42.42.5(pid=29616): Launched 17:35:50.394993 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:35:50.948675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29618): Launched 17:35:51.072245 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:35:51.345133 run patchelf(pid=29619): Launched 17:35:51.524803 run osmo-stp_10.42.42.5(pid=29616): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29616)] 17:35:51.661817 run osmo-stp_10.42.42.5(pid=29616): stdout: | (launched: 2022-12-10_17:35:50.211983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:51.799637 run osmo-stp_10.42.42.5(pid=29616): stderr: | 20221210173550403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173550403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173550403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173550404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173550406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173550406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173550406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:51.937938 run osmo-stp_10.42.42.5(pid=29616): stdout: | (launched: 2022-12-10_17:35:50.211983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:52.070151 run osmo-stp_10.42.42.5(pid=29616): stderr: | 20221210173550403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173550403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173550403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173550404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173550406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173550406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173550406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:52.227621 run patchelf(pid=29619): Terminating (SIGINT) 17:35:52.408081 run patchelf(pid=29619): Terminated: ok {rc=0} 17:35:52.537715 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29616): Process ended prematurely: osmo-stp_10.42.42.5(pid=29616) [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29616)] [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 17:35:52.547830 tst iperf3.py:8: Test FAILED (7.7 sec) 17:35:52.576882 run osmo-hlr_10.42.42.2(pid=29613): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29613)] 17:35:52.627231 run osmo-hlr_10.42.42.2(pid=29613): stdout: | (launched: 2022-12-10_17:35:49.205190) 17:35:52.679001 run osmo-hlr_10.42.42.2(pid=29613): stderr: | 20221210173549406 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173549406 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173549406 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173549406 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173549406 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173549406 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173549418 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173549427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173549427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173549427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:35:52.731196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29608): Terminating (SIGTERM) 17:35:52.773287 run iperf3-srv_10.42.42.10(pid=29609): Terminating (SIGTERM) 17:35:52.815328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29612): Terminating (SIGTERM) 17:35:52.857651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29615): Terminating (SIGTERM) 17:35:52.899794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29618): Terminating (SIGTERM) 17:35:52.941714 --- ParallelTerminationStrategy: PID 29608 died... 17:35:52.961692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29608): Terminated: ok {rc=0} 17:35:53.008531 --- ParallelTerminationStrategy: PID 29609 died... 17:35:53.027933 run iperf3-srv_10.42.42.10(pid=29609): Terminated {rc=256} 17:35:53.074336 --- ParallelTerminationStrategy: PID 29612 died... 17:35:53.093802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29612): Terminated: ok {rc=0} 17:35:53.140398 --- ParallelTerminationStrategy: PID 29615 died... 17:35:53.159839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29615): Terminated: ok {rc=0} 17:35:53.206471 --- ParallelTerminationStrategy: PID 29618 died... 17:35:53.226055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29618): Terminated: ok {rc=0} 17:35:53.314034 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:35:54.462437 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:54.474072 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:35:54.543616 tst iperf3m4.py: using LAC 29526 17:35:54.661576 tst iperf3m4.py: using RAC 201 17:35:54.781207 tst iperf3m4.py: using CellId 29526 17:35:54.900883 tst iperf3m4.py: using BVCI 29527 17:35:55.010077 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:55.020916 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:55.031754 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:55.042375 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:55.053503 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:55.064205 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:55.075098 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:55.085898 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:55.096817 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:55.211111 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:55.332606 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:55.450384 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:55.569499 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:35:55.788379 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:56.112513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29620): Launched 17:35:56.395325 run iperf3-srv_10.42.42.10(pid=29621): Launched 17:35:56.517531 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:35:56.735207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:57.059656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29622): Launched 17:35:57.341918 run iperf3-srv_10.42.42.10(pid=29623): Launched 17:35:57.463412 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:35:57.681416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:58.007072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29624): Launched 17:35:58.288757 run iperf3-srv_10.42.42.10(pid=29625): Launched 17:35:58.410601 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:35:58.627988 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:58.951571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29626): Launched 17:35:59.232804 run iperf3-srv_10.42.42.10(pid=29627): Launched 17:35:59.354694 tst iperf3m4.py:8: start network... 17:35:59.571409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:36:00.074478 run create_hlr_db(pid=29628): Launched 17:36:00.198409 bus /gobi_6: Setting Powered False 17:36:01.265379 run create_hlr_db(pid=29628): Terminated: ok {rc=0} 17:36:01.725647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29630): Launched 17:36:02.062551 run osmo-hlr_10.42.42.2(pid=29631): Launched 17:36:02.247804 run osmo-stp_10.42.42.5: Starting osmo-stp 17:36:02.802232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29633): Launched 17:36:03.126163 run osmo-stp_10.42.42.5(pid=29634): Launched 17:36:03.249575 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:36:03.805638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29636): Launched 17:36:03.929066 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:36:04.201586 run patchelf(pid=29637): Launched 17:36:04.381955 run osmo-stp_10.42.42.5(pid=29634): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29634)] 17:36:04.518844 run osmo-stp_10.42.42.5(pid=29634): stdout: | (launched: 2022-12-10_17:36:03.067066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:04.657383 run osmo-stp_10.42.42.5(pid=29634): stderr: | 20221210173603256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173603257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173603257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173603257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173603258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173603258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173603258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:04.795894 run osmo-stp_10.42.42.5(pid=29634): stdout: | (launched: 2022-12-10_17:36:03.067066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:04.929031 run osmo-stp_10.42.42.5(pid=29634): stderr: | 20221210173603256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173603257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173603257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173603257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173603258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173603258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173603258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:05.086154 run patchelf(pid=29637): Terminating (SIGINT) 17:36:05.267637 run patchelf(pid=29637): Terminated: ok {rc=0} 17:36:05.397779 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29634): Process ended prematurely: osmo-stp_10.42.42.5(pid=29634) [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29634)] [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:36:05.407842 tst iperf3m4.py:8: Test FAILED (11.0 sec) 17:36:05.437159 run osmo-hlr_10.42.42.2(pid=29631): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29631)] 17:36:05.487479 run osmo-hlr_10.42.42.2(pid=29631): stdout: | (launched: 2022-12-10_17:36:01.997708) 17:36:05.539669 run osmo-hlr_10.42.42.2(pid=29631): stderr: | 20221210173602252 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173602252 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173602252 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173602252 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173602252 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173602252 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173602264 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173602273 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173602273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173602273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:36:05.592016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29620): Terminating (SIGTERM) 17:36:05.634292 run iperf3-srv_10.42.42.10(pid=29621): Terminating (SIGTERM) 17:36:05.677143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29622): Terminating (SIGTERM) 17:36:05.719690 run iperf3-srv_10.42.42.10(pid=29623): Terminating (SIGTERM) 17:36:05.761734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29624): Terminating (SIGTERM) 17:36:05.803602 run iperf3-srv_10.42.42.10(pid=29625): Terminating (SIGTERM) 17:36:05.845286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29626): Terminating (SIGTERM) 17:36:05.886966 run iperf3-srv_10.42.42.10(pid=29627): Terminating (SIGTERM) 17:36:05.928572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29630): Terminating (SIGTERM) 17:36:05.970510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29633): Terminating (SIGTERM) 17:36:06.012208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29636): Terminating (SIGTERM) 17:36:06.054090 --- ParallelTerminationStrategy: PID 29620 died... 17:36:06.073925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29620): Terminated: ok {rc=0} 17:36:06.120500 --- ParallelTerminationStrategy: PID 29621 died... 17:36:06.139908 run iperf3-srv_10.42.42.10(pid=29621): Terminated {rc=256} 17:36:06.186947 --- ParallelTerminationStrategy: PID 29622 died... 17:36:06.206515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29622): Terminated: ok {rc=0} 17:36:06.253264 --- ParallelTerminationStrategy: PID 29623 died... 17:36:06.272403 run iperf3-srv_10.42.42.10(pid=29623): Terminated {rc=256} 17:36:06.318757 --- ParallelTerminationStrategy: PID 29624 died... 17:36:06.338334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29624): Terminated: ok {rc=0} 17:36:06.384678 --- ParallelTerminationStrategy: PID 29625 died... 17:36:06.404221 run iperf3-srv_10.42.42.10(pid=29625): Terminated {rc=256} 17:36:06.450727 --- ParallelTerminationStrategy: PID 29626 died... 17:36:06.470347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29626): Terminated: ok {rc=0} 17:36:06.516734 --- ParallelTerminationStrategy: PID 29627 died... 17:36:06.536261 run iperf3-srv_10.42.42.10(pid=29627): Terminated {rc=256} 17:36:06.582456 --- ParallelTerminationStrategy: PID 29630 died... 17:36:06.601925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29630): Terminated: ok {rc=0} 17:36:06.648757 --- ParallelTerminationStrategy: PID 29633 died... 17:36:06.668371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29633): Terminated: ok {rc=0} 17:36:06.714641 --- ParallelTerminationStrategy: PID 29636 died... 17:36:06.734268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29636): Terminated: ok {rc=0} 17:36:06.822287 bus /gobi_4: Setting Powered False 17:36:07.922166 bus /gobi_4: Setting Powered False 17:36:09.041686 bus /gobi_1: Setting Powered False 17:36:10.142116 bus /gobi_1: Setting Powered False 17:36:11.257896 bus /gobi_0: Setting Powered False 17:36:12.356723 bus /gobi_0: Setting Powered False 17:36:13.481883 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:36:14.584098 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:14.595682 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:36:14.665961 tst ping.py: using LAC 29527 17:36:14.790909 tst ping.py: using RAC 202 17:36:14.914542 tst ping.py: using CellId 29527 17:36:15.038129 tst ping.py: using BVCI 29528 17:36:15.159109 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:15.170929 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:15.182411 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:15.193825 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:15.205299 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:15.216857 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:15.228298 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:15.239626 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:36:15.355675 tst ping.py:19: start network... 17:36:15.566279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:36:16.057507 run create_hlr_db(pid=29639): Launched 17:36:16.194357 bus /gobi_6: Setting Powered False 17:36:17.256615 run create_hlr_db(pid=29639): Terminated: ok {rc=0} 17:36:17.697416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29641): Launched 17:36:18.013020 run osmo-hlr_10.42.42.2(pid=29642): Launched 17:36:18.134479 run osmo-stp_10.42.42.5: Starting osmo-stp 17:36:18.683542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29644): Launched 17:36:18.997779 run osmo-stp_10.42.42.5(pid=29645): Launched 17:36:19.117734 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:36:19.659861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29647): Launched 17:36:19.780888 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:36:20.047244 run patchelf(pid=29648): Launched 17:36:20.223514 run osmo-stp_10.42.42.5(pid=29645): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29645)] 17:36:20.357235 run osmo-stp_10.42.42.5(pid=29645): stdout: | (launched: 2022-12-10_17:36:18.940800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:20.492431 run osmo-stp_10.42.42.5(pid=29645): stderr: | 20221210173619132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173619132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173619132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173619132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173619133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173619133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173619133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:20.627558 run osmo-stp_10.42.42.5(pid=29645): stdout: | (launched: 2022-12-10_17:36:18.940800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:20.756552 run osmo-stp_10.42.42.5(pid=29645): stderr: | 20221210173619132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173619132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173619132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173619132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173619133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173619133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173619133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:20.909390 run patchelf(pid=29648): Terminating (SIGINT) 17:36:21.085451 run patchelf(pid=29648): Terminated: ok {rc=0} 17:36:21.212725 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29645): Process ended prematurely: osmo-stp_10.42.42.5(pid=29645) [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29645)] [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 17:36:21.222208 tst ping.py:22: Test FAILED (6.6 sec) 17:36:21.250490 run osmo-hlr_10.42.42.2(pid=29642): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29642)] 17:36:21.300472 run osmo-hlr_10.42.42.2(pid=29642): stdout: | (launched: 2022-12-10_17:36:17.955702) 17:36:21.352046 run osmo-hlr_10.42.42.2(pid=29642): stderr: | 20221210173618151 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173618151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173618151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173618151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173618151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173618152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173618164 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173618172 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173618172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173618173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:36:21.403839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29641): Terminating (SIGTERM) 17:36:21.445451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29644): Terminating (SIGTERM) 17:36:21.487169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29647): Terminating (SIGTERM) 17:36:21.529134 --- ParallelTerminationStrategy: PID 29641 died... 17:36:21.548800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29641): Terminated: ok {rc=0} 17:36:21.595428 --- ParallelTerminationStrategy: PID 29644 died... 17:36:21.614721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29644): Terminated: ok {rc=0} 17:36:21.660821 --- ParallelTerminationStrategy: PID 29647 died... 17:36:21.680486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29647): Terminated: ok {rc=0} 17:36:21.767707 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:36:22.852089 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:22.863826 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:36:22.935394 tst ping_idle_ping.py: using LAC 29528 17:36:23.053031 tst ping_idle_ping.py: using RAC 203 17:36:23.168715 tst ping_idle_ping.py: using CellId 29528 17:36:23.284529 tst ping_idle_ping.py: using BVCI 29529 17:36:23.391111 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:23.401978 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:23.412452 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:23.423278 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:23.434006 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:23.444800 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:23.455709 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:23.466448 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:36:23.582960 tst ping_idle_ping.py:24: start network... 17:36:23.795302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:36:24.285782 run create_hlr_db(pid=29649): Launched 17:36:24.406690 bus /gobi_6: Setting Powered False 17:36:25.469727 run create_hlr_db(pid=29649): Terminated: ok {rc=0} 17:36:25.892857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29651): Launched 17:36:26.189265 run osmo-hlr_10.42.42.2(pid=29652): Launched 17:36:26.301180 run osmo-stp_10.42.42.5: Starting osmo-stp 17:36:26.807220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29654): Launched 17:36:27.101655 run osmo-stp_10.42.42.5(pid=29655): Launched 17:36:27.214177 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:36:27.721150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29657): Launched 17:36:27.834038 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:36:28.082222 run patchelf(pid=29658): Launched 17:36:28.246497 run osmo-stp_10.42.42.5(pid=29655): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29655)] 17:36:28.371527 run osmo-stp_10.42.42.5(pid=29655): stdout: | (launched: 2022-12-10_17:36:27.047575) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:28.497893 run osmo-stp_10.42.42.5(pid=29655): stderr: | 20221210173627216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173627216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173627217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173627217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173627218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173627218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173627218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:28.624108 run osmo-stp_10.42.42.5(pid=29655): stdout: | (launched: 2022-12-10_17:36:27.047575) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:28.744649 run osmo-stp_10.42.42.5(pid=29655): stderr: | 20221210173627216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173627216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173627217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173627217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173627218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173627218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173627218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:28.887518 run patchelf(pid=29658): Terminating (SIGINT) 17:36:29.053299 run patchelf(pid=29658): Terminated: ok {rc=0} 17:36:29.172200 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29655): Process ended prematurely: osmo-stp_10.42.42.5(pid=29655) [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29655)] [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:36:29.180874 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 17:36:29.207364 run osmo-hlr_10.42.42.2(pid=29652): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29652)] 17:36:29.254043 run osmo-hlr_10.42.42.2(pid=29652): stdout: | (launched: 2022-12-10_17:36:26.134918) 17:36:29.302579 run osmo-hlr_10.42.42.2(pid=29652): stderr: | 20221210173626309 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173626309 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173626309 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173626309 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173626309 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173626309 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173626321 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173626330 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173626331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173626331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:36:29.351764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29651): Terminating (SIGTERM) 17:36:29.391125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29654): Terminating (SIGTERM) 17:36:29.430543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29657): Terminating (SIGTERM) 17:36:29.470139 --- ParallelTerminationStrategy: PID 29651 died... 17:36:29.488827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29651): Terminated: ok {rc=0} 17:36:29.532806 --- ParallelTerminationStrategy: PID 29654 died... 17:36:29.551377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29654): Terminated: ok {rc=0} 17:36:29.595256 --- ParallelTerminationStrategy: PID 29657 died... 17:36:29.613906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29657): Terminated: ok {rc=0} 17:36:29.697043 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 17:36:31.017859 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:36:31.025490 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 17:36:31.065813 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 17:36:31.107650 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 17:36:31.198263 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 17:36:31.234366 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 17:36:31.277253 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 17:36:31.908541 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 17:36:31.965637 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:31.977351 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:36:32.029495 tst cs_paging_gprs_active.py: using LAC 29529 17:36:32.162406 tst cs_paging_gprs_active.py: using RAC 204 17:36:32.291711 tst cs_paging_gprs_active.py: using CellId 29529 17:36:32.422381 tst cs_paging_gprs_active.py: using BVCI 29530 17:36:32.541987 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:32.553776 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:32.565496 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:32.578596 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:32.590224 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:32.602488 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:32.615007 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:32.627158 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:32.639627 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:36:32.759367 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:36:32.880165 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:36:33.098612 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:33.422934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29662): Launched 17:36:33.704380 run iperf3-srv_10.42.42.10(pid=29663): Launched 17:36:33.826817 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:36:34.044643 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:34.368124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29664): Launched 17:36:34.649207 run iperf3-srv_10.42.42.10(pid=29665): Launched 17:36:34.771054 tst cs_paging_gprs_active.py:38: start network... 17:36:34.987961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:36:35.486960 run create_hlr_db(pid=29666): Launched 17:36:35.609504 bus /gobi_6: Setting Powered False 17:36:36.672723 run create_hlr_db(pid=29666): Terminated: ok {rc=0} 17:36:37.101612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29668): Launched 17:36:37.402682 run osmo-hlr_10.42.42.2(pid=29669): Launched 17:36:37.517835 run osmo-stp_10.42.42.5: Starting osmo-stp 17:36:38.046691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29671): Launched 17:36:38.346383 run osmo-stp_10.42.42.5(pid=29672): Launched 17:36:38.460144 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:36:38.975688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29674): Launched 17:36:39.091071 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:36:39.344641 run patchelf(pid=29675): Launched 17:36:39.511996 run osmo-stp_10.42.42.5(pid=29672): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29672)] 17:36:39.639270 run osmo-stp_10.42.42.5(pid=29672): stdout: | (launched: 2022-12-10_17:36:38.291553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:39.767555 run osmo-stp_10.42.42.5(pid=29672): stderr: | 20221210173638459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173638459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173638459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173638460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173638460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173638460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173638460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:39.896157 run osmo-stp_10.42.42.5(pid=29672): stdout: | (launched: 2022-12-10_17:36:38.291553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:40.020266 run osmo-stp_10.42.42.5(pid=29672): stderr: | 20221210173638459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173638459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173638459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173638460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173638460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173638460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173638460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:40.166616 run patchelf(pid=29675): Terminating (SIGINT) 17:36:40.334663 run patchelf(pid=29675): Terminated: ok {rc=0} 17:36:40.455299 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29672): Process ended prematurely: osmo-stp_10.42.42.5(pid=29672) [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29672)] [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 17:36:40.464566 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 17:36:40.491559 run osmo-hlr_10.42.42.2(pid=29669): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29669)] 17:36:40.538606 run osmo-hlr_10.42.42.2(pid=29669): stdout: | (launched: 2022-12-10_17:36:37.347682) 17:36:40.587403 run osmo-hlr_10.42.42.2(pid=29669): stderr: | 20221210173637522 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173637522 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173637522 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173637522 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173637522 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173637522 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173637535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173637543 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173637544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173637544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:36:40.637313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29662): Terminating (SIGTERM) 17:36:40.676687 run iperf3-srv_10.42.42.10(pid=29663): Terminating (SIGTERM) 17:36:40.715983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29664): Terminating (SIGTERM) 17:36:40.755341 run iperf3-srv_10.42.42.10(pid=29665): Terminating (SIGTERM) 17:36:40.794560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29668): Terminating (SIGTERM) 17:36:40.833936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29671): Terminating (SIGTERM) 17:36:40.873219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29674): Terminating (SIGTERM) 17:36:40.912713 --- ParallelTerminationStrategy: PID 29662 died... 17:36:40.931611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29662): Terminated: ok {rc=0} 17:36:40.975428 --- ParallelTerminationStrategy: PID 29663 died... 17:36:40.993795 run iperf3-srv_10.42.42.10(pid=29663): Terminated {rc=256} 17:36:41.037207 --- ParallelTerminationStrategy: PID 29664 died... 17:36:41.055661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29664): Terminated: ok {rc=0} 17:36:41.099163 --- ParallelTerminationStrategy: PID 29665 died... 17:36:41.117488 run iperf3-srv_10.42.42.10(pid=29665): Terminated {rc=256} 17:36:41.160735 --- ParallelTerminationStrategy: PID 29668 died... 17:36:41.179133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29668): Terminated: ok {rc=0} 17:36:41.222594 --- ParallelTerminationStrategy: PID 29671 died... 17:36:41.241088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29671): Terminated: ok {rc=0} 17:36:41.284873 --- ParallelTerminationStrategy: PID 29674 died... 17:36:41.303745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29674): Terminated: ok {rc=0} 17:36:41.388732 bus /gobi_0: Setting Powered False 17:36:42.489359 bus /gobi_0: Setting Powered False 17:36:43.605895 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 17:36:44.750542 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:44.762494 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:36:44.821094 tst iperf3.py: using LAC 29530 17:36:44.939533 tst iperf3.py: using RAC 205 17:36:45.066177 tst iperf3.py: using CellId 29530 17:36:45.194044 tst iperf3.py: using BVCI 29531 17:36:45.311536 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:45.323581 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:45.335559 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:45.347783 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:45.359892 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:45.371748 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:45.383884 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:45.395933 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:45.407559 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:36:45.523490 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:36:45.725628 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:46.060700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29676): Launched 17:36:46.344242 run iperf3-srv_10.42.42.10(pid=29677): Launched 17:36:46.470709 tst iperf3.py:8: start network... 17:36:46.674835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:36:47.153734 run create_hlr_db(pid=29678): Launched 17:36:47.291202 bus /gobi_6: Setting Powered False 17:36:48.350167 run create_hlr_db(pid=29678): Terminated: ok {rc=0} 17:36:48.788348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29680): Launched 17:36:49.109608 run osmo-hlr_10.42.42.2(pid=29681): Launched 17:36:49.233175 run osmo-stp_10.42.42.5: Starting osmo-stp 17:36:49.786159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29683): Launched 17:36:50.107093 run osmo-stp_10.42.42.5(pid=29684): Launched 17:36:50.229928 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:36:50.782294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29686): Launched 17:36:50.905158 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:36:51.175435 run patchelf(pid=29687): Launched 17:36:51.354641 run osmo-stp_10.42.42.5(pid=29684): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29684)] 17:36:51.490338 run osmo-stp_10.42.42.5(pid=29684): stdout: | (launched: 2022-12-10_17:36:50.048462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:51.627651 run osmo-stp_10.42.42.5(pid=29684): stderr: | 20221210173650238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173650238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173650239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173650239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173650239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173650239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173650239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:51.765024 run osmo-stp_10.42.42.5(pid=29684): stdout: | (launched: 2022-12-10_17:36:50.048462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:51.896479 run osmo-stp_10.42.42.5(pid=29684): stderr: | 20221210173650238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173650238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173650239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173650239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173650239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173650239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173650239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:52.052166 run patchelf(pid=29687): Terminating (SIGINT) 17:36:52.232340 run patchelf(pid=29687): Terminated: ok {rc=0} 17:36:52.362136 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29684): Process ended prematurely: osmo-stp_10.42.42.5(pid=29684) [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29684)] [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 17:36:52.372135 tst iperf3.py:8: Test FAILED (7.7 sec) 17:36:52.401201 run osmo-hlr_10.42.42.2(pid=29681): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29681)] 17:36:52.451061 run osmo-hlr_10.42.42.2(pid=29681): stdout: | (launched: 2022-12-10_17:36:49.051305) 17:36:52.502624 run osmo-hlr_10.42.42.2(pid=29681): stderr: | 20221210173649249 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173649249 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173649249 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173649249 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173649249 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173649249 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173649262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173649270 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173649270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173649270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:36:52.554588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29676): Terminating (SIGTERM) 17:36:52.596248 run iperf3-srv_10.42.42.10(pid=29677): Terminating (SIGTERM) 17:36:52.637813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29680): Terminating (SIGTERM) 17:36:52.679499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29683): Terminating (SIGTERM) 17:36:52.721061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29686): Terminating (SIGTERM) 17:36:52.762797 --- ParallelTerminationStrategy: PID 29676 died... 17:36:52.782552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29676): Terminated: ok {rc=0} 17:36:52.828855 --- ParallelTerminationStrategy: PID 29677 died... 17:36:52.848067 run iperf3-srv_10.42.42.10(pid=29677): Terminated {rc=256} 17:36:52.893801 --- ParallelTerminationStrategy: PID 29680 died... 17:36:52.913083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29680): Terminated: ok {rc=0} 17:36:52.959145 --- ParallelTerminationStrategy: PID 29683 died... 17:36:52.978509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29683): Terminated: ok {rc=0} 17:36:53.024653 --- ParallelTerminationStrategy: PID 29686 died... 17:36:53.044103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29686): Terminated: ok {rc=0} 17:36:53.131887 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 17:36:54.279128 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:54.291251 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:36:54.342760 tst iperf3m4.py: using LAC 29531 17:36:54.467557 tst iperf3m4.py: using RAC 206 17:36:54.585075 tst iperf3m4.py: using CellId 29531 17:36:54.701768 tst iperf3m4.py: using BVCI 29532 17:36:54.811907 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:54.823268 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:54.834480 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:54.845621 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:54.856722 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:54.867944 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:54.879126 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:54.890148 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:54.901430 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:36:55.022211 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:36:55.144205 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:36:55.262706 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:36:55.378909 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:36:55.579674 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:55.880744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29688): Launched 17:36:56.142884 run iperf3-srv_10.42.42.10(pid=29689): Launched 17:36:56.255349 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:36:56.454876 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:56.754839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29690): Launched 17:36:57.015024 run iperf3-srv_10.42.42.10(pid=29691): Launched 17:36:57.128079 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:36:57.328860 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:57.629276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29692): Launched 17:36:57.890638 run iperf3-srv_10.42.42.10(pid=29693): Launched 17:36:58.003114 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:36:58.203913 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:58.504651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29694): Launched 17:36:58.765944 run iperf3-srv_10.42.42.10(pid=29695): Launched 17:36:58.878404 tst iperf3m4.py:8: start network... 17:36:59.078352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:36:59.541718 run create_hlr_db(pid=29696): Launched 17:36:59.664450 bus /gobi_6: Setting Powered False 17:37:00.724556 run create_hlr_db(pid=29696): Terminated: ok {rc=0} 17:37:01.182150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29698): Launched 17:37:01.507345 run osmo-hlr_10.42.42.2(pid=29699): Launched 17:37:01.717374 run osmo-stp_10.42.42.5: Starting osmo-stp 17:37:02.388730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29701): Launched 17:37:02.687864 run osmo-stp_10.42.42.5(pid=29702): Launched 17:37:02.801072 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:37:03.314658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29704): Launched 17:37:03.429123 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:37:03.681202 run patchelf(pid=29705): Launched 17:37:03.848680 run osmo-stp_10.42.42.5(pid=29702): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29702)] 17:37:03.975573 run osmo-stp_10.42.42.5(pid=29702): stdout: | (launched: 2022-12-10_17:37:02.633116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:04.103581 run osmo-stp_10.42.42.5(pid=29702): stderr: | 20221210173702799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173702799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173702799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173702800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173702800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173702800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173702800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:04.232583 run osmo-stp_10.42.42.5(pid=29702): stdout: | (launched: 2022-12-10_17:37:02.633116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:04.355508 run osmo-stp_10.42.42.5(pid=29702): stderr: | 20221210173702799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173702799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173702799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173702800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173702800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173702800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173702800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:04.501130 run patchelf(pid=29705): Terminating (SIGINT) 17:37:04.669110 run patchelf(pid=29705): Terminated: ok {rc=0} 17:37:04.789930 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29702): Process ended prematurely: osmo-stp_10.42.42.5(pid=29702) [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29702)] [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 17:37:04.799397 tst iperf3m4.py:8: Test FAILED (10.6 sec) 17:37:04.826976 run osmo-hlr_10.42.42.2(pid=29699): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29699)] 17:37:04.874218 run osmo-hlr_10.42.42.2(pid=29699): stdout: | (launched: 2022-12-10_17:37:01.445510) 17:37:04.923065 run osmo-hlr_10.42.42.2(pid=29699): stderr: | 20221210173701783 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173701783 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173701783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173701783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173701783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173701783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173701799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173701812 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173701812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173701812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:37:04.972204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29688): Terminating (SIGTERM) 17:37:05.011686 run iperf3-srv_10.42.42.10(pid=29689): Terminating (SIGTERM) 17:37:05.051010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29690): Terminating (SIGTERM) 17:37:05.090244 run iperf3-srv_10.42.42.10(pid=29691): Terminating (SIGTERM) 17:37:05.129687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29692): Terminating (SIGTERM) 17:37:05.169210 run iperf3-srv_10.42.42.10(pid=29693): Terminating (SIGTERM) 17:37:05.208532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29694): Terminating (SIGTERM) 17:37:05.247963 run iperf3-srv_10.42.42.10(pid=29695): Terminating (SIGTERM) 17:37:05.287170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29698): Terminating (SIGTERM) 17:37:05.326578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29701): Terminating (SIGTERM) 17:37:05.365903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29704): Terminating (SIGTERM) 17:37:05.405545 --- ParallelTerminationStrategy: PID 29688 died... 17:37:05.424353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29688): Terminated: ok {rc=0} 17:37:05.468192 --- ParallelTerminationStrategy: PID 29689 died... 17:37:05.486808 run iperf3-srv_10.42.42.10(pid=29689): Terminated {rc=256} 17:37:05.530236 --- ParallelTerminationStrategy: PID 29690 died... 17:37:05.548700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29690): Terminated: ok {rc=0} 17:37:05.592202 --- ParallelTerminationStrategy: PID 29691 died... 17:37:05.610867 run iperf3-srv_10.42.42.10(pid=29691): Terminated {rc=256} 17:37:05.654396 --- ParallelTerminationStrategy: PID 29692 died... 17:37:05.672892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29692): Terminated: ok {rc=0} 17:37:05.716775 --- ParallelTerminationStrategy: PID 29693 died... 17:37:05.735383 run iperf3-srv_10.42.42.10(pid=29693): Terminated {rc=256} 17:37:05.779631 --- ParallelTerminationStrategy: PID 29694 died... 17:37:05.798237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29694): Terminated: ok {rc=0} 17:37:05.841758 --- ParallelTerminationStrategy: PID 29695 died... 17:37:05.860179 run iperf3-srv_10.42.42.10(pid=29695): Terminated {rc=256} 17:37:05.904637 --- ParallelTerminationStrategy: PID 29698 died... 17:37:05.923339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29698): Terminated: ok {rc=0} 17:37:05.967355 --- ParallelTerminationStrategy: PID 29701 died... 17:37:05.985971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29701): Terminated: ok {rc=0} 17:37:06.029736 --- ParallelTerminationStrategy: PID 29704 died... 17:37:06.048316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29704): Terminated: ok {rc=0} 17:37:06.134788 bus /gobi_4: Setting Powered False 17:37:07.234330 bus /gobi_4: Setting Powered False 17:37:08.346574 bus /gobi_1: Setting Powered False 17:37:09.444939 bus /gobi_1: Setting Powered False 17:37:10.561434 bus /gobi_0: Setting Powered False 17:37:11.659631 bus /gobi_0: Setting Powered False 17:37:12.776694 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 17:37:13.878560 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:13.890816 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:37:13.945216 tst ping.py: using LAC 29532 17:37:14.069763 tst ping.py: using RAC 207 17:37:14.194911 tst ping.py: using CellId 29532 17:37:14.313363 tst ping.py: using BVCI 29533 17:37:14.419306 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:14.430911 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:14.442467 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:14.454037 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:14.465515 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:14.476903 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:14.488319 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:14.499769 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:37:14.613893 tst ping.py:19: start network... 17:37:14.809390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:37:15.264615 run create_hlr_db(pid=29706): Launched 17:37:15.385618 bus /gobi_6: Setting Powered False 17:37:16.443872 run create_hlr_db(pid=29706): Terminated: ok {rc=0} 17:37:16.864144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29708): Launched 17:37:17.175991 run osmo-hlr_10.42.42.2(pid=29709): Launched 17:37:17.309384 run osmo-stp_10.42.42.5: Starting osmo-stp 17:37:17.817683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29711): Launched 17:37:18.111688 run osmo-stp_10.42.42.5(pid=29712): Launched 17:37:18.224181 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:37:18.734576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29714): Launched 17:37:18.847381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:37:19.095552 run patchelf(pid=29715): Launched 17:37:19.260332 run osmo-stp_10.42.42.5(pid=29712): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29712)] 17:37:19.385802 run osmo-stp_10.42.42.5(pid=29712): stdout: | (launched: 2022-12-10_17:37:18.057404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:19.512380 run osmo-stp_10.42.42.5(pid=29712): stderr: | 20221210173718225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173718225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173718225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173718225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173718226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173718226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173718226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:19.638985 run osmo-stp_10.42.42.5(pid=29712): stdout: | (launched: 2022-12-10_17:37:18.057404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:19.760147 run osmo-stp_10.42.42.5(pid=29712): stderr: | 20221210173718225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173718225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173718225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173718225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173718226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173718226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173718226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:19.903735 run patchelf(pid=29715): Terminating (SIGINT) 17:37:20.069213 run patchelf(pid=29715): Terminated: ok {rc=0} 17:37:20.189387 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29712): Process ended prematurely: osmo-stp_10.42.42.5(pid=29712) [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29712)] [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 17:37:20.198371 tst ping.py:22: Test FAILED (6.3 sec) 17:37:20.225222 run osmo-hlr_10.42.42.2(pid=29709): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29709)] 17:37:20.272838 run osmo-hlr_10.42.42.2(pid=29709): stdout: | (launched: 2022-12-10_17:37:17.121798) 17:37:20.322209 run osmo-hlr_10.42.42.2(pid=29709): stderr: | 20221210173717323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173717323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173717324 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173717324 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173717324 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173717324 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173717335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173717344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173717344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173717344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:37:20.371643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29708): Terminating (SIGTERM) 17:37:20.411201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29711): Terminating (SIGTERM) 17:37:20.450912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29714): Terminating (SIGTERM) 17:37:20.490684 --- ParallelTerminationStrategy: PID 29708 died... 17:37:20.509773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29708): Terminated: ok {rc=0} 17:37:20.553711 --- ParallelTerminationStrategy: PID 29711 died... 17:37:20.572249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29711): Terminated: ok {rc=0} 17:37:20.616340 --- ParallelTerminationStrategy: PID 29714 died... 17:37:20.634946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29714): Terminated: ok {rc=0} 17:37:20.721249 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 17:37:21.809149 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:21.821303 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:37:21.876002 tst ping_idle_ping.py: using LAC 29533 17:37:22.003239 tst ping_idle_ping.py: using RAC 208 17:37:22.127900 tst ping_idle_ping.py: using CellId 29533 17:37:22.252312 tst ping_idle_ping.py: using BVCI 29534 17:37:22.369648 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:22.381482 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:22.393088 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:22.404798 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:22.416563 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:22.428359 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:22.440306 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:22.452022 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:37:22.568365 tst ping_idle_ping.py:24: start network... 17:37:22.766838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:37:23.227024 run create_hlr_db(pid=29716): Launched 17:37:23.348030 bus /gobi_6: Setting Powered False 17:37:24.407302 run create_hlr_db(pid=29716): Terminated: ok {rc=0} 17:37:24.820126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29718): Launched 17:37:25.115614 run osmo-hlr_10.42.42.2(pid=29719): Launched 17:37:25.228871 run osmo-stp_10.42.42.5: Starting osmo-stp 17:37:25.751091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29721): Launched 17:37:26.045736 run osmo-stp_10.42.42.5(pid=29722): Launched 17:37:26.157993 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:37:26.668294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29724): Launched 17:37:26.781686 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:37:27.029899 run patchelf(pid=29725): Launched 17:37:27.194310 run osmo-stp_10.42.42.5(pid=29722): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29722)] 17:37:27.319273 run osmo-stp_10.42.42.5(pid=29722): stdout: | (launched: 2022-12-10_17:37:25.991900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:27.445559 run osmo-stp_10.42.42.5(pid=29722): stderr: | 20221210173726163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173726163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173726164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173726164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173726165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173726165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173726165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:27.572461 run osmo-stp_10.42.42.5(pid=29722): stdout: | (launched: 2022-12-10_17:37:25.991900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:27.693727 run osmo-stp_10.42.42.5(pid=29722): stderr: | 20221210173726163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173726163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173726164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173726164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173726165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173726165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173726165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:27.837144 run patchelf(pid=29725): Terminating (SIGINT) 17:37:28.002025 run patchelf(pid=29725): Terminated: ok {rc=0} 17:37:28.120776 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29722): Process ended prematurely: osmo-stp_10.42.42.5(pid=29722) [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29722)] [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 17:37:28.129847 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 17:37:28.156402 run osmo-hlr_10.42.42.2(pid=29719): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29719)] 17:37:28.203790 run osmo-hlr_10.42.42.2(pid=29719): stdout: | (launched: 2022-12-10_17:37:25.061129) 17:37:28.252364 run osmo-hlr_10.42.42.2(pid=29719): stderr: | 20221210173725239 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173725239 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173725239 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173725239 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173725239 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173725239 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173725252 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173725262 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173725262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173725262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:37:28.301378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29718): Terminating (SIGTERM) 17:37:28.341291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29721): Terminating (SIGTERM) 17:37:28.381407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29724): Terminating (SIGTERM) 17:37:28.421586 --- ParallelTerminationStrategy: PID 29718 died... 17:37:28.440481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29718): Terminated: ok {rc=0} 17:37:28.483896 --- ParallelTerminationStrategy: PID 29721 died... 17:37:28.502322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29721): Terminated: ok {rc=0} 17:37:28.545369 --- ParallelTerminationStrategy: PID 29724 died... 17:37:28.563624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29724): Terminated: ok {rc=0} 17:37:28.649926 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:37:29.957369 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:37:29.964154 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:37:29.997353 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:37:30.031466 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:37:30.085851 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:37:30.119555 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:37:30.153603 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:37:30.711944 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2377 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:37:30.716802 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:30.728109 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:37:30.795872 tst switch_tch_pdch.py: using LAC 29534 17:37:30.943498 tst switch_tch_pdch.py: using RAC 209 17:37:31.075861 tst switch_tch_pdch.py: using CellId 29534 17:37:31.216176 tst switch_tch_pdch.py: using BVCI 29535 17:37:31.334831 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:31.346970 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:31.358858 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:31.370756 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:31.382590 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:31.394446 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:31.406455 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:31.418391 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:37:31.538738 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:37:31.654197 tst switch_tch_pdch.py:51: start network... 17:37:31.853234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:37:32.319708 run create_hlr_db(pid=29730): Launched 17:37:32.456640 bus /gobi_6: Setting Powered False 17:37:33.520220 run create_hlr_db(pid=29730): Terminated: ok {rc=0} 17:37:33.944500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29732): Launched 17:37:34.238150 run osmo-hlr_10.42.42.2(pid=29733): Launched 17:37:34.350369 run osmo-stp_10.42.42.5: Starting osmo-stp 17:37:34.869403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29735): Launched 17:37:35.163220 run osmo-stp_10.42.42.5(pid=29736): Launched 17:37:35.274684 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:37:35.782383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29738): Launched 17:37:35.896273 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:37:36.144490 run patchelf(pid=29742): Launched 17:37:36.308450 run osmo-stp_10.42.42.5(pid=29736): ERR: Terminated: ERROR {rc=1} [trial-2377↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29736)] 17:37:36.434269 run osmo-stp_10.42.42.5(pid=29736): stdout: | (launched: 2022-12-10_17:37:35.109357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:36.560231 run osmo-stp_10.42.42.5(pid=29736): stderr: | 20221210173735279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173735279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173735280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173735280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173735282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173735282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173735282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:36.686506 run osmo-stp_10.42.42.5(pid=29736): stdout: | (launched: 2022-12-10_17:37:35.109357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:36.806835 run osmo-stp_10.42.42.5(pid=29736): stderr: | 20221210173735279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173735279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173735280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173735280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173735282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173735282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173735282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:36.949611 run patchelf(pid=29742): Terminating (SIGINT) 17:37:37.114041 run patchelf(pid=29742): Terminated: ok {rc=0} 17:37:37.232219 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29736): Process ended prematurely: osmo-stp_10.42.42.5(pid=29736) [trial-2377↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29736)] [trial-2377↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:37:37.241090 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 17:37:37.267506 run osmo-hlr_10.42.42.2(pid=29733): ERR: Terminated: ERROR {rc=237} [trial-2377↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29733)] 17:37:37.314444 run osmo-hlr_10.42.42.2(pid=29733): stdout: | (launched: 2022-12-10_17:37:34.184702) 17:37:37.362971 run osmo-hlr_10.42.42.2(pid=29733): stderr: | 20221210173734359 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173734359 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173734359 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173734359 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173734359 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173734359 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173734371 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173734380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173734380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173734380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:37:37.411838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29732): Terminating (SIGTERM) 17:37:37.451271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29735): Terminating (SIGTERM) 17:37:37.490548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29738): Terminating (SIGTERM) 17:37:37.530135 --- ParallelTerminationStrategy: PID 29732 died... 17:37:37.549215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29732): Terminated: ok {rc=0} 17:37:37.593264 --- ParallelTerminationStrategy: PID 29735 died... 17:37:37.611603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29735): Terminated: ok {rc=0} 17:37:37.655197 --- ParallelTerminationStrategy: PID 29738 died... 17:37:37.673749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29738): Terminated: ok {rc=0} 17:37:37.758788 bus /gobi_0: Setting Powered False 17:37:38.857250 bus /gobi_0: Setting Powered False 17:37:39.969891 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:37:41.222571 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:37:41.228504 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:37:41.261130 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:37:41.295234 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:37:41.347611 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:37:41.380185 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:37:41.414118 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:37:41.969573 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2377 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:37:41.974477 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:41.985423 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:37:42.054119 tst switch_tch_pdch.py: using LAC 29535 17:37:42.171529 tst switch_tch_pdch.py: using RAC 210 17:37:42.288074 tst switch_tch_pdch.py: using CellId 29535 17:37:42.402554 tst switch_tch_pdch.py: using BVCI 29536 17:37:42.511244 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:42.522155 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:42.532765 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:42.543498 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:42.554201 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:42.564838 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:42.575591 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:42.586219 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:37:42.701491 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:37:42.815232 tst switch_tch_pdch.py:51: start network... 17:37:43.011047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:37:43.440017 run create_hlr_db(pid=29746): Launched 17:37:43.560005 bus /gobi_6: Setting Powered False 17:37:44.619749 run create_hlr_db(pid=29746): Terminated: ok {rc=0} 17:37:45.005286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29748): Launched 17:37:45.298233 run osmo-hlr_10.42.42.2(pid=29749): Launched 17:37:45.409321 run osmo-stp_10.42.42.5: Starting osmo-stp 17:37:45.917719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29751): Launched 17:37:46.237659 run osmo-stp_10.42.42.5(pid=29752): Launched 17:37:46.521682 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:37:47.019887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29754): Launched 17:37:47.147364 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:37:47.399175 run patchelf(pid=29755): Launched 17:37:47.563669 run osmo-stp_10.42.42.5(pid=29752): ERR: Terminated: ERROR {rc=1} [trial-2377↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29752)] 17:37:47.688523 run osmo-stp_10.42.42.5(pid=29752): stdout: | (launched: 2022-12-10_17:37:46.180670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:47.814989 run osmo-stp_10.42.42.5(pid=29752): stderr: | 20221210173746373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173746374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173746374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173746375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173746377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173746378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173746378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:47.941434 run osmo-stp_10.42.42.5(pid=29752): stdout: | (launched: 2022-12-10_17:37:46.180670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:48.062470 run osmo-stp_10.42.42.5(pid=29752): stderr: | 20221210173746373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173746374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173746374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173746375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173746377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173746378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173746378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:48.205623 run patchelf(pid=29755): Terminating (SIGINT) 17:37:48.370763 run patchelf(pid=29755): Terminated: ok {rc=0} 17:37:48.489589 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29752): Process ended prematurely: osmo-stp_10.42.42.5(pid=29752) [trial-2377↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29752)] [trial-2377↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:37:48.498638 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 17:37:48.525185 run osmo-hlr_10.42.42.2(pid=29749): ERR: Terminated: ERROR {rc=237} [trial-2377↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29749)] 17:37:48.572193 run osmo-hlr_10.42.42.2(pid=29749): stdout: | (launched: 2022-12-10_17:37:45.244444) 17:37:48.621174 run osmo-hlr_10.42.42.2(pid=29749): stderr: | 20221210173745420 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173745420 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173745420 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173745420 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173745421 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173745421 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173745436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173745446 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173745446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173745446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:37:48.670182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29748): Terminating (SIGTERM) 17:37:48.709268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29751): Terminating (SIGTERM) 17:37:48.748148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29754): Terminating (SIGTERM) 17:37:48.787386 --- ParallelTerminationStrategy: PID 29748 died... 17:37:48.806258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29748): Terminated: ok {rc=0} 17:37:48.849742 --- ParallelTerminationStrategy: PID 29751 died... 17:37:48.868148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29751): Terminated: ok {rc=0} 17:37:48.911260 --- ParallelTerminationStrategy: PID 29754 died... 17:37:48.929541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29754): Terminated: ok {rc=0} 17:37:49.014461 bus /gobi_0: Setting Powered False 17:37:50.114327 bus /gobi_0: Setting Powered False 17:37:51.228341 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 17:37:52.481776 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:37:52.486348 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:37:52.519676 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 17:37:52.526655 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 17:37:52.578879 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:37:52.612478 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 17:37:52.619115 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 17:37:53.159868 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 17:37:53.165711 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 17:37:53.177211 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:37:53.230252 tst mo_mt_sms.py: using LAC 29536 17:37:53.355625 tst mo_mt_sms.py: using RAC 211 17:37:53.478095 tst mo_mt_sms.py: using CellId 29536 17:37:53.600401 tst mo_mt_sms.py: using BVCI 29537 17:37:53.714225 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:37:53.833415 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:37:53.949193 tst mo_mt_sms.py:9: start nitb and bts... 17:37:54.162515 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:37:54.805164 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29759): Launched 17:37:55.121360 run osmo-nitb_10.42.42.2(pid=29760): Launched 17:37:55.297663 run osmo-nitb_10.42.42.2(pid=29760): ERR: Terminated: ERROR {rc=2} [trial-2377↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29760)] 17:37:55.439969 run osmo-nitb_10.42.42.2(pid=29760): stdout: | (launched: 2022-12-10_17:37:55.064173) 17:37:55.583275 run osmo-nitb_10.42.42.2(pid=29760): stderr: | (launched: 2022-12-10_17:37:55.111007) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:37:55.726576 run osmo-nitb_10.42.42.2(pid=29760): stdout: | (launched: 2022-12-10_17:37:55.064173) 17:37:55.863957 run osmo-nitb_10.42.42.2(pid=29760): stderr: | (launched: 2022-12-10_17:37:55.111007) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f2803594268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29760): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29760) [trial-2377↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29760)] 17:37:56.241116 tst osmo-nitb_10.42.42.2(pid=29760): stdout: | (launched: 2022-12-10_17:37:55.064173) 17:37:56.368165 tst osmo-nitb_10.42.42.2(pid=29760): stderr: | (launched: 2022-12-10_17:37:55.111007) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:37:56.518119 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=29760): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29760) [trial-2377↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29760)] [trial-2377↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 17:37:56.527269 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 17:37:56.534326 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29759): Terminating (SIGTERM) 17:37:56.745646 --- ParallelTerminationStrategy: PID 29759 died... 17:37:56.767395 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29759): Terminated: ok {rc=0} 17:37:56.855537 bus /sierra_3: Setting Powered False 17:37:57.953477 bus /sierra_3: Setting Powered False 17:37:59.070063 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 sms:trx-sysmocell5000 --------------------------------------------------------------------- 17:38:00.267562 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:38:00.271539 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:38:00.305445 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:38:00.332097 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 17:38:00.383505 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:38:00.417082 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:38:00.443460 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 17:38:00.993931 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 17:38:01.000161 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:01.011782 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:38:01.059830 tst mo_mt_sms.py: using LAC 29537 17:38:01.182404 tst mo_mt_sms.py: using RAC 212 17:38:01.334536 tst mo_mt_sms.py: using CellId 29537 17:38:01.463732 tst mo_mt_sms.py: using BVCI 29538 17:38:01.585685 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:01.598221 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:01.610795 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:01.625338 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:01.638740 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:01.651130 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:38:01.807237 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:38:01.960133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:38:02.487808 run create_hlr_db(pid=29764): Launched 17:38:02.610616 bus /sierra_2: Setting Powered False 17:38:03.669341 run create_hlr_db(pid=29764): Terminated: ok {rc=0} 17:38:04.102304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29766): Launched 17:38:04.422054 run osmo-hlr_10.42.42.2(pid=29767): Launched 17:38:04.542198 run osmo-stp_10.42.42.5: Starting osmo-stp 17:38:05.089568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29769): Launched 17:38:05.405602 run osmo-stp_10.42.42.5(pid=29770): Launched 17:38:05.528074 run osmo-msc_10.42.42.6: Starting osmo-msc 17:38:06.099652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29772): Launched 17:38:06.417196 run osmo-msc_10.42.42.6(pid=29773): Launched 17:38:06.594195 run osmo-stp_10.42.42.5(pid=29770): ERR: Terminated: ERROR {rc=1} [trial-2377↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29770)] 17:38:06.728120 run osmo-stp_10.42.42.5(pid=29770): stdout: | (launched: 2022-12-10_17:38:05.348317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:06.861988 run osmo-stp_10.42.42.5(pid=29770): stderr: | 20221210173805539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173805539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173805540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173805540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173805540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173805541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173805541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:06.995400 run osmo-stp_10.42.42.5(pid=29770): stdout: | (launched: 2022-12-10_17:38:05.348317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:07.121187 run osmo-stp_10.42.42.5(pid=29770): stderr: | 20221210173805539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173805539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173805540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173805540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173805540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173805541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173805541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:07.272157 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29770): Process ended prematurely: osmo-stp_10.42.42.5(pid=29770) [trial-2377↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29770)] [trial-2377↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 17:38:07.280989 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 17:38:07.309105 run osmo-hlr_10.42.42.2(pid=29767): ERR: Terminated: ERROR {rc=237} [trial-2377↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29767)] 17:38:07.360587 run osmo-hlr_10.42.42.2(pid=29767): stdout: | (launched: 2022-12-10_17:38:04.364333) 17:38:07.412824 run osmo-hlr_10.42.42.2(pid=29767): stderr: | 20221210173804562 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173804562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173804562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173804562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173804562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173804562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173804575 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173804583 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173804583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173804583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:38:07.485445 run osmo-msc_10.42.42.6(pid=29773): ERR: Terminated: ERROR {rc=2} [trial-2377↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29773)] 17:38:07.536054 run osmo-msc_10.42.42.6(pid=29773): stdout: | (launched: 2022-12-10_17:38:06.359426) 17:38:07.588122 run osmo-msc_10.42.42.6(pid=29773): stderr: | 20221210173806684 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173806684 DLGLOBAL DEBUG validating counter group 0x7ff257570c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173806684 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173806684 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173806684 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173806684 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173806686 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173806686 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173806687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173806687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:38:07.640728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29766): Terminating (SIGTERM) 17:38:07.682813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29769): Terminating (SIGTERM) 17:38:07.724902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29772): Terminating (SIGTERM) 17:38:07.767160 --- ParallelTerminationStrategy: PID 29766 died... 17:38:07.786876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29766): Terminated: ok {rc=0} 17:38:07.833953 --- ParallelTerminationStrategy: PID 29769 died... 17:38:07.853256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29769): Terminated: ok {rc=0} 17:38:07.900078 --- ParallelTerminationStrategy: PID 29772 died... 17:38:07.919387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29772): Terminated: ok {rc=0} 17:38:08.008292 bus /sierra_3: Setting Powered False 17:38:09.106290 bus /sierra_3: Setting Powered False 17:38:10.221335 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 17:38:11.455995 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:38:11.460107 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:38:11.496447 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 17:38:11.503498 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 17:38:11.540929 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:38:11.576176 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 17:38:11.583138 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 17:38:12.102538 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2377 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 17:38:12.107598 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 17:38:12.118893 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:38:12.171484 tst assert_extension.py: using LAC 29538 17:38:12.297358 tst assert_extension.py: using RAC 213 17:38:12.421232 tst assert_extension.py: using CellId 29538 17:38:12.548679 tst assert_extension.py: using BVCI 29539 17:38:12.664611 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 17:38:12.777334 tst assert_extension.py:10: start nitb and bts... 17:38:12.974064 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:38:13.576830 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29778): Launched 17:38:13.873748 run osmo-nitb_10.42.42.2(pid=29779): Launched 17:38:14.036350 run osmo-nitb_10.42.42.2(pid=29779): ERR: Terminated: ERROR {rc=2} [trial-2377↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29779)] 17:38:14.168797 run osmo-nitb_10.42.42.2(pid=29779): stdout: | (launched: 2022-12-10_17:38:13.819456) 17:38:14.303035 run osmo-nitb_10.42.42.2(pid=29779): stderr: | (launched: 2022-12-10_17:38:13.863074) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:38:14.436514 run osmo-nitb_10.42.42.2(pid=29779): stdout: | (launched: 2022-12-10_17:38:13.819456) 17:38:14.565271 run osmo-nitb_10.42.42.2(pid=29779): stderr: | (launched: 2022-12-10_17:38:13.863074) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f2803594268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29779): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29779) [trial-2377↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29779)] 17:38:14.984432 tst osmo-nitb_10.42.42.2(pid=29779): stdout: | (launched: 2022-12-10_17:38:13.819456) 17:38:15.103474 tst osmo-nitb_10.42.42.2(pid=29779): stderr: | (launched: 2022-12-10_17:38:13.863074) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:38:15.243674 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29779): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29779) [trial-2377↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29779)] [trial-2377↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 17:38:15.252285 tst assert_extension.py:12: Test FAILED (3.1 sec) 17:38:15.259408 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29778): Terminating (SIGTERM) 17:38:15.468814 --- ParallelTerminationStrategy: PID 29778 died... 17:38:15.489385 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29778): Terminated: ok {rc=0} 17:38:15.575624 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 17:38:16.782737 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:38:16.790449 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:38:16.842081 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:38:16.882478 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 17:38:16.928491 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:38:16.984235 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:38:17.028792 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 17:38:17.561014 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2377 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 17:38:17.567702 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:17.584398 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:38:17.654073 tst assert_extension.py: using LAC 29539 17:38:17.803237 tst assert_extension.py: using RAC 214 17:38:17.955071 tst assert_extension.py: using CellId 29539 17:38:18.111555 tst assert_extension.py: using BVCI 29540 17:38:18.270392 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:18.287009 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:18.301101 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:18.314095 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:18.329575 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:18.345202 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 17:38:18.500619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:38:19.090303 run create_hlr_db(pid=30053): Launched 17:38:19.256712 bus /sierra_2: Setting Powered False 17:38:20.319431 run create_hlr_db(pid=30053): Terminated: ok {rc=0} 17:38:20.771950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30055): Launched 17:38:21.109383 run osmo-hlr_10.42.42.2(pid=30057): Launched 17:38:21.352488 run osmo-stp_10.42.42.5: Starting osmo-stp 17:38:22.092646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30060): Launched 17:38:22.417514 run osmo-stp_10.42.42.5(pid=30061): Launched 17:38:22.648535 run osmo-msc_10.42.42.6: Starting osmo-msc 17:38:23.306618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30063): Launched 17:38:23.632360 run osmo-msc_10.42.42.6(pid=30064): Launched 17:38:23.979485 run osmo-stp_10.42.42.5(pid=30061): ERR: Terminated: ERROR {rc=1} [trial-2377↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30061)] 17:38:24.262466 run osmo-stp_10.42.42.5(pid=30061): stdout: | (launched: 2022-12-10_17:38:22.361828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:24.438809 run osmo-stp_10.42.42.5(pid=30061): stderr: | 20221210173822650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173822650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173822650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173822651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173822651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173822651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173822651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:24.574379 run osmo-stp_10.42.42.5(pid=30061): stdout: | (launched: 2022-12-10_17:38:22.361828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:24.703444 run osmo-stp_10.42.42.5(pid=30061): stderr: | 20221210173822650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173822650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173822650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173822651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173822651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173822651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173822651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:24.856680 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30061): Process ended prematurely: osmo-stp_10.42.42.5(pid=30061) [trial-2377↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30061)] [trial-2377↪ussd:trx-sysmocell5000↪assert_extension.py:17] 17:38:24.866680 tst assert_extension.py:17: Test FAILED (7.3 sec) 17:38:24.897742 run osmo-hlr_10.42.42.2(pid=30057): ERR: Terminated: ERROR {rc=237} [trial-2377↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30057)] 17:38:24.950715 run osmo-hlr_10.42.42.2(pid=30057): stdout: | (launched: 2022-12-10_17:38:21.048258) 17:38:25.005431 run osmo-hlr_10.42.42.2(pid=30057): stderr: | 20221210173821342 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173821342 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173821342 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173821342 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173821342 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173821343 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173821367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173821384 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173821384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173821384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:38:25.082138 run osmo-msc_10.42.42.6(pid=30064): ERR: Terminated: ERROR {rc=2} [trial-2377↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30064)] 17:38:25.135761 run osmo-msc_10.42.42.6(pid=30064): stdout: | (launched: 2022-12-10_17:38:23.575684) 17:38:25.190007 run osmo-msc_10.42.42.6(pid=30064): stderr: | 20221210173824071 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173824071 DLGLOBAL DEBUG validating counter group 0x7fe782a0ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173824071 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173824071 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173824071 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173824071 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173824081 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173824082 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173824082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173824082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:38:25.245842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30055): Terminating (SIGTERM) 17:38:25.292469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30060): Terminating (SIGTERM) 17:38:25.339460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30063): Terminating (SIGTERM) 17:38:25.386397 --- ParallelTerminationStrategy: PID 30055 died... 17:38:25.407247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30055): Terminated: ok {rc=0} 17:38:25.458962 --- ParallelTerminationStrategy: PID 30060 died... 17:38:25.479367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30060): Terminated: ok {rc=0} 17:38:25.529134 --- ParallelTerminationStrategy: PID 30063 died... 17:38:25.549969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30063): Terminated: ok {rc=0} 17:38:25.643294 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:38:26.866120 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:38:26.875136 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:38:26.914561 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:38:26.943919 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:38:26.996355 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:38:27.033250 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:38:27.064125 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:38:27.616432 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:38:27.673952 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:27.686717 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:38:27.759271 tst mo_mt_call.py: using LAC 29540 17:38:27.885307 tst mo_mt_call.py: using RAC 215 17:38:28.010264 tst mo_mt_call.py: using CellId 29540 17:38:28.139156 tst mo_mt_call.py: using BVCI 29541 17:38:28.258816 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:28.271787 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:28.284265 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:28.298925 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:28.311598 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:28.326426 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:38:28.451590 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:38:28.575611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:38:29.083389 run create_hlr_db(pid=30069): Launched 17:38:29.245908 bus /sierra_2: Setting Powered False 17:38:30.310841 run create_hlr_db(pid=30069): Terminated: ok {rc=0} 17:38:30.764719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30071): Launched 17:38:31.125303 run osmo-hlr_10.42.42.2(pid=30072): Launched 17:38:31.357738 run osmo-stp_10.42.42.5: Starting osmo-stp 17:38:32.178482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30074): Launched 17:38:32.579037 run osmo-stp_10.42.42.5(pid=30075): Launched 17:38:32.858783 run osmo-msc_10.42.42.6: Starting osmo-msc 17:38:33.588858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30077): Launched 17:38:33.930377 run osmo-msc_10.42.42.6(pid=30078): Launched 17:38:34.293619 run osmo-stp_10.42.42.5(pid=30075): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30075)] 17:38:34.569996 run osmo-stp_10.42.42.5(pid=30075): stdout: | (launched: 2022-12-10_17:38:32.513418) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:34.745225 run osmo-stp_10.42.42.5(pid=30075): stderr: | 20221210173832816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173832816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173832816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173832822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173832823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173832823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173832823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:34.882560 run osmo-stp_10.42.42.5(pid=30075): stdout: | (launched: 2022-12-10_17:38:32.513418) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:35.013258 run osmo-stp_10.42.42.5(pid=30075): stderr: | 20221210173832816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173832816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173832816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173832822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173832823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173832823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173832823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:35.170945 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30075): Process ended prematurely: osmo-stp_10.42.42.5(pid=30075) [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30075)] [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:38:35.181924 tst mo_mt_call.py:8: Test FAILED (7.5 sec) 17:38:35.214342 run osmo-hlr_10.42.42.2(pid=30072): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30072)] 17:38:35.268629 run osmo-hlr_10.42.42.2(pid=30072): stdout: | (launched: 2022-12-10_17:38:31.066273) 17:38:35.323622 run osmo-hlr_10.42.42.2(pid=30072): stderr: | 20221210173831324 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173831324 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173831324 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173831324 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173831324 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173831324 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173831344 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173831365 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173831365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173831365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:38:35.399165 run osmo-msc_10.42.42.6(pid=30078): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30078)] 17:38:35.452430 run osmo-msc_10.42.42.6(pid=30078): stdout: | (launched: 2022-12-10_17:38:33.869654) 17:38:35.508026 run osmo-msc_10.42.42.6(pid=30078): stderr: | 20221210173834370 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173834370 DLGLOBAL DEBUG validating counter group 0x7f6aef76cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173834370 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173834370 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173834370 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173834371 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173834372 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173834373 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173834373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173834373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:38:35.563396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30071): Terminating (SIGTERM) 17:38:35.608416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30074): Terminating (SIGTERM) 17:38:35.655274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30077): Terminating (SIGTERM) 17:38:35.702769 --- ParallelTerminationStrategy: PID 30071 died... 17:38:35.723551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30071): Terminated: ok {rc=0} 17:38:35.774837 --- ParallelTerminationStrategy: PID 30074 died... 17:38:35.795206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30074): Terminated: ok {rc=0} 17:38:35.844484 --- ParallelTerminationStrategy: PID 30077 died... 17:38:35.866179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30077): Terminated: ok {rc=0} 17:38:35.958631 bus /sierra_3: Setting Powered False 17:38:37.062702 bus /sierra_3: Setting Powered False 17:38:38.182926 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:38:39.340049 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:39.354091 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:38:39.429933 tst mo_mt_call_osmux.py: using LAC 29541 17:38:39.559223 tst mo_mt_call_osmux.py: using RAC 216 17:38:39.689938 tst mo_mt_call_osmux.py: using CellId 29541 17:38:39.818001 tst mo_mt_call_osmux.py: using BVCI 29542 17:38:39.939509 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:39.953421 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:39.967214 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:39.981036 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:39.993644 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:40.007514 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:38:40.132854 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:38:40.259846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:38:40.760787 run create_hlr_db(pid=30080): Launched 17:38:40.882429 bus /sierra_2: Setting Powered False 17:38:41.945189 run create_hlr_db(pid=30080): Terminated: ok {rc=0} 17:38:42.369301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30082): Launched 17:38:42.665701 run osmo-hlr_10.42.42.2(pid=30083): Launched 17:38:42.778106 run osmo-stp_10.42.42.5: Starting osmo-stp 17:38:43.308072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30085): Launched 17:38:43.605444 run osmo-stp_10.42.42.5(pid=30086): Launched 17:38:43.719544 run osmo-msc_10.42.42.6: Starting osmo-msc 17:38:44.257973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30088): Launched 17:38:44.554828 run osmo-msc_10.42.42.6(pid=30089): Launched 17:38:44.720612 run osmo-stp_10.42.42.5(pid=30086): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30086)] 17:38:44.845238 run osmo-stp_10.42.42.5(pid=30086): stdout: | (launched: 2022-12-10_17:38:43.550488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:44.971162 run osmo-stp_10.42.42.5(pid=30086): stderr: | 20221210173843720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173843720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173843720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173843720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173843721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173843721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173843721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:45.094571 run osmo-stp_10.42.42.5(pid=30086): stdout: | (launched: 2022-12-10_17:38:43.550488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:45.212078 run osmo-stp_10.42.42.5(pid=30086): stderr: | 20221210173843720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173843720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173843720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173843720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173843721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173843721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173843721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:45.352693 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30086): Process ended prematurely: osmo-stp_10.42.42.5(pid=30086) [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30086)] [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:38:45.361754 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:38:45.387521 run osmo-hlr_10.42.42.2(pid=30083): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30083)] 17:38:45.434735 run osmo-hlr_10.42.42.2(pid=30083): stdout: | (launched: 2022-12-10_17:38:42.611397) 17:38:45.483481 run osmo-hlr_10.42.42.2(pid=30083): stderr: | 20221210173842787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173842787 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173842787 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173842787 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173842787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173842787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173842801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173842811 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173842811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173842811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:38:45.551362 run osmo-msc_10.42.42.6(pid=30089): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30089)] 17:38:45.598189 run osmo-msc_10.42.42.6(pid=30089): stdout: | (launched: 2022-12-10_17:38:44.499648) 17:38:45.646720 run osmo-msc_10.42.42.6(pid=30089): stderr: | 20221210173844770 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173844770 DLGLOBAL DEBUG validating counter group 0x7f6ec13d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173844770 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173844771 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173844771 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173844772 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173844774 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173844774 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173844774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173844774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:38:45.696275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30082): Terminating (SIGTERM) 17:38:45.735524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30085): Terminating (SIGTERM) 17:38:45.774751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30088): Terminating (SIGTERM) 17:38:45.814258 --- ParallelTerminationStrategy: PID 30082 died... 17:38:45.846718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30082): Terminated: ok {rc=0} 17:38:45.903133 --- ParallelTerminationStrategy: PID 30085 died... 17:38:45.922405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30085): Terminated: ok {rc=0} 17:38:45.967097 --- ParallelTerminationStrategy: PID 30088 died... 17:38:45.985808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30088): Terminated: ok {rc=0} 17:38:46.069790 bus /sierra_3: Setting Powered False 17:38:47.171598 bus /sierra_3: Setting Powered False 17:38:48.289274 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:38:49.537546 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:38:49.543712 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:38:49.577269 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:38:49.603538 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:38:49.655974 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:38:49.689455 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:38:49.715884 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:38:50.265933 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:38:50.313521 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:38:50.324699 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:38:50.394659 tst mo_mt_call.py: using LAC 29542 17:38:50.512373 tst mo_mt_call.py: using RAC 217 17:38:50.628646 tst mo_mt_call.py: using CellId 29542 17:38:50.744936 tst mo_mt_call.py: using BVCI 29543 17:38:50.852028 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:38:50.863124 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:38:50.874076 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:38:50.884921 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:38:50.895882 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:38:50.906705 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:38:51.023448 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:38:51.141258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:38:51.631843 run create_hlr_db(pid=30094): Launched 17:38:51.753434 bus /sierra_2: Setting Powered False 17:38:52.816110 run create_hlr_db(pid=30094): Terminated: ok {rc=0} 17:38:53.241063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30096): Launched 17:38:53.539694 run osmo-hlr_10.42.42.2(pid=30097): Launched 17:38:53.653451 run osmo-stp_10.42.42.5: Starting osmo-stp 17:38:54.164850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30099): Launched 17:38:54.462815 run osmo-stp_10.42.42.5(pid=30100): Launched 17:38:54.576129 run osmo-msc_10.42.42.6: Starting osmo-msc 17:38:55.119484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30102): Launched 17:38:55.417280 run osmo-msc_10.42.42.6(pid=30103): Launched 17:38:55.583975 run osmo-stp_10.42.42.5(pid=30100): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30100)] 17:38:55.710038 run osmo-stp_10.42.42.5(pid=30100): stdout: | (launched: 2022-12-10_17:38:54.406985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:55.836325 run osmo-stp_10.42.42.5(pid=30100): stderr: | 20221210173854578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173854578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173854579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173854579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173854579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173854579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173854580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:55.960155 run osmo-stp_10.42.42.5(pid=30100): stdout: | (launched: 2022-12-10_17:38:54.406985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:56.078460 run osmo-stp_10.42.42.5(pid=30100): stderr: | 20221210173854578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173854578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173854579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173854579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173854579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173854579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173854580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:56.219739 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30100): Process ended prematurely: osmo-stp_10.42.42.5(pid=30100) [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30100)] [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:38:56.228664 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:38:56.254896 run osmo-hlr_10.42.42.2(pid=30097): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30097)] 17:38:56.302071 run osmo-hlr_10.42.42.2(pid=30097): stdout: | (launched: 2022-12-10_17:38:53.484690) 17:38:56.351287 run osmo-hlr_10.42.42.2(pid=30097): stderr: | 20221210173853660 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173853660 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173853660 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173853660 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173853660 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173853661 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173853683 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173853693 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173853693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173853693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:38:56.419593 run osmo-msc_10.42.42.6(pid=30103): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30103)] 17:38:56.466904 run osmo-msc_10.42.42.6(pid=30103): stdout: | (launched: 2022-12-10_17:38:55.362087) 17:38:56.515973 run osmo-msc_10.42.42.6(pid=30103): stderr: | 20221210173855635 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173855635 DLGLOBAL DEBUG validating counter group 0x7f8c73bfac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173855635 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173855635 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173855635 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173855636 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173855637 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173855638 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173855638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173855638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:38:56.565293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30096): Terminating (SIGTERM) 17:38:56.604361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30099): Terminating (SIGTERM) 17:38:56.643329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30102): Terminating (SIGTERM) 17:38:56.682546 --- ParallelTerminationStrategy: PID 30096 died... 17:38:56.701373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30096): Terminated: ok {rc=0} 17:38:56.744632 --- ParallelTerminationStrategy: PID 30099 died... 17:38:56.762956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30099): Terminated: ok {rc=0} 17:38:56.806059 --- ParallelTerminationStrategy: PID 30102 died... 17:38:56.824392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30102): Terminated: ok {rc=0} 17:38:56.909828 bus /sierra_3: Setting Powered False 17:38:58.008868 bus /sierra_3: Setting Powered False 17:38:59.123602 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:39:00.266917 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:00.278861 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:39:00.348577 tst mo_mt_call_osmux.py: using LAC 29543 17:39:00.474527 tst mo_mt_call_osmux.py: using RAC 218 17:39:00.599409 tst mo_mt_call_osmux.py: using CellId 29543 17:39:00.725400 tst mo_mt_call_osmux.py: using BVCI 29544 17:39:00.849127 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:00.866818 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:00.880711 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:00.892894 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:00.904789 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:00.926625 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:39:01.046166 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:39:01.169716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:01.670778 run create_hlr_db(pid=30105): Launched 17:39:01.827681 bus /sierra_2: Setting Powered False 17:39:02.890213 run create_hlr_db(pid=30105): Terminated: ok {rc=0} 17:39:03.332842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30107): Launched 17:39:03.650448 run osmo-hlr_10.42.42.2(pid=30108): Launched 17:39:03.772168 run osmo-stp_10.42.42.5: Starting osmo-stp 17:39:04.321935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30110): Launched 17:39:04.639426 run osmo-stp_10.42.42.5(pid=30111): Launched 17:39:04.760548 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:05.337168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30113): Launched 17:39:05.654963 run osmo-msc_10.42.42.6(pid=30114): Launched 17:39:05.832457 run osmo-stp_10.42.42.5(pid=30111): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30111)] 17:39:05.966418 run osmo-stp_10.42.42.5(pid=30111): stdout: | (launched: 2022-12-10_17:39:04.581713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:06.101271 run osmo-stp_10.42.42.5(pid=30111): stderr: | 20221210173904775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173904775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173904776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173904776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173904776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173904776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173904777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:06.235382 run osmo-stp_10.42.42.5(pid=30111): stdout: | (launched: 2022-12-10_17:39:04.581713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:06.362353 run osmo-stp_10.42.42.5(pid=30111): stderr: | 20221210173904775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173904775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173904776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173904776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173904776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173904776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173904777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:06.513749 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30111): Process ended prematurely: osmo-stp_10.42.42.5(pid=30111) [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30111)] [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:39:06.523504 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:39:06.551712 run osmo-hlr_10.42.42.2(pid=30108): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30108)] 17:39:06.601589 run osmo-hlr_10.42.42.2(pid=30108): stdout: | (launched: 2022-12-10_17:39:03.592241) 17:39:06.653190 run osmo-hlr_10.42.42.2(pid=30108): stderr: | 20221210173903791 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173903791 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173903791 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173903791 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173903791 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173903791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173903803 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173903811 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173903811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173903811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:39:06.724901 run osmo-msc_10.42.42.6(pid=30114): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30114)] 17:39:06.774515 run osmo-msc_10.42.42.6(pid=30114): stdout: | (launched: 2022-12-10_17:39:05.596756) 17:39:06.825783 run osmo-msc_10.42.42.6(pid=30114): stderr: | 20221210173905918 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173905918 DLGLOBAL DEBUG validating counter group 0x7fce01328c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173905918 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173905918 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173905918 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173905919 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173905920 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173905921 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173905921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173905921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:39:06.877575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30107): Terminating (SIGTERM) 17:39:06.919086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30110): Terminating (SIGTERM) 17:39:06.960756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30113): Terminating (SIGTERM) 17:39:07.003267 --- ParallelTerminationStrategy: PID 30107 died... 17:39:07.023023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30107): Terminated: ok {rc=0} 17:39:07.069377 --- ParallelTerminationStrategy: PID 30110 died... 17:39:07.088606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30110): Terminated: ok {rc=0} 17:39:07.134803 --- ParallelTerminationStrategy: PID 30113 died... 17:39:07.153979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30113): Terminated: ok {rc=0} 17:39:07.240478 bus /sierra_3: Setting Powered False 17:39:08.339551 bus /sierra_3: Setting Powered False 17:39:09.454636 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:39:10.707701 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:39:10.714145 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:39:10.747561 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:39:10.774056 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:39:10.826852 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:39:10.861571 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:39:10.888037 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:39:11.439920 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:39:11.487276 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:11.498580 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:39:11.566404 tst mo_mt_call.py: using LAC 29544 17:39:11.683630 tst mo_mt_call.py: using RAC 219 17:39:11.799194 tst mo_mt_call.py: using CellId 29544 17:39:11.914389 tst mo_mt_call.py: using BVCI 29545 17:39:12.023554 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:12.034786 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:12.045831 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:12.056706 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:12.068140 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:12.079134 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:39:12.195809 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:39:12.315071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:12.807645 run create_hlr_db(pid=30120): Launched 17:39:12.930412 bus /sierra_2: Setting Powered False 17:39:13.994205 run create_hlr_db(pid=30120): Terminated: ok {rc=0} 17:39:14.435929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30122): Launched 17:39:14.754070 run osmo-hlr_10.42.42.2(pid=30123): Launched 17:39:14.874960 run osmo-stp_10.42.42.5: Starting osmo-stp 17:39:15.425236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30125): Launched 17:39:15.741670 run osmo-stp_10.42.42.5(pid=30126): Launched 17:39:15.863299 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:16.584025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30128): Launched 17:39:16.915374 run osmo-msc_10.42.42.6(pid=30129): Launched 17:39:17.217322 run osmo-stp_10.42.42.5(pid=30126): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30126)] 17:39:17.422356 run osmo-stp_10.42.42.5(pid=30126): stdout: | (launched: 2022-12-10_17:39:15.683808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:17.557166 run osmo-stp_10.42.42.5(pid=30126): stderr: | 20221210173915947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173915947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173915947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173915948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173915948 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173915948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173915948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:17.689852 run osmo-stp_10.42.42.5(pid=30126): stdout: | (launched: 2022-12-10_17:39:15.683808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:17.817106 run osmo-stp_10.42.42.5(pid=30126): stderr: | 20221210173915947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173915947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173915947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173915948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173915948 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173915948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173915948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:17.968687 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30126): Process ended prematurely: osmo-stp_10.42.42.5(pid=30126) [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30126)] [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:39:17.978686 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 17:39:18.007685 run osmo-hlr_10.42.42.2(pid=30123): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30123)] 17:39:18.058226 run osmo-hlr_10.42.42.2(pid=30123): stdout: | (launched: 2022-12-10_17:39:14.695955) 17:39:18.110584 run osmo-hlr_10.42.42.2(pid=30123): stderr: | 20221210173914894 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173914894 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173914895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173914895 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173914895 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173914895 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173914907 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173914915 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173914915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173914915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:39:18.183311 run osmo-msc_10.42.42.6(pid=30129): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30129)] 17:39:18.233870 run osmo-msc_10.42.42.6(pid=30129): stdout: | (launched: 2022-12-10_17:39:16.857489) 17:39:18.286617 run osmo-msc_10.42.42.6(pid=30129): stderr: | 20221210173917268 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173917268 DLGLOBAL DEBUG validating counter group 0x7fb3aa0a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173917268 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173917268 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173917268 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173917274 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173917276 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173917279 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173917279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173917279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:39:18.339282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30122): Terminating (SIGTERM) 17:39:18.381589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30125): Terminating (SIGTERM) 17:39:18.424335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30128): Terminating (SIGTERM) 17:39:18.466898 --- ParallelTerminationStrategy: PID 30122 died... 17:39:18.486951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30122): Terminated: ok {rc=0} 17:39:18.534166 --- ParallelTerminationStrategy: PID 30125 died... 17:39:18.553851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30125): Terminated: ok {rc=0} 17:39:18.600713 --- ParallelTerminationStrategy: PID 30128 died... 17:39:18.620294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30128): Terminated: ok {rc=0} 17:39:18.708290 bus /sierra_3: Setting Powered False 17:39:19.805857 bus /sierra_3: Setting Powered False 17:39:20.922504 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:39:22.066799 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:22.078708 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:39:22.149336 tst mo_mt_call_osmux.py: using LAC 29545 17:39:22.265946 tst mo_mt_call_osmux.py: using RAC 220 17:39:22.382307 tst mo_mt_call_osmux.py: using CellId 29545 17:39:22.498547 tst mo_mt_call_osmux.py: using BVCI 29546 17:39:22.607843 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:22.619121 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:22.630618 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:22.641745 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:22.652841 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:22.663932 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:39:22.781362 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:39:22.897088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:23.362496 run create_hlr_db(pid=30131): Launched 17:39:23.485581 bus /sierra_2: Setting Powered False 17:39:24.545207 run create_hlr_db(pid=30131): Terminated: ok {rc=0} 17:39:24.979763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30133): Launched 17:39:25.298258 run osmo-hlr_10.42.42.2(pid=30134): Launched 17:39:25.421179 run osmo-stp_10.42.42.5: Starting osmo-stp 17:39:25.966697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30136): Launched 17:39:26.285630 run osmo-stp_10.42.42.5(pid=30137): Launched 17:39:26.409128 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:26.984665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30139): Launched 17:39:27.303451 run osmo-msc_10.42.42.6(pid=30140): Launched 17:39:27.481353 run osmo-stp_10.42.42.5(pid=30137): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30137)] 17:39:27.615625 run osmo-stp_10.42.42.5(pid=30137): stdout: | (launched: 2022-12-10_17:39:26.227530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:27.751265 run osmo-stp_10.42.42.5(pid=30137): stderr: | 20221210173926420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173926420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173926420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173926421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173926421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173926421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173926422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:27.885745 run osmo-stp_10.42.42.5(pid=30137): stdout: | (launched: 2022-12-10_17:39:26.227530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:28.012620 run osmo-stp_10.42.42.5(pid=30137): stderr: | 20221210173926420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173926420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173926420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173926421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173926421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173926421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173926422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:28.164740 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30137): Process ended prematurely: osmo-stp_10.42.42.5(pid=30137) [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30137)] [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:39:28.174695 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:39:28.203084 run osmo-hlr_10.42.42.2(pid=30134): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30134)] 17:39:28.253835 run osmo-hlr_10.42.42.2(pid=30134): stdout: | (launched: 2022-12-10_17:39:25.239941) 17:39:28.306313 run osmo-hlr_10.42.42.2(pid=30134): stderr: | 20221210173925439 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173925439 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173925439 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173925439 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173925439 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173925439 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173925451 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173925459 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173925460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173925460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:39:28.378615 run osmo-msc_10.42.42.6(pid=30140): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30140)] 17:39:28.429107 run osmo-msc_10.42.42.6(pid=30140): stdout: | (launched: 2022-12-10_17:39:27.244830) 17:39:28.481129 run osmo-msc_10.42.42.6(pid=30140): stderr: | 20221210173927566 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173927566 DLGLOBAL DEBUG validating counter group 0x7f10cc7f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173927566 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173927566 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173927566 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173927566 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173927568 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173927568 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173927568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173927569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:39:28.533661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30133): Terminating (SIGTERM) 17:39:28.575601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30136): Terminating (SIGTERM) 17:39:28.617614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30139): Terminating (SIGTERM) 17:39:28.659633 --- ParallelTerminationStrategy: PID 30133 died... 17:39:28.679615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30133): Terminated: ok {rc=0} 17:39:28.726563 --- ParallelTerminationStrategy: PID 30136 died... 17:39:28.746036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30136): Terminated: ok {rc=0} 17:39:28.792495 --- ParallelTerminationStrategy: PID 30139 died... 17:39:28.811988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30139): Terminated: ok {rc=0} 17:39:28.899780 bus /sierra_3: Setting Powered False 17:39:29.996254 bus /sierra_3: Setting Powered False 17:39:31.111295 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:39:32.392594 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:39:32.401277 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:39:32.436501 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:39:32.465879 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:39:32.518245 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:39:32.553621 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:39:32.581227 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:39:33.134934 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:39:33.184515 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:33.195752 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:39:33.263294 tst mo_mt_call.py: using LAC 29546 17:39:33.382266 tst mo_mt_call.py: using RAC 221 17:39:33.498572 tst mo_mt_call.py: using CellId 29546 17:39:33.615251 tst mo_mt_call.py: using BVCI 29547 17:39:33.722307 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:33.733477 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:33.744374 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:33.755322 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:33.766378 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:33.777307 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:39:33.895194 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:39:34.013371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:34.506171 run create_hlr_db(pid=30145): Launched 17:39:34.628530 bus /sierra_2: Setting Powered False 17:39:35.691886 run create_hlr_db(pid=30145): Terminated: ok {rc=0} 17:39:36.117082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30147): Launched 17:39:36.415441 run osmo-hlr_10.42.42.2(pid=30148): Launched 17:39:36.529370 run osmo-stp_10.42.42.5: Starting osmo-stp 17:39:37.041175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30150): Launched 17:39:37.339109 run osmo-stp_10.42.42.5(pid=30151): Launched 17:39:37.454834 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:37.996169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30153): Launched 17:39:38.294808 run osmo-msc_10.42.42.6(pid=30154): Launched 17:39:38.461268 run osmo-stp_10.42.42.5(pid=30151): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30151)] 17:39:38.587196 run osmo-stp_10.42.42.5(pid=30151): stdout: | (launched: 2022-12-10_17:39:37.284053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:38.712846 run osmo-stp_10.42.42.5(pid=30151): stderr: | 20221210173937452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173937452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173937453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173937453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173937453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173937454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173937454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:38.837281 run osmo-stp_10.42.42.5(pid=30151): stdout: | (launched: 2022-12-10_17:39:37.284053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:38.955702 run osmo-stp_10.42.42.5(pid=30151): stderr: | 20221210173937452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173937452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173937453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173937453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173937453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173937454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173937454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:39.097358 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30151): Process ended prematurely: osmo-stp_10.42.42.5(pid=30151) [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30151)] [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:39:39.106403 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:39:39.132415 run osmo-hlr_10.42.42.2(pid=30148): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30148)] 17:39:39.179617 run osmo-hlr_10.42.42.2(pid=30148): stdout: | (launched: 2022-12-10_17:39:36.360677) 17:39:39.228580 run osmo-hlr_10.42.42.2(pid=30148): stderr: | 20221210173936538 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173936538 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173936538 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173936538 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173936538 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173936538 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173936555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173936565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173936565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173936565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:39:39.297069 run osmo-msc_10.42.42.6(pid=30154): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30154)] 17:39:39.344641 run osmo-msc_10.42.42.6(pid=30154): stdout: | (launched: 2022-12-10_17:39:38.240215) 17:39:39.393923 run osmo-msc_10.42.42.6(pid=30154): stderr: | 20221210173938513 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173938513 DLGLOBAL DEBUG validating counter group 0x7fe267bd6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173938513 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173938514 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173938514 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173938514 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173938516 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173938516 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173938516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173938516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:39:39.443705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30147): Terminating (SIGTERM) 17:39:39.483044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30150): Terminating (SIGTERM) 17:39:39.522278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30153): Terminating (SIGTERM) 17:39:39.561843 --- ParallelTerminationStrategy: PID 30147 died... 17:39:39.580753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30147): Terminated: ok {rc=0} 17:39:39.624185 --- ParallelTerminationStrategy: PID 30150 died... 17:39:39.642605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30150): Terminated: ok {rc=0} 17:39:39.685790 --- ParallelTerminationStrategy: PID 30153 died... 17:39:39.704190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30153): Terminated: ok {rc=0} 17:39:39.788467 bus /sierra_3: Setting Powered False 17:39:40.887908 bus /sierra_3: Setting Powered False 17:39:42.003089 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:39:43.149143 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:43.161071 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:39:43.230947 tst mo_mt_call_osmux.py: using LAC 29547 17:39:43.349053 tst mo_mt_call_osmux.py: using RAC 222 17:39:43.469715 tst mo_mt_call_osmux.py: using CellId 29547 17:39:43.586496 tst mo_mt_call_osmux.py: using BVCI 29548 17:39:43.695528 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:43.706731 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:43.717707 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:43.728688 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:43.739698 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:43.750612 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:39:43.868483 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:39:43.987195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:44.481217 run create_hlr_db(pid=30157): Launched 17:39:44.603052 bus /sierra_2: Setting Powered False 17:39:45.665713 run create_hlr_db(pid=30157): Terminated: ok {rc=0} 17:39:46.114410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30159): Launched 17:39:46.449206 run osmo-hlr_10.42.42.2(pid=30160): Launched 17:39:46.651403 run osmo-stp_10.42.42.5: Starting osmo-stp 17:39:47.417847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30162): Launched 17:39:47.717509 run osmo-stp_10.42.42.5(pid=30163): Launched 17:39:47.830382 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:48.368686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30165): Launched 17:39:48.666152 run osmo-msc_10.42.42.6(pid=30166): Launched 17:39:48.831915 run osmo-stp_10.42.42.5(pid=30163): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30163)] 17:39:48.958216 run osmo-stp_10.42.42.5(pid=30163): stdout: | (launched: 2022-12-10_17:39:47.662401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:49.084104 run osmo-stp_10.42.42.5(pid=30163): stderr: | 20221210173947831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173947831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173947831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173947831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173947832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173947832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173947832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:49.207923 run osmo-stp_10.42.42.5(pid=30163): stdout: | (launched: 2022-12-10_17:39:47.662401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:49.326539 run osmo-stp_10.42.42.5(pid=30163): stderr: | 20221210173947831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173947831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173947831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173947831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173947832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173947832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173947832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:49.468779 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30163): Process ended prematurely: osmo-stp_10.42.42.5(pid=30163) [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30163)] [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:39:49.478060 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:39:49.504289 run osmo-hlr_10.42.42.2(pid=30160): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30160)] 17:39:49.551458 run osmo-hlr_10.42.42.2(pid=30160): stdout: | (launched: 2022-12-10_17:39:46.390920) 17:39:49.600169 run osmo-hlr_10.42.42.2(pid=30160): stderr: | 20221210173946686 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173946686 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173946686 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173946686 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173946686 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173946686 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173946708 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173946729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173946730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173946730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:39:49.668082 run osmo-msc_10.42.42.6(pid=30166): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30166)] 17:39:49.714928 run osmo-msc_10.42.42.6(pid=30166): stdout: | (launched: 2022-12-10_17:39:48.611055) 17:39:49.763190 run osmo-msc_10.42.42.6(pid=30166): stderr: | 20221210173948883 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173948883 DLGLOBAL DEBUG validating counter group 0x7f442d01dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173948883 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173948883 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173948883 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173948884 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173948885 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173948886 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173948886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173948886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:39:49.812034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30159): Terminating (SIGTERM) 17:39:49.850733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30162): Terminating (SIGTERM) 17:39:49.889364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30165): Terminating (SIGTERM) 17:39:49.929093 --- ParallelTerminationStrategy: PID 30159 died... 17:39:49.947767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30159): Terminated: ok {rc=0} 17:39:49.991367 --- ParallelTerminationStrategy: PID 30162 died... 17:39:50.009722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30162): Terminated: ok {rc=0} 17:39:50.052519 --- ParallelTerminationStrategy: PID 30165 died... 17:39:50.070710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30165): Terminated: ok {rc=0} 17:39:50.155238 bus /sierra_3: Setting Powered False 17:39:51.253117 bus /sierra_3: Setting Powered False 17:39:52.367246 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:39:53.622066 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:39:53.629136 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:39:53.664619 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:39:53.692654 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:39:53.749705 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:39:53.785252 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:39:53.812775 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:39:54.361150 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:39:54.412429 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:39:54.424260 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:39:54.494209 tst mo_mt_call.py: using LAC 29548 17:39:54.618828 tst mo_mt_call.py: using RAC 223 17:39:54.741261 tst mo_mt_call.py: using CellId 29548 17:39:54.863664 tst mo_mt_call.py: using BVCI 29549 17:39:54.980278 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:39:54.991920 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:39:55.003349 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:39:55.015194 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:39:55.026963 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:39:55.038812 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:39:55.152464 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:39:55.269198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:55.762963 run create_hlr_db(pid=30171): Launched 17:39:55.883655 bus /sierra_2: Setting Powered False 17:39:56.947184 run create_hlr_db(pid=30171): Terminated: ok {rc=0} 17:39:57.389363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30173): Launched 17:39:57.708011 run osmo-hlr_10.42.42.2(pid=30174): Launched 17:39:57.830439 run osmo-stp_10.42.42.5: Starting osmo-stp 17:39:58.380823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30176): Launched 17:39:58.697897 run osmo-stp_10.42.42.5(pid=30177): Launched 17:39:58.820414 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:59.396738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30179): Launched 17:39:59.715566 run osmo-msc_10.42.42.6(pid=30180): Launched 17:39:59.893629 run osmo-stp_10.42.42.5(pid=30177): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30177)] 17:40:00.027953 run osmo-stp_10.42.42.5(pid=30177): stdout: | (launched: 2022-12-10_17:39:58.640353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:00.163330 run osmo-stp_10.42.42.5(pid=30177): stderr: | 20221210173958829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173958829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173958829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173958830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173958832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173958832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173958832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:00.298300 run osmo-stp_10.42.42.5(pid=30177): stdout: | (launched: 2022-12-10_17:39:58.640353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:00.425487 run osmo-stp_10.42.42.5(pid=30177): stderr: | 20221210173958829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210173958829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210173958829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210173958830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210173958832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210173958832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210173958832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:00.577145 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30177): Process ended prematurely: osmo-stp_10.42.42.5(pid=30177) [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30177)] [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:40:00.586831 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:40:00.614600 run osmo-hlr_10.42.42.2(pid=30174): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30174)] 17:40:00.665214 run osmo-hlr_10.42.42.2(pid=30174): stdout: | (launched: 2022-12-10_17:39:57.650140) 17:40:00.717102 run osmo-hlr_10.42.42.2(pid=30174): stderr: | 20221210173957847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210173957847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210173957847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210173957847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210173957847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210173957847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210173957859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210173957868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210173957868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210173957868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:00.789267 run osmo-msc_10.42.42.6(pid=30180): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30180)] 17:40:00.848031 run osmo-msc_10.42.42.6(pid=30180): stdout: | (launched: 2022-12-10_17:39:59.657471) 17:40:00.906810 run osmo-msc_10.42.42.6(pid=30180): stderr: | 20221210173959977 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210173959977 DLGLOBAL DEBUG validating counter group 0x7f68cd6cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210173959978 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210173959978 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210173959978 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210173959978 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210173959980 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210173959980 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210173959980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210173959980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:00.960363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30173): Terminating (SIGTERM) 17:40:01.004449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30176): Terminating (SIGTERM) 17:40:01.049211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30179): Terminating (SIGTERM) 17:40:01.093177 --- ParallelTerminationStrategy: PID 30173 died... 17:40:01.113733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30173): Terminated: ok {rc=0} 17:40:01.162348 --- ParallelTerminationStrategy: PID 30176 died... 17:40:01.182716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30176): Terminated: ok {rc=0} 17:40:01.231352 --- ParallelTerminationStrategy: PID 30179 died... 17:40:01.251632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30179): Terminated: ok {rc=0} 17:40:01.341123 bus /sierra_3: Setting Powered False 17:40:02.438627 bus /sierra_3: Setting Powered False 17:40:03.553171 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:40:04.701523 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:04.714090 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:40:04.787076 tst mo_mt_call_osmux.py: using LAC 29549 17:40:04.912719 tst mo_mt_call_osmux.py: using RAC 224 17:40:05.039806 tst mo_mt_call_osmux.py: using CellId 29549 17:40:05.164215 tst mo_mt_call_osmux.py: using BVCI 29550 17:40:05.281168 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:05.293110 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:05.305308 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:05.317287 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:05.329308 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:05.340890 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:40:05.458487 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:40:05.573809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:06.035533 run create_hlr_db(pid=30185): Launched 17:40:06.158201 bus /sierra_2: Setting Powered False 17:40:07.217556 run create_hlr_db(pid=30185): Terminated: ok {rc=0} 17:40:07.651969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30187): Launched 17:40:07.971206 run osmo-hlr_10.42.42.2(pid=30188): Launched 17:40:08.092838 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:08.644063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30190): Launched 17:40:08.962519 run osmo-stp_10.42.42.5(pid=30191): Launched 17:40:09.084283 run osmo-msc_10.42.42.6: Starting osmo-msc 17:40:09.661706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30193): Launched 17:40:09.980700 run osmo-msc_10.42.42.6(pid=30194): Launched 17:40:10.160216 run osmo-stp_10.42.42.5(pid=30191): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30191)] 17:40:10.295033 run osmo-stp_10.42.42.5(pid=30191): stdout: | (launched: 2022-12-10_17:40:08.904512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:10.430561 run osmo-stp_10.42.42.5(pid=30191): stderr: | 20221210174009096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174009096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174009097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174009097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174009099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174009099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174009099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:10.564915 run osmo-stp_10.42.42.5(pid=30191): stdout: | (launched: 2022-12-10_17:40:08.904512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:10.691827 run osmo-stp_10.42.42.5(pid=30191): stderr: | 20221210174009096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174009096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174009097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174009097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174009099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174009099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174009099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:10.843836 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30191): Process ended prematurely: osmo-stp_10.42.42.5(pid=30191) [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30191)] [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:40:10.853764 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:40:10.881801 run osmo-hlr_10.42.42.2(pid=30188): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30188)] 17:40:10.933399 run osmo-hlr_10.42.42.2(pid=30188): stdout: | (launched: 2022-12-10_17:40:07.913399) 17:40:10.985329 run osmo-hlr_10.42.42.2(pid=30188): stderr: | 20221210174008112 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174008112 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174008112 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174008112 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174008112 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174008112 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174008124 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174008133 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174008133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174008133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:11.057563 run osmo-msc_10.42.42.6(pid=30194): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30194)] 17:40:11.107679 run osmo-msc_10.42.42.6(pid=30194): stdout: | (launched: 2022-12-10_17:40:09.922562) 17:40:11.159623 run osmo-msc_10.42.42.6(pid=30194): stderr: | 20221210174010244 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174010245 DLGLOBAL DEBUG validating counter group 0x7f5c8c42ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174010245 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174010245 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174010245 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174010245 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174010247 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174010247 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174010247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174010247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:11.211899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30187): Terminating (SIGTERM) 17:40:11.253702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30190): Terminating (SIGTERM) 17:40:11.295817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30193): Terminating (SIGTERM) 17:40:11.338343 --- ParallelTerminationStrategy: PID 30187 died... 17:40:11.358555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30187): Terminated: ok {rc=0} 17:40:11.405252 --- ParallelTerminationStrategy: PID 30190 died... 17:40:11.424693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30190): Terminated: ok {rc=0} 17:40:11.470962 --- ParallelTerminationStrategy: PID 30193 died... 17:40:11.490506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30193): Terminated: ok {rc=0} 17:40:11.578689 bus /sierra_3: Setting Powered False 17:40:12.676942 bus /sierra_3: Setting Powered False 17:40:13.793462 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:40:15.052736 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:40:15.059972 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:40:15.094755 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:40:15.122710 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:40:15.175306 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:40:15.209760 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:40:15.236998 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:40:15.788806 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:40:15.852799 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:15.864664 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:40:15.948783 tst mo_mt_call.py: using LAC 29550 17:40:16.068486 tst mo_mt_call.py: using RAC 225 17:40:16.221438 tst mo_mt_call.py: using CellId 29550 17:40:16.347153 tst mo_mt_call.py: using BVCI 29551 17:40:16.504527 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:16.521230 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:16.538700 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:16.553342 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:16.566793 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:16.578625 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:40:16.696614 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:40:16.814910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:17.290849 run create_hlr_db(pid=30200): Launched 17:40:17.414718 bus /sierra_2: Setting Powered False 17:40:18.474069 run create_hlr_db(pid=30200): Terminated: ok {rc=0} 17:40:18.887479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30202): Launched 17:40:19.184340 run osmo-hlr_10.42.42.2(pid=30203): Launched 17:40:19.297733 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:19.825167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30205): Launched 17:40:20.122374 run osmo-stp_10.42.42.5(pid=30206): Launched 17:40:20.235281 run osmo-msc_10.42.42.6: Starting osmo-msc 17:40:20.773095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30208): Launched 17:40:21.070551 run osmo-msc_10.42.42.6(pid=30209): Launched 17:40:21.237139 run osmo-stp_10.42.42.5(pid=30206): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30206)] 17:40:21.363801 run osmo-stp_10.42.42.5(pid=30206): stdout: | (launched: 2022-12-10_17:40:20.067389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:21.488872 run osmo-stp_10.42.42.5(pid=30206): stderr: | 20221210174020237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174020237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174020238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174020238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174020238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174020239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174020239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:21.613072 run osmo-stp_10.42.42.5(pid=30206): stdout: | (launched: 2022-12-10_17:40:20.067389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:21.731630 run osmo-stp_10.42.42.5(pid=30206): stderr: | 20221210174020237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174020237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174020238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174020238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174020238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174020239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174020239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:21.873557 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30206): Process ended prematurely: osmo-stp_10.42.42.5(pid=30206) [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30206)] [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:40:21.882431 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:40:21.908322 run osmo-hlr_10.42.42.2(pid=30203): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30203)] 17:40:21.955495 run osmo-hlr_10.42.42.2(pid=30203): stdout: | (launched: 2022-12-10_17:40:19.130059) 17:40:22.004459 run osmo-hlr_10.42.42.2(pid=30203): stderr: | 20221210174019307 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174019307 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174019307 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174019307 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174019307 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174019307 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174019320 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174019328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174019329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174019329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:22.072793 run osmo-msc_10.42.42.6(pid=30209): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30209)] 17:40:22.119927 run osmo-msc_10.42.42.6(pid=30209): stdout: | (launched: 2022-12-10_17:40:21.015975) 17:40:22.168775 run osmo-msc_10.42.42.6(pid=30209): stderr: | 20221210174021286 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174021286 DLGLOBAL DEBUG validating counter group 0x7f0e03f1ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174021286 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174021286 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174021287 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174021288 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174021290 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174021290 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174021290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174021290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:22.217839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30202): Terminating (SIGTERM) 17:40:22.256727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30205): Terminating (SIGTERM) 17:40:22.295634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30208): Terminating (SIGTERM) 17:40:22.334672 --- ParallelTerminationStrategy: PID 30202 died... 17:40:22.353407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30202): Terminated: ok {rc=0} 17:40:22.396592 --- ParallelTerminationStrategy: PID 30205 died... 17:40:22.414916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30205): Terminated: ok {rc=0} 17:40:22.457875 --- ParallelTerminationStrategy: PID 30208 died... 17:40:22.476075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30208): Terminated: ok {rc=0} 17:40:22.558195 bus /sierra_3: Setting Powered False 17:40:23.653219 bus /sierra_3: Setting Powered False 17:40:24.766749 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:40:25.911793 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:25.923604 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:40:25.994045 tst mo_mt_call_osmux.py: using LAC 29551 17:40:26.119494 tst mo_mt_call_osmux.py: using RAC 226 17:40:26.243731 tst mo_mt_call_osmux.py: using CellId 29551 17:40:26.370362 tst mo_mt_call_osmux.py: using BVCI 29552 17:40:26.487266 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:26.499064 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:26.510595 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:26.522479 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:26.534225 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:26.545881 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:40:26.662554 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:40:26.777947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:27.240032 run create_hlr_db(pid=30211): Launched 17:40:27.362791 bus /sierra_2: Setting Powered False 17:40:28.421472 run create_hlr_db(pid=30211): Terminated: ok {rc=0} 17:40:28.838373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30213): Launched 17:40:29.137235 run osmo-hlr_10.42.42.2(pid=30214): Launched 17:40:29.250692 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:29.778520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30216): Launched 17:40:30.079199 run osmo-stp_10.42.42.5(pid=30217): Launched 17:40:30.192855 run osmo-msc_10.42.42.6: Starting osmo-msc 17:40:30.733747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30219): Launched 17:40:31.038103 run osmo-msc_10.42.42.6(pid=30220): Launched 17:40:31.361347 run osmo-stp_10.42.42.5(pid=30217): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30217)] 17:40:31.683968 run osmo-stp_10.42.42.5(pid=30217): stdout: | (launched: 2022-12-10_17:40:30.024441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:31.900242 run osmo-stp_10.42.42.5(pid=30217): stderr: | 20221210174030192 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174030192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174030192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174030193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174030193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174030193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174030193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:32.028457 run osmo-stp_10.42.42.5(pid=30217): stdout: | (launched: 2022-12-10_17:40:30.024441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:32.150732 run osmo-stp_10.42.42.5(pid=30217): stderr: | 20221210174030192 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174030192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174030192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174030193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174030193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174030193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174030193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:32.295849 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30217): Process ended prematurely: osmo-stp_10.42.42.5(pid=30217) [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30217)] [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:40:32.305280 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:40:32.332248 run osmo-hlr_10.42.42.2(pid=30214): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30214)] 17:40:32.380704 run osmo-hlr_10.42.42.2(pid=30214): stdout: | (launched: 2022-12-10_17:40:29.081906) 17:40:32.430754 run osmo-hlr_10.42.42.2(pid=30214): stderr: | 20221210174029258 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174029258 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174029258 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174029258 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174029258 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174029259 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174029271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174029280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174029280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174029280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:32.499750 run osmo-msc_10.42.42.6(pid=30220): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30220)] 17:40:32.547358 run osmo-msc_10.42.42.6(pid=30220): stdout: | (launched: 2022-12-10_17:40:30.980374) 17:40:32.597166 run osmo-msc_10.42.42.6(pid=30220): stderr: | 20221210174031475 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174031476 DLGLOBAL DEBUG validating counter group 0x7f490ae68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174031476 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174031476 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174031477 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174031479 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174031484 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174031485 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174031486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174031486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:32.646465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30213): Terminating (SIGTERM) 17:40:32.685814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30216): Terminating (SIGTERM) 17:40:32.724753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30219): Terminating (SIGTERM) 17:40:32.763827 --- ParallelTerminationStrategy: PID 30213 died... 17:40:32.782565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30213): Terminated: ok {rc=0} 17:40:32.825938 --- ParallelTerminationStrategy: PID 30216 died... 17:40:32.844293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30216): Terminated: ok {rc=0} 17:40:32.887488 --- ParallelTerminationStrategy: PID 30219 died... 17:40:32.905807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30219): Terminated: ok {rc=0} 17:40:32.988821 bus /sierra_3: Setting Powered False 17:40:34.085972 bus /sierra_3: Setting Powered False 17:40:35.203932 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:40:36.455203 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:40:36.461092 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:40:36.494765 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:40:36.521291 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:40:36.574679 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:40:36.608245 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:40:36.634274 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:40:37.183053 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:40:37.230510 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:37.241600 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:40:37.312593 tst mo_mt_call.py: using LAC 29552 17:40:37.432271 tst mo_mt_call.py: using RAC 227 17:40:37.551344 tst mo_mt_call.py: using CellId 29552 17:40:37.668753 tst mo_mt_call.py: using BVCI 29553 17:40:37.776213 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:37.787221 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:37.798094 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:37.809196 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:37.820063 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:37.830844 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:40:37.948669 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:40:38.065231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:38.527207 run create_hlr_db(pid=30227): Launched 17:40:38.649586 bus /sierra_2: Setting Powered False 17:40:39.709251 run create_hlr_db(pid=30227): Terminated: ok {rc=0} 17:40:40.146657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30229): Launched 17:40:40.469106 run osmo-hlr_10.42.42.2(pid=30230): Launched 17:40:40.591510 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:41.146157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30232): Launched 17:40:41.467084 run osmo-stp_10.42.42.5(pid=30233): Launched 17:40:41.590471 run osmo-msc_10.42.42.6: Starting osmo-msc 17:40:42.192509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30235): Launched 17:40:42.511659 run osmo-msc_10.42.42.6(pid=30236): Launched 17:40:42.690921 run osmo-stp_10.42.42.5(pid=30233): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30233)] 17:40:42.825778 run osmo-stp_10.42.42.5(pid=30233): stdout: | (launched: 2022-12-10_17:40:41.408430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:42.961099 run osmo-stp_10.42.42.5(pid=30233): stderr: | 20221210174041599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174041599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174041599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174041600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174041600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174041600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174041600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:43.095754 run osmo-stp_10.42.42.5(pid=30233): stdout: | (launched: 2022-12-10_17:40:41.408430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:43.222900 run osmo-stp_10.42.42.5(pid=30233): stderr: | 20221210174041599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174041599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174041599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174041600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174041600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174041600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174041600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:43.375919 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30233): Process ended prematurely: osmo-stp_10.42.42.5(pid=30233) [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30233)] [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:40:43.385657 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:40:43.414140 run osmo-hlr_10.42.42.2(pid=30230): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30230)] 17:40:43.464723 run osmo-hlr_10.42.42.2(pid=30230): stdout: | (launched: 2022-12-10_17:40:40.410732) 17:40:43.517208 run osmo-hlr_10.42.42.2(pid=30230): stderr: | 20221210174040608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174040608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174040608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174040608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174040608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174040608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174040620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174040628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174040628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174040629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:43.589978 run osmo-msc_10.42.42.6(pid=30236): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30236)] 17:40:43.640452 run osmo-msc_10.42.42.6(pid=30236): stdout: | (launched: 2022-12-10_17:40:42.453774) 17:40:43.692516 run osmo-msc_10.42.42.6(pid=30236): stderr: | 20221210174042775 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174042775 DLGLOBAL DEBUG validating counter group 0x7fa9d5ad0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174042775 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174042775 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174042775 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174042775 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174042777 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174042778 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174042778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174042778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:43.745065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30229): Terminating (SIGTERM) 17:40:43.787110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30232): Terminating (SIGTERM) 17:40:43.829213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30235): Terminating (SIGTERM) 17:40:43.871814 --- ParallelTerminationStrategy: PID 30229 died... 17:40:43.892194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30229): Terminated: ok {rc=0} 17:40:43.939247 --- ParallelTerminationStrategy: PID 30232 died... 17:40:43.958563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30232): Terminated: ok {rc=0} 17:40:44.004719 --- ParallelTerminationStrategy: PID 30235 died... 17:40:44.024012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30235): Terminated: ok {rc=0} 17:40:44.111602 bus /sierra_3: Setting Powered False 17:40:45.209228 bus /sierra_3: Setting Powered False 17:40:46.328721 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:40:47.479656 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:47.491775 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:40:47.566005 tst mo_mt_call_osmux.py: using LAC 29553 17:40:47.691910 tst mo_mt_call_osmux.py: using RAC 228 17:40:47.816298 tst mo_mt_call_osmux.py: using CellId 29553 17:40:47.940927 tst mo_mt_call_osmux.py: using BVCI 29554 17:40:48.056706 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:48.068266 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:48.079644 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:48.091246 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:48.102933 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:48.114478 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:40:48.230993 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:40:48.350667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:48.811187 run create_hlr_db(pid=30238): Launched 17:40:48.934540 bus /sierra_2: Setting Powered False 17:40:49.994943 run create_hlr_db(pid=30238): Terminated: ok {rc=0} 17:40:50.430575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30240): Launched 17:40:50.749872 run osmo-hlr_10.42.42.2(pid=30241): Launched 17:40:50.871802 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:51.422669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30243): Launched 17:40:51.742498 run osmo-stp_10.42.42.5(pid=30244): Launched 17:40:51.864557 run osmo-msc_10.42.42.6: Starting osmo-msc 17:40:52.442418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30246): Launched 17:40:52.760518 run osmo-msc_10.42.42.6(pid=30247): Launched 17:40:52.938833 run osmo-stp_10.42.42.5(pid=30244): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30244)] 17:40:53.073471 run osmo-stp_10.42.42.5(pid=30244): stdout: | (launched: 2022-12-10_17:40:51.684262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:53.208813 run osmo-stp_10.42.42.5(pid=30244): stderr: | 20221210174051877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174051877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174051877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174051878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174051878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174051878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174051878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:53.343745 run osmo-stp_10.42.42.5(pid=30244): stdout: | (launched: 2022-12-10_17:40:51.684262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:53.471095 run osmo-stp_10.42.42.5(pid=30244): stderr: | 20221210174051877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174051877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174051877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174051878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174051878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174051878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174051878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:53.623047 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30244): Process ended prematurely: osmo-stp_10.42.42.5(pid=30244) [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30244)] [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:40:53.632608 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:40:53.661179 run osmo-hlr_10.42.42.2(pid=30241): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30241)] 17:40:53.711731 run osmo-hlr_10.42.42.2(pid=30241): stdout: | (launched: 2022-12-10_17:40:50.691782) 17:40:53.763649 run osmo-hlr_10.42.42.2(pid=30241): stderr: | 20221210174050890 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174050890 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174050890 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174050890 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174050890 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174050890 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174050903 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174050913 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174050913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174050913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:53.835611 run osmo-msc_10.42.42.6(pid=30247): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30247)] 17:40:53.885603 run osmo-msc_10.42.42.6(pid=30247): stdout: | (launched: 2022-12-10_17:40:52.702470) 17:40:53.937359 run osmo-msc_10.42.42.6(pid=30247): stderr: | 20221210174053023 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174053023 DLGLOBAL DEBUG validating counter group 0x7fcbe9484c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174053024 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174053024 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174053024 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174053024 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174053027 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174053028 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174053028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174053028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:53.989472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30240): Terminating (SIGTERM) 17:40:54.031113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30243): Terminating (SIGTERM) 17:40:54.072828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30246): Terminating (SIGTERM) 17:40:54.114786 --- ParallelTerminationStrategy: PID 30240 died... 17:40:54.134554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30240): Terminated: ok {rc=0} 17:40:54.181131 --- ParallelTerminationStrategy: PID 30243 died... 17:40:54.200518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30243): Terminated: ok {rc=0} 17:40:54.246544 --- ParallelTerminationStrategy: PID 30246 died... 17:40:54.266054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30246): Terminated: ok {rc=0} 17:40:54.353106 bus /sierra_3: Setting Powered False 17:40:55.451552 bus /sierra_3: Setting Powered False 17:40:56.566337 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 17:40:57.818057 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:40:57.823172 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:40:57.856615 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:40:57.883180 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 17:40:57.967348 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:40:58.000811 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:40:58.027193 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 17:40:58.611197 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2377 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 17:40:58.616109 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:40:58.626893 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:40:58.675856 tst emergency_mo_mt_call.py: using LAC 29554 17:40:58.789961 tst emergency_mo_mt_call.py: using RAC 229 17:40:58.904161 tst emergency_mo_mt_call.py: using CellId 29554 17:40:59.020744 tst emergency_mo_mt_call.py: using BVCI 29555 17:40:59.125379 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:40:59.136071 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:40:59.146601 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:40:59.157147 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:40:59.167629 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:40:59.178169 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:40:59.294042 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:40:59.409417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:59.860586 run create_hlr_db(pid=30252): Launched 17:40:59.979486 bus /sierra_2: Setting Powered False 17:41:01.037223 run create_hlr_db(pid=30252): Terminated: ok {rc=0} 17:41:01.463162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30254): Launched 17:41:01.779044 run osmo-hlr_10.42.42.2(pid=30255): Launched 17:41:01.975752 run osmo-stp_10.42.42.5: Starting osmo-stp 17:41:02.576319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30257): Launched 17:41:02.890241 run osmo-stp_10.42.42.5(pid=30258): Launched 17:41:03.017183 tst emergency_mo_mt_call.py: using MSISDN 7823 17:41:03.176614 run osmo-msc_10.42.42.6: Starting osmo-msc 17:41:03.740441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30260): Launched 17:41:04.053080 run osmo-msc_10.42.42.6(pid=30261): Launched 17:41:04.229780 run osmo-stp_10.42.42.5(pid=30258): ERR: Terminated: ERROR {rc=1} [trial-2377↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30258)] 17:41:04.363451 run osmo-stp_10.42.42.5(pid=30258): stdout: | (launched: 2022-12-10_17:41:02.832663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:04.496885 run osmo-stp_10.42.42.5(pid=30258): stderr: | 20221210174103023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174103023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174103023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174103023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174103024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174103024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174103024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:04.629280 run osmo-stp_10.42.42.5(pid=30258): stdout: | (launched: 2022-12-10_17:41:02.832663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:04.753844 run osmo-stp_10.42.42.5(pid=30258): stderr: | 20221210174103023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174103023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174103023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174103023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174103024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174103024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174103024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:04.902833 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30258): Process ended prematurely: osmo-stp_10.42.42.5(pid=30258) [trial-2377↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30258)] [trial-2377↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 17:41:04.912056 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 17:41:04.939857 run osmo-hlr_10.42.42.2(pid=30255): ERR: Terminated: ERROR {rc=237} [trial-2377↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30255)] 17:41:04.990904 run osmo-hlr_10.42.42.2(pid=30255): stdout: | (launched: 2022-12-10_17:41:01.719575) 17:41:05.043382 run osmo-hlr_10.42.42.2(pid=30255): stderr: | 20221210174102073 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174102073 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174102073 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174102073 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174102073 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174102074 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174102105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174102121 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174102121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174102121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:41:05.115828 run osmo-msc_10.42.42.6(pid=30261): ERR: Terminated: ERROR {rc=2} [trial-2377↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30261)] 17:41:05.166370 run osmo-msc_10.42.42.6(pid=30261): stdout: | (launched: 2022-12-10_17:41:03.995940) 17:41:05.218353 run osmo-msc_10.42.42.6(pid=30261): stderr: | 20221210174104317 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174104317 DLGLOBAL DEBUG validating counter group 0x7fe80dae0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174104317 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174104317 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174104318 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174104318 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174104319 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174104320 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174104320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174104320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:41:05.270901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30254): Terminating (SIGTERM) 17:41:05.313182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30257): Terminating (SIGTERM) 17:41:05.355576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30260): Terminating (SIGTERM) 17:41:05.398055 --- ParallelTerminationStrategy: PID 30254 died... 17:41:05.418103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30254): Terminated: ok {rc=0} 17:41:05.465125 --- ParallelTerminationStrategy: PID 30257 died... 17:41:05.484712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30257): Terminated: ok {rc=0} 17:41:05.531330 --- ParallelTerminationStrategy: PID 30260 died... 17:41:05.550866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30260): Terminated: ok {rc=0} 17:41:05.638176 bus /sierra_3: Setting Powered False 17:41:06.737108 bus /sierra_3: Setting Powered False 17:41:07.852071 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 17:41:08.937973 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:08.950203 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:41:09.008873 tst emergency_preemptive_call.py: using LAC 29555 17:41:09.130810 tst emergency_preemptive_call.py: using RAC 230 17:41:09.250943 tst emergency_preemptive_call.py: using CellId 29555 17:41:09.372122 tst emergency_preemptive_call.py: using BVCI 29556 17:41:09.484913 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:09.496405 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:09.507488 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:09.519011 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:09.530602 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:09.542048 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:09.658856 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:09.774141 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:09.885488 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:09.996384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:41:10.449227 run create_hlr_db(pid=30263): Launched 17:41:10.568920 bus /sierra_2: Setting Powered False 17:41:11.628575 run create_hlr_db(pid=30263): Terminated: ok {rc=0} 17:41:12.055116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30265): Launched 17:41:12.369102 run osmo-hlr_10.42.42.2(pid=30266): Launched 17:41:12.489308 run osmo-stp_10.42.42.5: Starting osmo-stp 17:41:13.031624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30268): Launched 17:41:13.345214 run osmo-stp_10.42.42.5(pid=30269): Launched 17:41:13.476295 tst emergency_preemptive_call.py: using MSISDN 7824 17:41:13.636114 run osmo-msc_10.42.42.6: Starting osmo-msc 17:41:14.197614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30271): Launched 17:41:14.510333 run osmo-msc_10.42.42.6(pid=30272): Launched 17:41:14.685888 run osmo-stp_10.42.42.5(pid=30269): ERR: Terminated: ERROR {rc=1} [trial-2377↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30269)] 17:41:14.818259 run osmo-stp_10.42.42.5(pid=30269): stdout: | (launched: 2022-12-10_17:41:13.287707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:14.951197 run osmo-stp_10.42.42.5(pid=30269): stderr: | 20221210174113479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174113479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174113480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174113480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174113481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174113481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174113481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:15.084035 run osmo-stp_10.42.42.5(pid=30269): stdout: | (launched: 2022-12-10_17:41:13.287707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:15.209224 run osmo-stp_10.42.42.5(pid=30269): stderr: | 20221210174113479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174113479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174113480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174113480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174113481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174113481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174113481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:15.358668 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30269): Process ended prematurely: osmo-stp_10.42.42.5(pid=30269) [trial-2377↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30269)] [trial-2377↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 17:41:15.367937 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 17:41:15.396254 run osmo-hlr_10.42.42.2(pid=30266): ERR: Terminated: ERROR {rc=237} [trial-2377↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30266)] 17:41:15.446980 run osmo-hlr_10.42.42.2(pid=30266): stdout: | (launched: 2022-12-10_17:41:12.311114) 17:41:15.499175 run osmo-hlr_10.42.42.2(pid=30266): stderr: | 20221210174112508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174112508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174112508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174112508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174112508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174112508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174112521 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174112530 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174112530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174112530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:41:15.572075 run osmo-msc_10.42.42.6(pid=30272): ERR: Terminated: ERROR {rc=2} [trial-2377↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30272)] 17:41:15.622596 run osmo-msc_10.42.42.6(pid=30272): stdout: | (launched: 2022-12-10_17:41:14.453401) 17:41:15.675077 run osmo-msc_10.42.42.6(pid=30272): stderr: | 20221210174114773 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174114773 DLGLOBAL DEBUG validating counter group 0x7fa74ee18c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174114774 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174114774 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174114774 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174114774 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174114776 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174114776 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174114776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174114776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:41:15.727643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30265): Terminating (SIGTERM) 17:41:15.769644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30268): Terminating (SIGTERM) 17:41:15.812184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30271): Terminating (SIGTERM) 17:41:15.863044 --- ParallelTerminationStrategy: PID 30265 died... 17:41:15.888076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30265): Terminated: ok {rc=0} 17:41:15.937498 --- ParallelTerminationStrategy: PID 30268 died... 17:41:15.957449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30268): Terminated: ok {rc=0} 17:41:16.004342 --- ParallelTerminationStrategy: PID 30271 died... 17:41:16.024010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30271): Terminated: ok {rc=0} 17:41:16.111792 bus /sierra_9: Setting Powered False 17:41:17.209392 bus /sierra_9: Setting Powered False 17:41:18.329199 bus /sierra_8: Setting Powered False 17:41:19.428409 bus /sierra_8: Setting Powered False 17:41:20.540403 bus /sierra_3: Setting Powered False 17:41:21.638532 bus /sierra_3: Setting Powered False 17:41:22.755273 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 17:41:24.038998 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:41:24.043832 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:41:24.080047 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 17:41:24.119328 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 17:41:24.207558 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:41:24.241990 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 17:41:24.281088 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 17:41:24.874815 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 17:41:24.927049 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:24.938282 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:41:24.989172 tst cs_paging_gprs_active.py: using LAC 29556 17:41:25.115481 tst cs_paging_gprs_active.py: using RAC 231 17:41:25.234848 tst cs_paging_gprs_active.py: using CellId 29556 17:41:25.353912 tst cs_paging_gprs_active.py: using BVCI 29557 17:41:25.461865 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:25.472637 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:25.483305 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:25.493979 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:25.504253 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:25.514815 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:25.525447 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:25.535729 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:25.546411 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:25.664512 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:25.783391 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:41:25.999089 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:26.319222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30277): Launched 17:41:26.598360 run iperf3-srv_10.42.42.10(pid=30278): Launched 17:41:26.720660 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:41:26.935772 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:27.257313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30279): Launched 17:41:27.536196 run iperf3-srv_10.42.42.10(pid=30280): Launched 17:41:27.657021 tst cs_paging_gprs_active.py:38: start network... 17:41:27.871888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:41:28.368911 run create_hlr_db(pid=30281): Launched 17:41:28.493219 bus /sierra_2: Setting Powered False 17:41:29.556745 run create_hlr_db(pid=30281): Terminated: ok {rc=0} 17:41:30.002505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30283): Launched 17:41:30.324847 run osmo-hlr_10.42.42.2(pid=30284): Launched 17:41:30.448876 run osmo-stp_10.42.42.5: Starting osmo-stp 17:41:31.015947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30286): Launched 17:41:31.457763 run osmo-stp_10.42.42.5(pid=30287): Launched 17:41:31.601229 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:41:32.329760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30289): Launched 17:41:32.444791 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:41:32.698072 run patchelf(pid=30290): Launched 17:41:32.866928 run osmo-stp_10.42.42.5(pid=30287): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30287)] 17:41:32.993727 run osmo-stp_10.42.42.5(pid=30287): stdout: | (launched: 2022-12-10_17:41:31.375100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:33.122069 run osmo-stp_10.42.42.5(pid=30287): stderr: | 20221210174131724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174131724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174131724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174131729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174131729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174131729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174131729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:33.250292 run osmo-stp_10.42.42.5(pid=30287): stdout: | (launched: 2022-12-10_17:41:31.375100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:33.373577 run osmo-stp_10.42.42.5(pid=30287): stderr: | 20221210174131724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174131724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174131724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174131729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174131729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174131729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174131729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:33.519397 run patchelf(pid=30290): Terminating (SIGINT) 17:41:33.687418 run patchelf(pid=30290): Terminated: ok {rc=0} 17:41:33.808486 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30287): Process ended prematurely: osmo-stp_10.42.42.5(pid=30287) [trial-2377↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30287)] [trial-2377↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 17:41:33.818316 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:41:33.845383 run osmo-hlr_10.42.42.2(pid=30284): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30284)] 17:41:33.892290 run osmo-hlr_10.42.42.2(pid=30284): stdout: | (launched: 2022-12-10_17:41:30.265814) 17:41:33.940934 run osmo-hlr_10.42.42.2(pid=30284): stderr: | 20221210174130465 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174130465 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174130465 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174130465 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174130466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174130466 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174130477 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174130485 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174130486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174130486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:41:33.990171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30277): Terminating (SIGTERM) 17:41:34.029562 run iperf3-srv_10.42.42.10(pid=30278): Terminating (SIGTERM) 17:41:34.068917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30279): Terminating (SIGTERM) 17:41:34.108397 run iperf3-srv_10.42.42.10(pid=30280): Terminating (SIGTERM) 17:41:34.148207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30283): Terminating (SIGTERM) 17:41:34.187641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30286): Terminating (SIGTERM) 17:41:34.226850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30289): Terminating (SIGTERM) 17:41:34.266379 --- ParallelTerminationStrategy: PID 30277 died... 17:41:34.285398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30277): Terminated: ok {rc=0} 17:41:34.329281 --- ParallelTerminationStrategy: PID 30278 died... 17:41:34.347588 run iperf3-srv_10.42.42.10(pid=30278): Terminated {rc=256} 17:41:34.391098 --- ParallelTerminationStrategy: PID 30279 died... 17:41:34.409739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30279): Terminated: ok {rc=0} 17:41:34.453271 --- ParallelTerminationStrategy: PID 30280 died... 17:41:34.471709 run iperf3-srv_10.42.42.10(pid=30280): Terminated {rc=256} 17:41:34.515039 --- ParallelTerminationStrategy: PID 30283 died... 17:41:34.533424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30283): Terminated: ok {rc=0} 17:41:34.576800 --- ParallelTerminationStrategy: PID 30286 died... 17:41:34.595647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30286): Terminated: ok {rc=0} 17:41:34.639191 --- ParallelTerminationStrategy: PID 30289 died... 17:41:34.657726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30289): Terminated: ok {rc=0} 17:41:34.742719 bus /gobi_0: Setting Powered False 17:41:35.842862 bus /gobi_0: Setting Powered False 17:41:36.957306 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 17:41:38.103706 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:38.115224 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:41:38.168479 tst iperf3.py: using LAC 29557 17:41:38.287468 tst iperf3.py: using RAC 232 17:41:38.407704 tst iperf3.py: using CellId 29557 17:41:38.526761 tst iperf3.py: using BVCI 29558 17:41:38.634914 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:38.645862 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:38.656278 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:38.666964 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:38.677671 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:38.688232 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:38.699024 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:38.709489 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:38.720218 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:38.837452 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:41:39.053834 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:39.374638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30291): Launched 17:41:39.653338 run iperf3-srv_10.42.42.10(pid=30292): Launched 17:41:39.773658 tst iperf3.py:8: start network... 17:41:39.988294 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:41:40.484666 run create_hlr_db(pid=30293): Launched 17:41:40.608449 bus /gobi_6: Setting Powered False 17:41:41.671825 run create_hlr_db(pid=30293): Terminated: ok {rc=0} 17:41:42.100862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30295): Launched 17:41:42.402295 run osmo-hlr_10.42.42.2(pid=30296): Launched 17:41:42.516146 run osmo-stp_10.42.42.5: Starting osmo-stp 17:41:43.045732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30298): Launched 17:41:43.345267 run osmo-stp_10.42.42.5(pid=30299): Launched 17:41:43.459087 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:41:43.974318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30301): Launched 17:41:44.089010 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:41:44.342282 run patchelf(pid=30302): Launched 17:41:44.511611 run osmo-stp_10.42.42.5(pid=30299): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30299)] 17:41:44.638839 run osmo-stp_10.42.42.5(pid=30299): stdout: | (launched: 2022-12-10_17:41:43.290380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:44.767559 run osmo-stp_10.42.42.5(pid=30299): stderr: | 20221210174143461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174143461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174143461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174143462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174143462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174143462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174143462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:44.896603 run osmo-stp_10.42.42.5(pid=30299): stdout: | (launched: 2022-12-10_17:41:43.290380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:45.019898 run osmo-stp_10.42.42.5(pid=30299): stderr: | 20221210174143461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174143461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174143461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174143462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174143462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174143462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174143462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:45.165630 run patchelf(pid=30302): Terminating (SIGINT) 17:41:45.334800 run patchelf(pid=30302): Terminated: ok {rc=0} 17:41:45.456579 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30299): Process ended prematurely: osmo-stp_10.42.42.5(pid=30299) [trial-2377↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30299)] [trial-2377↪gprs:trx-sysmocell5000↪iperf3.py:8] 17:41:45.466112 tst iperf3.py:8: Test FAILED (7.4 sec) 17:41:45.493458 run osmo-hlr_10.42.42.2(pid=30296): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30296)] 17:41:45.541134 run osmo-hlr_10.42.42.2(pid=30296): stdout: | (launched: 2022-12-10_17:41:42.346238) 17:41:45.590723 run osmo-hlr_10.42.42.2(pid=30296): stderr: | 20221210174142525 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174142525 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174142525 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174142525 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174142525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174142525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174142537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174142545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174142546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174142546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:41:45.640575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30291): Terminating (SIGTERM) 17:41:45.680751 run iperf3-srv_10.42.42.10(pid=30292): Terminating (SIGTERM) 17:41:45.720765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30295): Terminating (SIGTERM) 17:41:45.760788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30298): Terminating (SIGTERM) 17:41:45.800829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30301): Terminating (SIGTERM) 17:41:45.847533 --- ParallelTerminationStrategy: PID 30291 died... 17:41:45.872048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30291): Terminated: ok {rc=0} 17:41:45.934066 --- ParallelTerminationStrategy: PID 30292 died... 17:41:45.953226 run iperf3-srv_10.42.42.10(pid=30292): Terminated {rc=256} 17:41:45.998169 --- ParallelTerminationStrategy: PID 30295 died... 17:41:46.017950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30295): Terminated: ok {rc=0} 17:41:46.063054 --- ParallelTerminationStrategy: PID 30298 died... 17:41:46.082325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30298): Terminated: ok {rc=0} 17:41:46.127530 --- ParallelTerminationStrategy: PID 30301 died... 17:41:46.146821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30301): Terminated: ok {rc=0} 17:41:46.232745 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 17:41:47.375061 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:47.386516 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:41:47.437086 tst iperf3m4.py: using LAC 29558 17:41:47.555138 tst iperf3m4.py: using RAC 233 17:41:47.672882 tst iperf3m4.py: using CellId 29558 17:41:47.799325 tst iperf3m4.py: using BVCI 29559 17:41:47.915287 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:47.926676 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:47.937741 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:47.949561 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:47.961270 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:47.973213 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:47.984812 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:47.996477 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:48.008346 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:48.124532 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:48.244442 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:48.360824 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:48.478498 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:41:48.693741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:49.012905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30303): Launched 17:41:49.291079 run iperf3-srv_10.42.42.10(pid=30304): Launched 17:41:49.411631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:41:49.625643 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:49.945187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30305): Launched 17:41:50.221527 run iperf3-srv_10.42.42.10(pid=30306): Launched 17:41:50.343018 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:41:50.557654 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:50.877714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30307): Launched 17:41:51.155525 run iperf3-srv_10.42.42.10(pid=30308): Launched 17:41:51.275715 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:41:51.490665 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:51.810111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30309): Launched 17:41:52.087895 run iperf3-srv_10.42.42.10(pid=30310): Launched 17:41:52.207420 tst iperf3m4.py:8: start network... 17:41:52.421719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:41:52.917341 run create_hlr_db(pid=30311): Launched 17:41:53.038494 bus /gobi_6: Setting Powered False 17:41:54.101250 run create_hlr_db(pid=30311): Terminated: ok {rc=0} 17:41:54.528268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30313): Launched 17:41:54.826952 run osmo-hlr_10.42.42.2(pid=30314): Launched 17:41:54.940230 run osmo-stp_10.42.42.5: Starting osmo-stp 17:41:55.470323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30316): Launched 17:41:55.768854 run osmo-stp_10.42.42.5(pid=30317): Launched 17:41:55.881991 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:41:56.395160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30319): Launched 17:41:56.510353 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:41:56.762763 run patchelf(pid=30320): Launched 17:41:56.941902 run osmo-stp_10.42.42.5(pid=30317): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30317)] 17:41:57.077652 run osmo-stp_10.42.42.5(pid=30317): stdout: | (launched: 2022-12-10_17:41:55.713963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:57.214503 run osmo-stp_10.42.42.5(pid=30317): stderr: | 20221210174155881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174155881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174155881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174155881 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174155882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174155882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174155882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:57.352254 run osmo-stp_10.42.42.5(pid=30317): stdout: | (launched: 2022-12-10_17:41:55.713963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:57.483280 run osmo-stp_10.42.42.5(pid=30317): stderr: | 20221210174155881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174155881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174155881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174155881 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174155882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174155882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174155882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:57.638712 run patchelf(pid=30320): Terminating (SIGINT) 17:41:57.817983 run patchelf(pid=30320): Terminated: ok {rc=0} 17:41:57.946863 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30317): Process ended prematurely: osmo-stp_10.42.42.5(pid=30317) [trial-2377↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30317)] [trial-2377↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 17:41:57.956843 tst iperf3m4.py:8: Test FAILED (10.6 sec) 17:41:57.986120 run osmo-hlr_10.42.42.2(pid=30314): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30314)] 17:41:58.036430 run osmo-hlr_10.42.42.2(pid=30314): stdout: | (launched: 2022-12-10_17:41:54.772172) 17:41:58.088271 run osmo-hlr_10.42.42.2(pid=30314): stderr: | 20221210174154947 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174154947 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174154947 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174154947 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174154947 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174154947 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174154960 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174154970 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174154971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174154971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:41:58.140600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30303): Terminating (SIGTERM) 17:41:58.182546 run iperf3-srv_10.42.42.10(pid=30304): Terminating (SIGTERM) 17:41:58.224325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30305): Terminating (SIGTERM) 17:41:58.266336 run iperf3-srv_10.42.42.10(pid=30306): Terminating (SIGTERM) 17:41:58.308077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30307): Terminating (SIGTERM) 17:41:58.349846 run iperf3-srv_10.42.42.10(pid=30308): Terminating (SIGTERM) 17:41:58.392098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30309): Terminating (SIGTERM) 17:41:58.433978 run iperf3-srv_10.42.42.10(pid=30310): Terminating (SIGTERM) 17:41:58.475573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30313): Terminating (SIGTERM) 17:41:58.517523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30316): Terminating (SIGTERM) 17:41:58.559235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30319): Terminating (SIGTERM) 17:41:58.601367 --- ParallelTerminationStrategy: PID 30303 died... 17:41:58.621336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30303): Terminated: ok {rc=0} 17:41:58.668039 --- ParallelTerminationStrategy: PID 30304 died... 17:41:58.687671 run iperf3-srv_10.42.42.10(pid=30304): Terminated {rc=256} 17:41:58.734303 --- ParallelTerminationStrategy: PID 30305 died... 17:41:58.754003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30305): Terminated: ok {rc=0} 17:41:58.800445 --- ParallelTerminationStrategy: PID 30306 died... 17:41:58.819868 run iperf3-srv_10.42.42.10(pid=30306): Terminated {rc=256} 17:41:58.866029 --- ParallelTerminationStrategy: PID 30307 died... 17:41:58.885582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30307): Terminated: ok {rc=0} 17:41:58.931617 --- ParallelTerminationStrategy: PID 30308 died... 17:41:58.950792 run iperf3-srv_10.42.42.10(pid=30308): Terminated {rc=256} 17:41:58.996878 --- ParallelTerminationStrategy: PID 30309 died... 17:41:59.016676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30309): Terminated: ok {rc=0} 17:41:59.062907 --- ParallelTerminationStrategy: PID 30310 died... 17:41:59.082507 run iperf3-srv_10.42.42.10(pid=30310): Terminated {rc=256} 17:41:59.128642 --- ParallelTerminationStrategy: PID 30313 died... 17:41:59.148071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30313): Terminated: ok {rc=0} 17:41:59.194557 --- ParallelTerminationStrategy: PID 30316 died... 17:41:59.214162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30316): Terminated: ok {rc=0} 17:41:59.260520 --- ParallelTerminationStrategy: PID 30319 died... 17:41:59.280182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30319): Terminated: ok {rc=0} 17:41:59.368447 bus /gobi_4: Setting Powered False 17:42:00.466033 bus /gobi_4: Setting Powered False 17:42:01.580545 bus /gobi_1: Setting Powered False 17:42:02.675969 bus /gobi_1: Setting Powered False 17:42:03.791034 bus /gobi_0: Setting Powered False 17:42:04.889121 bus /gobi_0: Setting Powered False 17:42:06.004157 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 17:42:07.107536 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:07.119163 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:42:07.169406 tst ping.py: using LAC 29559 17:42:07.284882 tst ping.py: using RAC 234 17:42:07.402086 tst ping.py: using CellId 29559 17:42:07.515074 tst ping.py: using BVCI 29560 17:42:07.620317 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:07.631036 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:07.641662 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:07.652145 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:07.662559 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:07.673371 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:07.683895 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:07.694391 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:42:07.809851 tst ping.py:19: start network... 17:42:08.021502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:42:08.505989 run create_hlr_db(pid=30325): Launched 17:42:08.627115 bus /gobi_6: Setting Powered False 17:42:09.685410 run create_hlr_db(pid=30325): Terminated: ok {rc=0} 17:42:10.121514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30327): Launched 17:42:10.434668 run osmo-hlr_10.42.42.2(pid=30328): Launched 17:42:10.554939 run osmo-stp_10.42.42.5: Starting osmo-stp 17:42:11.099405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30330): Launched 17:42:11.412878 run osmo-stp_10.42.42.5(pid=30331): Launched 17:42:11.533219 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:42:12.074378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30333): Launched 17:42:12.196319 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:42:12.461673 run patchelf(pid=30334): Launched 17:42:12.638704 run osmo-stp_10.42.42.5(pid=30331): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30331)] 17:42:12.772169 run osmo-stp_10.42.42.5(pid=30331): stdout: | (launched: 2022-12-10_17:42:11.354932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:12.907322 run osmo-stp_10.42.42.5(pid=30331): stderr: | 20221210174211547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174211547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174211547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174211548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174211548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174211548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174211548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:13.051394 run osmo-stp_10.42.42.5(pid=30331): stdout: | (launched: 2022-12-10_17:42:11.354932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:13.180495 run osmo-stp_10.42.42.5(pid=30331): stderr: | 20221210174211547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174211547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174211547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174211548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174211548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174211548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174211548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:13.333829 run patchelf(pid=30334): Terminating (SIGINT) 17:42:13.509791 run patchelf(pid=30334): Terminated: ok {rc=0} 17:42:13.635946 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30331): Process ended prematurely: osmo-stp_10.42.42.5(pid=30331) [trial-2377↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30331)] [trial-2377↪gprs:trx-sysmocell5000↪ping.py:22] 17:42:13.645475 tst ping.py:22: Test FAILED (6.5 sec) 17:42:13.673883 run osmo-hlr_10.42.42.2(pid=30328): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30328)] 17:42:13.723924 run osmo-hlr_10.42.42.2(pid=30328): stdout: | (launched: 2022-12-10_17:42:10.377676) 17:42:13.775898 run osmo-hlr_10.42.42.2(pid=30328): stderr: | 20221210174210577 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174210577 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174210577 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174210577 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174210577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174210577 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174210588 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174210597 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174210597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174210597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:42:13.828112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30327): Terminating (SIGTERM) 17:42:13.870422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30330): Terminating (SIGTERM) 17:42:13.912600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30333): Terminating (SIGTERM) 17:42:13.954848 --- ParallelTerminationStrategy: PID 30327 died... 17:42:13.974954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30327): Terminated: ok {rc=0} 17:42:14.021831 --- ParallelTerminationStrategy: PID 30330 died... 17:42:14.041489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30330): Terminated: ok {rc=0} 17:42:14.088191 --- ParallelTerminationStrategy: PID 30333 died... 17:42:14.107794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30333): Terminated: ok {rc=0} 17:42:14.195535 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 17:42:15.282712 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:15.295219 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:42:15.348283 tst ping_idle_ping.py: using LAC 29560 17:42:15.476636 tst ping_idle_ping.py: using RAC 235 17:42:15.606027 tst ping_idle_ping.py: using CellId 29560 17:42:15.723208 tst ping_idle_ping.py: using BVCI 29561 17:42:15.831064 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:15.842794 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:15.864372 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:15.917867 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:15.949682 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:15.987190 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:16.008888 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:16.040668 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:42:16.240306 tst ping_idle_ping.py:24: start network... 17:42:16.459570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:42:16.961350 run create_hlr_db(pid=30337): Launched 17:42:17.122696 bus /gobi_6: Setting Powered False 17:42:18.185838 run create_hlr_db(pid=30337): Terminated: ok {rc=0} 17:42:18.626269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30339): Launched 17:42:18.940366 run osmo-hlr_10.42.42.2(pid=30340): Launched 17:42:19.062231 run osmo-stp_10.42.42.5: Starting osmo-stp 17:42:19.606094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30342): Launched 17:42:19.920537 run osmo-stp_10.42.42.5(pid=30343): Launched 17:42:20.041666 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:42:20.584728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30345): Launched 17:42:20.705587 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:42:20.970441 run patchelf(pid=30346): Launched 17:42:21.146287 run osmo-stp_10.42.42.5(pid=30343): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30343)] 17:42:21.280021 run osmo-stp_10.42.42.5(pid=30343): stdout: | (launched: 2022-12-10_17:42:19.863243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:21.415595 run osmo-stp_10.42.42.5(pid=30343): stderr: | 20221210174220054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174220054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174220055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174220055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174220055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174220055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174220055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:21.551036 run osmo-stp_10.42.42.5(pid=30343): stdout: | (launched: 2022-12-10_17:42:19.863243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:21.680414 run osmo-stp_10.42.42.5(pid=30343): stderr: | 20221210174220054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174220054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174220055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174220055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174220055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174220055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174220055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:21.833653 run patchelf(pid=30346): Terminating (SIGINT) 17:42:22.009959 run patchelf(pid=30346): Terminated: ok {rc=0} 17:42:22.137073 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30343): Process ended prematurely: osmo-stp_10.42.42.5(pid=30343) [trial-2377↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30343)] [trial-2377↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 17:42:22.146603 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 17:42:22.175292 run osmo-hlr_10.42.42.2(pid=30340): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30340)] 17:42:22.225840 run osmo-hlr_10.42.42.2(pid=30340): stdout: | (launched: 2022-12-10_17:42:18.882869) 17:42:22.278117 run osmo-hlr_10.42.42.2(pid=30340): stderr: | 20221210174219080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174219080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174219080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174219080 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174219080 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174219080 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174219092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174219101 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174219102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174219102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:42:22.331096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30339): Terminating (SIGTERM) 17:42:22.373907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30342): Terminating (SIGTERM) 17:42:22.416370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30345): Terminating (SIGTERM) 17:42:22.458888 --- ParallelTerminationStrategy: PID 30339 died... 17:42:22.479103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30339): Terminated: ok {rc=0} 17:42:22.526427 --- ParallelTerminationStrategy: PID 30342 died... 17:42:22.546284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30342): Terminated: ok {rc=0} 17:42:22.593906 --- ParallelTerminationStrategy: PID 30345 died... 17:42:22.613794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30345): Terminated: ok {rc=0} 17:42:22.701834 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 17:42:24.014154 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:42:24.019783 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:42:24.056771 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:42:24.096179 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:42:24.184629 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:42:24.219082 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:42:24.257625 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:42:24.854723 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:42:24.907540 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:24.919089 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:42:24.970189 tst cs_paging_gprs_active.py: using LAC 29561 17:42:25.094151 tst cs_paging_gprs_active.py: using RAC 236 17:42:25.210891 tst cs_paging_gprs_active.py: using CellId 29561 17:42:25.326832 tst cs_paging_gprs_active.py: using BVCI 29562 17:42:25.437236 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:25.448251 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:25.459316 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:25.470254 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:25.480824 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:25.491565 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:25.502413 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:25.513025 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:25.523880 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:25.640645 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:25.755449 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:42:25.955263 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:26.255281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30350): Launched 17:42:26.516051 run iperf3-srv_10.42.42.10(pid=30351): Launched 17:42:26.628863 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:42:26.829258 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:27.129565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30352): Launched 17:42:27.392813 run iperf3-srv_10.42.42.10(pid=30353): Launched 17:42:27.505810 tst cs_paging_gprs_active.py:38: start network... 17:42:27.705159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:42:28.168633 run create_hlr_db(pid=30354): Launched 17:42:28.291425 bus /gobi_6: Setting Powered False 17:42:29.350474 run create_hlr_db(pid=30354): Terminated: ok {rc=0} 17:42:29.787218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30356): Launched 17:42:30.108883 run osmo-hlr_10.42.42.2(pid=30357): Launched 17:42:30.232659 run osmo-stp_10.42.42.5: Starting osmo-stp 17:42:30.787998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30359): Launched 17:42:31.120003 run osmo-stp_10.42.42.5(pid=30360): Launched 17:42:31.257150 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:42:31.877963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30362): Launched 17:42:32.013703 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:42:32.297823 run patchelf(pid=30363): Launched 17:42:32.474742 run osmo-stp_10.42.42.5(pid=30360): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30360)] 17:42:32.604449 run osmo-stp_10.42.42.5(pid=30360): stdout: | (launched: 2022-12-10_17:42:31.061158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:32.732806 run osmo-stp_10.42.42.5(pid=30360): stderr: | 20221210174231439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174231440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174231440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174231440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174231441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174231441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174231446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:32.862343 run osmo-stp_10.42.42.5(pid=30360): stdout: | (launched: 2022-12-10_17:42:31.061158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:32.985681 run osmo-stp_10.42.42.5(pid=30360): stderr: | 20221210174231439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174231440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174231440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174231440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174231441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174231441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174231446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:33.131696 run patchelf(pid=30363): Terminating (SIGINT) 17:42:33.299418 run patchelf(pid=30363): Terminated: ok {rc=0} 17:42:33.420674 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30360): Process ended prematurely: osmo-stp_10.42.42.5(pid=30360) [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30360)] [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:42:33.430281 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 17:42:33.457404 run osmo-hlr_10.42.42.2(pid=30357): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30357)] 17:42:33.504926 run osmo-hlr_10.42.42.2(pid=30357): stdout: | (launched: 2022-12-10_17:42:30.050105) 17:42:33.554448 run osmo-hlr_10.42.42.2(pid=30357): stderr: | 20221210174230247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174230247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174230247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174230247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174230247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174230248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174230260 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174230268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174230268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174230268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:42:33.604070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30350): Terminating (SIGTERM) 17:42:33.643756 run iperf3-srv_10.42.42.10(pid=30351): Terminating (SIGTERM) 17:42:33.683288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30352): Terminating (SIGTERM) 17:42:33.722772 run iperf3-srv_10.42.42.10(pid=30353): Terminating (SIGTERM) 17:42:33.762020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30356): Terminating (SIGTERM) 17:42:33.801598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30359): Terminating (SIGTERM) 17:42:33.840851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30362): Terminating (SIGTERM) 17:42:33.880374 --- ParallelTerminationStrategy: PID 30350 died... 17:42:33.899419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30350): Terminated: ok {rc=0} 17:42:33.943194 --- ParallelTerminationStrategy: PID 30351 died... 17:42:33.961553 run iperf3-srv_10.42.42.10(pid=30351): Terminated {rc=256} 17:42:34.005189 --- ParallelTerminationStrategy: PID 30352 died... 17:42:34.023735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30352): Terminated: ok {rc=0} 17:42:34.067480 --- ParallelTerminationStrategy: PID 30353 died... 17:42:34.086110 run iperf3-srv_10.42.42.10(pid=30353): Terminated {rc=256} 17:42:34.129763 --- ParallelTerminationStrategy: PID 30356 died... 17:42:34.148200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30356): Terminated: ok {rc=0} 17:42:34.191647 --- ParallelTerminationStrategy: PID 30359 died... 17:42:34.210139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30359): Terminated: ok {rc=0} 17:42:34.253675 --- ParallelTerminationStrategy: PID 30362 died... 17:42:34.272153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30362): Terminated: ok {rc=0} 17:42:34.357142 bus /gobi_0: Setting Powered False 17:42:35.456529 bus /gobi_0: Setting Powered False 17:42:36.568910 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:42:37.716581 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:37.728665 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:42:37.785461 tst iperf3.py: using LAC 29562 17:42:37.904194 tst iperf3.py: using RAC 237 17:42:38.033812 tst iperf3.py: using CellId 29562 17:42:38.158676 tst iperf3.py: using BVCI 29563 17:42:38.274720 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:38.286208 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:38.297340 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:38.309378 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:38.321284 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:38.333190 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:38.345134 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:38.356735 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:38.368747 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:38.483263 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:42:38.682714 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:38.981853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30364): Launched 17:42:39.241669 run iperf3-srv_10.42.42.10(pid=30365): Launched 17:42:39.354305 tst iperf3.py:8: start network... 17:42:39.553433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:42:40.016892 run create_hlr_db(pid=30366): Launched 17:42:40.139430 bus /gobi_6: Setting Powered False 17:42:41.198799 run create_hlr_db(pid=30366): Terminated: ok {rc=0} 17:42:41.634730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30368): Launched 17:42:41.955986 run osmo-hlr_10.42.42.2(pid=30369): Launched 17:42:42.078458 run osmo-stp_10.42.42.5: Starting osmo-stp 17:42:42.633158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30371): Launched 17:42:42.952863 run osmo-stp_10.42.42.5(pid=30372): Launched 17:42:43.075335 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:42:43.627915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30374): Launched 17:42:43.750788 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:42:44.020520 run patchelf(pid=30375): Launched 17:42:44.198498 run osmo-stp_10.42.42.5(pid=30372): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30372)] 17:42:44.334247 run osmo-stp_10.42.42.5(pid=30372): stdout: | (launched: 2022-12-10_17:42:42.894533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:44.471779 run osmo-stp_10.42.42.5(pid=30372): stderr: | 20221210174243085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174243085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174243085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174243085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174243086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174243086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174243086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:44.609271 run osmo-stp_10.42.42.5(pid=30372): stdout: | (launched: 2022-12-10_17:42:42.894533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:44.740770 run osmo-stp_10.42.42.5(pid=30372): stderr: | 20221210174243085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174243085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174243085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174243085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174243086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174243086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174243086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:44.896720 run patchelf(pid=30375): Terminating (SIGINT) 17:42:45.075709 run patchelf(pid=30375): Terminated: ok {rc=0} 17:42:45.204588 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30372): Process ended prematurely: osmo-stp_10.42.42.5(pid=30372) [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30372)] [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 17:42:45.215471 tst iperf3.py:8: Test FAILED (7.5 sec) 17:42:45.244800 run osmo-hlr_10.42.42.2(pid=30369): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30369)] 17:42:45.295551 run osmo-hlr_10.42.42.2(pid=30369): stdout: | (launched: 2022-12-10_17:42:41.897613) 17:42:45.347975 run osmo-hlr_10.42.42.2(pid=30369): stderr: | 20221210174242095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174242095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174242095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174242095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174242095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174242095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174242108 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174242116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174242116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174242116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:42:45.401263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30364): Terminating (SIGTERM) 17:42:45.443591 run iperf3-srv_10.42.42.10(pid=30365): Terminating (SIGTERM) 17:42:45.485927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30368): Terminating (SIGTERM) 17:42:45.528079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30371): Terminating (SIGTERM) 17:42:45.570314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30374): Terminating (SIGTERM) 17:42:45.612439 --- ParallelTerminationStrategy: PID 30364 died... 17:42:45.632426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30364): Terminated: ok {rc=0} 17:42:45.679344 --- ParallelTerminationStrategy: PID 30365 died... 17:42:45.698951 run iperf3-srv_10.42.42.10(pid=30365): Terminated {rc=256} 17:42:45.745540 --- ParallelTerminationStrategy: PID 30368 died... 17:42:45.764905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30368): Terminated: ok {rc=0} 17:42:45.811721 --- ParallelTerminationStrategy: PID 30371 died... 17:42:45.839165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30371): Terminated: ok {rc=0} 17:42:45.916123 --- ParallelTerminationStrategy: PID 30374 died... 17:42:45.938752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30374): Terminated: ok {rc=0} 17:42:46.027333 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:42:47.194569 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:47.207287 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:42:47.263748 tst iperf3m4.py: using LAC 29563 17:42:47.393518 tst iperf3m4.py: using RAC 238 17:42:47.514885 tst iperf3m4.py: using CellId 29563 17:42:47.631729 tst iperf3m4.py: using BVCI 29564 17:42:47.750669 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:47.762098 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:47.773558 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:47.785276 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:47.796673 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:47.808275 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:47.819798 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:47.831170 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:47.842756 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:47.958643 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:48.081278 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:48.196480 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:48.314639 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:42:48.531024 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:48.851835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30376): Launched 17:42:49.130029 run iperf3-srv_10.42.42.10(pid=30377): Launched 17:42:49.252178 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:42:49.467317 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:49.787542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30378): Launched 17:42:50.065719 run iperf3-srv_10.42.42.10(pid=30379): Launched 17:42:50.185802 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:42:50.400727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:50.721380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30380): Launched 17:42:50.999930 run iperf3-srv_10.42.42.10(pid=30381): Launched 17:42:51.120278 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:42:51.335048 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:51.656758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30382): Launched 17:42:51.937785 run iperf3-srv_10.42.42.10(pid=30383): Launched 17:42:52.055707 tst iperf3m4.py:8: start network... 17:42:52.254953 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:42:52.718769 run create_hlr_db(pid=30384): Launched 17:42:52.841354 bus /gobi_6: Setting Powered False 17:42:53.901527 run create_hlr_db(pid=30384): Terminated: ok {rc=0} 17:42:54.318275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30386): Launched 17:42:54.617789 run osmo-hlr_10.42.42.2(pid=30387): Launched 17:42:54.730686 run osmo-stp_10.42.42.5: Starting osmo-stp 17:42:55.244887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30389): Launched 17:42:55.545497 run osmo-stp_10.42.42.5(pid=30390): Launched 17:42:55.659174 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:42:56.174384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30392): Launched 17:42:56.288453 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:42:56.540598 run patchelf(pid=30393): Launched 17:42:56.707178 run osmo-stp_10.42.42.5(pid=30390): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30390)] 17:42:56.833664 run osmo-stp_10.42.42.5(pid=30390): stdout: | (launched: 2022-12-10_17:42:55.490161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:56.962396 run osmo-stp_10.42.42.5(pid=30390): stderr: | 20221210174255657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174255657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174255657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174255658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174255658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174255658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174255658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:57.090649 run osmo-stp_10.42.42.5(pid=30390): stdout: | (launched: 2022-12-10_17:42:55.490161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:57.212772 run osmo-stp_10.42.42.5(pid=30390): stderr: | 20221210174255657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174255657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174255657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174255658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174255658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174255658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174255658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:57.357983 run patchelf(pid=30393): Terminating (SIGINT) 17:42:57.525591 run patchelf(pid=30393): Terminated: ok {rc=0} 17:42:57.645651 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30390): Process ended prematurely: osmo-stp_10.42.42.5(pid=30390) [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30390)] [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 17:42:57.655031 tst iperf3m4.py:8: Test FAILED (10.5 sec) 17:42:57.682499 run osmo-hlr_10.42.42.2(pid=30387): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30387)] 17:42:57.729979 run osmo-hlr_10.42.42.2(pid=30387): stdout: | (launched: 2022-12-10_17:42:54.562259) 17:42:57.779184 run osmo-hlr_10.42.42.2(pid=30387): stderr: | 20221210174254737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174254737 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174254737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174254737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174254737 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174254737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174254749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174254758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174254758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174254759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:42:57.828678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30376): Terminating (SIGTERM) 17:42:57.868388 run iperf3-srv_10.42.42.10(pid=30377): Terminating (SIGTERM) 17:42:57.908028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30378): Terminating (SIGTERM) 17:42:57.947515 run iperf3-srv_10.42.42.10(pid=30379): Terminating (SIGTERM) 17:42:57.986938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30380): Terminating (SIGTERM) 17:42:58.026502 run iperf3-srv_10.42.42.10(pid=30381): Terminating (SIGTERM) 17:42:58.065912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30382): Terminating (SIGTERM) 17:42:58.105875 run iperf3-srv_10.42.42.10(pid=30383): Terminating (SIGTERM) 17:42:58.145275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30386): Terminating (SIGTERM) 17:42:58.185277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30389): Terminating (SIGTERM) 17:42:58.225315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30392): Terminating (SIGTERM) 17:42:58.265416 --- ParallelTerminationStrategy: PID 30376 died... 17:42:58.284443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30376): Terminated: ok {rc=0} 17:42:58.328427 --- ParallelTerminationStrategy: PID 30377 died... 17:42:58.347044 run iperf3-srv_10.42.42.10(pid=30377): Terminated {rc=256} 17:42:58.390543 --- ParallelTerminationStrategy: PID 30378 died... 17:42:58.409004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30378): Terminated: ok {rc=0} 17:42:58.452250 --- ParallelTerminationStrategy: PID 30379 died... 17:42:58.470669 run iperf3-srv_10.42.42.10(pid=30379): Terminated {rc=256} 17:42:58.513738 --- ParallelTerminationStrategy: PID 30380 died... 17:42:58.532088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30380): Terminated: ok {rc=0} 17:42:58.575414 --- ParallelTerminationStrategy: PID 30381 died... 17:42:58.593856 run iperf3-srv_10.42.42.10(pid=30381): Terminated {rc=256} 17:42:58.637044 --- ParallelTerminationStrategy: PID 30382 died... 17:42:58.655358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30382): Terminated: ok {rc=0} 17:42:58.698666 --- ParallelTerminationStrategy: PID 30383 died... 17:42:58.717190 run iperf3-srv_10.42.42.10(pid=30383): Terminated {rc=256} 17:42:58.760359 --- ParallelTerminationStrategy: PID 30386 died... 17:42:58.778782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30386): Terminated: ok {rc=0} 17:42:58.822257 --- ParallelTerminationStrategy: PID 30389 died... 17:42:58.840697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30389): Terminated: ok {rc=0} 17:42:58.884232 --- ParallelTerminationStrategy: PID 30392 died... 17:42:58.902726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30392): Terminated: ok {rc=0} 17:42:58.988632 bus /gobi_4: Setting Powered False 17:43:00.087722 bus /gobi_4: Setting Powered False 17:43:01.200149 bus /gobi_1: Setting Powered False 17:43:02.296370 bus /gobi_1: Setting Powered False 17:43:03.411550 bus /gobi_0: Setting Powered False 17:43:04.509346 bus /gobi_0: Setting Powered False 17:43:05.624718 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 17:43:06.726935 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:06.739155 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:43:06.792586 tst ping.py: using LAC 29564 17:43:06.915512 tst ping.py: using RAC 239 17:43:07.037362 tst ping.py: using CellId 29564 17:43:07.159324 tst ping.py: using BVCI 29565 17:43:07.274216 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:07.285872 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:07.297107 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:07.308545 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:07.319900 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:07.331362 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:07.342984 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:07.354587 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:43:07.470635 tst ping.py:19: start network... 17:43:07.681011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:43:08.165116 run create_hlr_db(pid=30394): Launched 17:43:08.283762 bus /gobi_6: Setting Powered False 17:43:09.346075 run create_hlr_db(pid=30394): Terminated: ok {rc=0} 17:43:09.784830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30396): Launched 17:43:10.100410 run osmo-hlr_10.42.42.2(pid=30397): Launched 17:43:10.220915 run osmo-stp_10.42.42.5: Starting osmo-stp 17:43:10.767551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30399): Launched 17:43:11.081496 run osmo-stp_10.42.42.5(pid=30400): Launched 17:43:11.201882 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:43:11.744937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30402): Launched 17:43:11.867471 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:43:12.134232 run patchelf(pid=30403): Launched 17:43:12.311892 run osmo-stp_10.42.42.5(pid=30400): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30400)] 17:43:12.446751 run osmo-stp_10.42.42.5(pid=30400): stdout: | (launched: 2022-12-10_17:43:11.023786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:12.581792 run osmo-stp_10.42.42.5(pid=30400): stderr: | 20221210174311215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174311215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174311216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174311216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174311216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174311217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174311217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:12.717669 run osmo-stp_10.42.42.5(pid=30400): stdout: | (launched: 2022-12-10_17:43:11.023786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:12.846728 run osmo-stp_10.42.42.5(pid=30400): stderr: | 20221210174311215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174311215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174311216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174311216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174311216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174311217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174311217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:13.000142 run patchelf(pid=30403): Terminating (SIGINT) 17:43:13.176772 run patchelf(pid=30403): Terminated: ok {rc=0} 17:43:13.303804 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30400): Process ended prematurely: osmo-stp_10.42.42.5(pid=30400) [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30400)] [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 17:43:13.313370 tst ping.py:22: Test FAILED (6.6 sec) 17:43:13.342091 run osmo-hlr_10.42.42.2(pid=30397): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30397)] 17:43:13.392647 run osmo-hlr_10.42.42.2(pid=30397): stdout: | (launched: 2022-12-10_17:43:10.042890) 17:43:13.444536 run osmo-hlr_10.42.42.2(pid=30397): stderr: | 20221210174310239 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174310239 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174310239 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174310239 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174310239 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174310239 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174310251 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174310260 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174310260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174310260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:43:13.496876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30396): Terminating (SIGTERM) 17:43:13.538874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30399): Terminating (SIGTERM) 17:43:13.580879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30402): Terminating (SIGTERM) 17:43:13.623344 --- ParallelTerminationStrategy: PID 30396 died... 17:43:13.643304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30396): Terminated: ok {rc=0} 17:43:13.689902 --- ParallelTerminationStrategy: PID 30399 died... 17:43:13.709377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30399): Terminated: ok {rc=0} 17:43:13.755589 --- ParallelTerminationStrategy: PID 30402 died... 17:43:13.775113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30402): Terminated: ok {rc=0} 17:43:13.862668 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:43:14.946525 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:14.958298 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:43:15.011333 tst ping_idle_ping.py: using LAC 29565 17:43:15.128411 tst ping_idle_ping.py: using RAC 240 17:43:15.244233 tst ping_idle_ping.py: using CellId 29565 17:43:15.367878 tst ping_idle_ping.py: using BVCI 29566 17:43:15.482593 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:15.494229 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:15.505717 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:15.517488 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:15.529876 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:15.541668 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:15.553913 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:15.565703 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:43:15.683334 tst ping_idle_ping.py:24: start network... 17:43:15.922010 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:43:16.522208 run create_hlr_db(pid=30404): Launched 17:43:16.647142 bus /gobi_6: Setting Powered False 17:43:17.709260 run create_hlr_db(pid=30404): Terminated: ok {rc=0} 17:43:18.150671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30406): Launched 17:43:18.468515 run osmo-hlr_10.42.42.2(pid=30407): Launched 17:43:18.589531 run osmo-stp_10.42.42.5: Starting osmo-stp 17:43:19.133863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30409): Launched 17:43:19.449252 run osmo-stp_10.42.42.5(pid=30410): Launched 17:43:19.569481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:43:20.112893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30412): Launched 17:43:20.234109 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:43:20.500664 run patchelf(pid=30413): Launched 17:43:20.678677 run osmo-stp_10.42.42.5(pid=30410): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30410)] 17:43:20.808272 run osmo-stp_10.42.42.5(pid=30410): stdout: | (launched: 2022-12-10_17:43:19.391144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:20.935206 run osmo-stp_10.42.42.5(pid=30410): stderr: | 20221210174319583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174319583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174319583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174319584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174319584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174319584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174319584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:21.061435 run osmo-stp_10.42.42.5(pid=30410): stdout: | (launched: 2022-12-10_17:43:19.391144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:21.182652 run osmo-stp_10.42.42.5(pid=30410): stderr: | 20221210174319583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174319583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174319583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174319584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174319584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174319584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174319584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:21.325761 run patchelf(pid=30413): Terminating (SIGINT) 17:43:21.490575 run patchelf(pid=30413): Terminated: ok {rc=0} 17:43:21.609954 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30410): Process ended prematurely: osmo-stp_10.42.42.5(pid=30410) [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30410)] [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 17:43:21.618722 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:43:21.645691 run osmo-hlr_10.42.42.2(pid=30407): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30407)] 17:43:21.693128 run osmo-hlr_10.42.42.2(pid=30407): stdout: | (launched: 2022-12-10_17:43:18.409927) 17:43:21.741771 run osmo-hlr_10.42.42.2(pid=30407): stderr: | 20221210174318613 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174318613 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174318613 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174318613 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174318613 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174318613 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174318623 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174318632 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174318632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174318632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:43:21.791113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30406): Terminating (SIGTERM) 17:43:21.830733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30409): Terminating (SIGTERM) 17:43:21.870372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30412): Terminating (SIGTERM) 17:43:21.910326 --- ParallelTerminationStrategy: PID 30406 died... 17:43:21.929484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30406): Terminated: ok {rc=0} 17:43:21.973631 --- ParallelTerminationStrategy: PID 30409 died... 17:43:21.992113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30409): Terminated: ok {rc=0} 17:43:22.035959 --- ParallelTerminationStrategy: PID 30412 died... 17:43:22.054639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30412): Terminated: ok {rc=0} 17:43:22.140038 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:43:23.463085 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:43:23.469786 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:43:23.505258 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:43:23.545890 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:43:23.631366 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:43:23.666214 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:43:23.705428 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:43:24.300640 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:43:24.351273 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:24.362500 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:43:24.430284 tst cs_paging_gprs_active.py: using LAC 29566 17:43:24.546251 tst cs_paging_gprs_active.py: using RAC 241 17:43:24.661958 tst cs_paging_gprs_active.py: using CellId 29566 17:43:24.777882 tst cs_paging_gprs_active.py: using BVCI 29567 17:43:24.885916 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:24.896812 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:24.907618 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:24.918565 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:24.929593 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:24.940279 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:24.951285 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:24.962132 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:24.973301 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:43:25.091510 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:43:25.211370 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:43:25.427516 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:25.748796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30417): Launched 17:43:26.027699 run iperf3-srv_10.42.42.10(pid=30418): Launched 17:43:26.148727 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:43:26.363820 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:26.686177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30419): Launched 17:43:26.965423 run iperf3-srv_10.42.42.10(pid=30420): Launched 17:43:27.086242 tst cs_paging_gprs_active.py:38: start network... 17:43:27.302535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:43:27.801409 run create_hlr_db(pid=30421): Launched 17:43:27.925208 bus /gobi_6: Setting Powered False 17:43:28.988249 run create_hlr_db(pid=30421): Terminated: ok {rc=0} 17:43:29.418431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30423): Launched 17:43:29.719943 run osmo-hlr_10.42.42.2(pid=30424): Launched 17:43:29.835207 run osmo-stp_10.42.42.5: Starting osmo-stp 17:43:30.367486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30426): Launched 17:43:30.667166 run osmo-stp_10.42.42.5(pid=30427): Launched 17:43:30.781395 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:43:31.372447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30429): Launched 17:43:31.503339 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:43:31.769744 run patchelf(pid=30430): Launched 17:43:31.951747 run osmo-stp_10.42.42.5(pid=30427): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30427)] 17:43:32.081714 run osmo-stp_10.42.42.5(pid=30427): stdout: | (launched: 2022-12-10_17:43:30.612319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:32.212616 run osmo-stp_10.42.42.5(pid=30427): stderr: | 20221210174330783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174330783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174330784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174330784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174330785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174330785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174330785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:32.341073 run osmo-stp_10.42.42.5(pid=30427): stdout: | (launched: 2022-12-10_17:43:30.612319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:32.463923 run osmo-stp_10.42.42.5(pid=30427): stderr: | 20221210174330783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174330783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174330784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174330784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174330785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174330785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174330785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:32.609401 run patchelf(pid=30430): Terminating (SIGINT) 17:43:32.776397 run patchelf(pid=30430): Terminated: ok {rc=0} 17:43:32.897108 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30427): Process ended prematurely: osmo-stp_10.42.42.5(pid=30427) [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30427)] [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:43:32.906681 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 17:43:32.933815 run osmo-hlr_10.42.42.2(pid=30424): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30424)] 17:43:32.981526 run osmo-hlr_10.42.42.2(pid=30424): stdout: | (launched: 2022-12-10_17:43:29.664498) 17:43:33.030830 run osmo-hlr_10.42.42.2(pid=30424): stderr: | 20221210174329840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174329840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174329840 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174329841 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174329841 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174329841 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174329851 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174329862 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174329862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174329862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:43:33.079974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30417): Terminating (SIGTERM) 17:43:33.119596 run iperf3-srv_10.42.42.10(pid=30418): Terminating (SIGTERM) 17:43:33.159012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30419): Terminating (SIGTERM) 17:43:33.198436 run iperf3-srv_10.42.42.10(pid=30420): Terminating (SIGTERM) 17:43:33.238166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30423): Terminating (SIGTERM) 17:43:33.277847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30426): Terminating (SIGTERM) 17:43:33.317436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30429): Terminating (SIGTERM) 17:43:33.357182 --- ParallelTerminationStrategy: PID 30417 died... 17:43:33.376213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30417): Terminated: ok {rc=0} 17:43:33.420056 --- ParallelTerminationStrategy: PID 30418 died... 17:43:33.438553 run iperf3-srv_10.42.42.10(pid=30418): Terminated {rc=256} 17:43:33.482112 --- ParallelTerminationStrategy: PID 30419 died... 17:43:33.500607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30419): Terminated: ok {rc=0} 17:43:33.543993 --- ParallelTerminationStrategy: PID 30420 died... 17:43:33.562480 run iperf3-srv_10.42.42.10(pid=30420): Terminated {rc=256} 17:43:33.605834 --- ParallelTerminationStrategy: PID 30423 died... 17:43:33.624466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30423): Terminated: ok {rc=0} 17:43:33.667794 --- ParallelTerminationStrategy: PID 30426 died... 17:43:33.686457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30426): Terminated: ok {rc=0} 17:43:33.729977 --- ParallelTerminationStrategy: PID 30429 died... 17:43:33.748399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30429): Terminated: ok {rc=0} 17:43:33.834056 bus /gobi_0: Setting Powered False 17:43:34.933630 bus /gobi_0: Setting Powered False 17:43:36.047875 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:43:37.192860 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:37.204544 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:43:37.277804 tst iperf3.py: using LAC 29567 17:43:37.396387 tst iperf3.py: using RAC 242 17:43:37.515267 tst iperf3.py: using CellId 29567 17:43:37.633383 tst iperf3.py: using BVCI 29568 17:43:37.741314 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:37.752390 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:37.763352 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:37.774322 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:37.785291 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:37.795968 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:37.806872 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:37.817538 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:37.828468 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:43:37.945312 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:43:38.162039 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:38.482322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30431): Launched 17:43:38.761384 run iperf3-srv_10.42.42.10(pid=30432): Launched 17:43:38.882909 tst iperf3.py:8: start network... 17:43:39.097437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:43:39.593242 run create_hlr_db(pid=30433): Launched 17:43:39.717476 bus /gobi_6: Setting Powered False 17:43:40.780562 run create_hlr_db(pid=30433): Terminated: ok {rc=0} 17:43:41.207001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30435): Launched 17:43:41.507338 run osmo-hlr_10.42.42.2(pid=30436): Launched 17:43:41.622148 run osmo-stp_10.42.42.5: Starting osmo-stp 17:43:42.150411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30438): Launched 17:43:42.449390 run osmo-stp_10.42.42.5(pid=30439): Launched 17:43:42.563655 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:43:43.079671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30441): Launched 17:43:43.195465 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:43:43.450140 run patchelf(pid=30442): Launched 17:43:43.617173 run osmo-stp_10.42.42.5(pid=30439): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30439)] 17:43:43.744121 run osmo-stp_10.42.42.5(pid=30439): stdout: | (launched: 2022-12-10_17:43:42.394428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:43.872850 run osmo-stp_10.42.42.5(pid=30439): stderr: | 20221210174342565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174342565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174342565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174342566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174342566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174342566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174342566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:44.002386 run osmo-stp_10.42.42.5(pid=30439): stdout: | (launched: 2022-12-10_17:43:42.394428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:44.125521 run osmo-stp_10.42.42.5(pid=30439): stderr: | 20221210174342565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174342565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174342565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174342566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174342566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174342566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174342566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:44.272315 run patchelf(pid=30442): Terminating (SIGINT) 17:43:44.441177 run patchelf(pid=30442): Terminated: ok {rc=0} 17:43:44.562456 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30439): Process ended prematurely: osmo-stp_10.42.42.5(pid=30439) [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30439)] [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 17:43:44.571853 tst iperf3.py:8: Test FAILED (7.4 sec) 17:43:44.598901 run osmo-hlr_10.42.42.2(pid=30436): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30436)] 17:43:44.646170 run osmo-hlr_10.42.42.2(pid=30436): stdout: | (launched: 2022-12-10_17:43:41.452416) 17:43:44.695230 run osmo-hlr_10.42.42.2(pid=30436): stderr: | 20221210174341629 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174341629 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174341629 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174341629 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174341629 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174341629 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174341641 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174341650 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174341650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174341650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:43:44.745401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30431): Terminating (SIGTERM) 17:43:44.784721 run iperf3-srv_10.42.42.10(pid=30432): Terminating (SIGTERM) 17:43:44.823934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30435): Terminating (SIGTERM) 17:43:44.863245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30438): Terminating (SIGTERM) 17:43:44.902491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30441): Terminating (SIGTERM) 17:43:44.941837 --- ParallelTerminationStrategy: PID 30431 died... 17:43:44.960616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30431): Terminated: ok {rc=0} 17:43:45.004550 --- ParallelTerminationStrategy: PID 30432 died... 17:43:45.023049 run iperf3-srv_10.42.42.10(pid=30432): Terminated {rc=256} 17:43:45.066357 --- ParallelTerminationStrategy: PID 30435 died... 17:43:45.084834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30435): Terminated: ok {rc=0} 17:43:45.128245 --- ParallelTerminationStrategy: PID 30438 died... 17:43:45.146847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30438): Terminated: ok {rc=0} 17:43:45.190109 --- ParallelTerminationStrategy: PID 30441 died... 17:43:45.208480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30441): Terminated: ok {rc=0} 17:43:45.295156 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:43:46.460885 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:46.474401 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:43:46.549752 tst iperf3m4.py: using LAC 29568 17:43:46.679286 tst iperf3m4.py: using RAC 243 17:43:46.799303 tst iperf3m4.py: using CellId 29568 17:43:46.928520 tst iperf3m4.py: using BVCI 29569 17:43:47.048160 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:47.060845 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:47.074669 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:47.087473 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:47.100473 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:47.113656 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:47.126853 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:47.139595 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:47.154279 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:43:47.278846 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:43:47.399621 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:43:47.518218 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:43:47.634077 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:43:47.834863 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:48.135282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30443): Launched 17:43:48.396892 run iperf3-srv_10.42.42.10(pid=30444): Launched 17:43:48.510269 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:43:48.710451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:49.010911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30445): Launched 17:43:49.272197 run iperf3-srv_10.42.42.10(pid=30446): Launched 17:43:49.386172 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:43:49.586422 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:49.887101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30447): Launched 17:43:50.147864 run iperf3-srv_10.42.42.10(pid=30448): Launched 17:43:50.260581 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:43:50.461101 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:50.761710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30449): Launched 17:43:51.022670 run iperf3-srv_10.42.42.10(pid=30450): Launched 17:43:51.135198 tst iperf3m4.py:8: start network... 17:43:51.335204 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:43:51.799726 run create_hlr_db(pid=30451): Launched 17:43:51.922475 bus /gobi_6: Setting Powered False 17:43:52.983076 run create_hlr_db(pid=30451): Terminated: ok {rc=0} 17:43:53.400517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30453): Launched 17:43:53.699430 run osmo-hlr_10.42.42.2(pid=30454): Launched 17:43:53.812541 run osmo-stp_10.42.42.5: Starting osmo-stp 17:43:54.331035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30456): Launched 17:43:54.629789 run osmo-stp_10.42.42.5(pid=30457): Launched 17:43:54.742347 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:43:55.257188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30459): Launched 17:43:55.371434 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:43:55.624461 run patchelf(pid=30460): Launched 17:43:55.791432 run osmo-stp_10.42.42.5(pid=30457): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30457)] 17:43:55.917623 run osmo-stp_10.42.42.5(pid=30457): stdout: | (launched: 2022-12-10_17:43:54.574921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:56.045631 run osmo-stp_10.42.42.5(pid=30457): stderr: | 20221210174354744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174354744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174354745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174354745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174354746 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174354746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174354746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:56.173588 run osmo-stp_10.42.42.5(pid=30457): stdout: | (launched: 2022-12-10_17:43:54.574921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:56.295875 run osmo-stp_10.42.42.5(pid=30457): stderr: | 20221210174354744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174354744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174354745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174354745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174354746 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174354746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174354746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:56.440686 run patchelf(pid=30460): Terminating (SIGINT) 17:43:56.607448 run patchelf(pid=30460): Terminated: ok {rc=0} 17:43:56.727343 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30457): Process ended prematurely: osmo-stp_10.42.42.5(pid=30457) [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30457)] [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:43:56.736707 tst iperf3m4.py:8: Test FAILED (10.3 sec) 17:43:56.763897 run osmo-hlr_10.42.42.2(pid=30454): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30454)] 17:43:56.810709 run osmo-hlr_10.42.42.2(pid=30454): stdout: | (launched: 2022-12-10_17:43:53.644560) 17:43:56.859375 run osmo-hlr_10.42.42.2(pid=30454): stderr: | 20221210174353820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174353820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174353820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174353820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174353820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174353820 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174353832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174353841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174353841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174353841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:43:56.908708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30443): Terminating (SIGTERM) 17:43:56.947868 run iperf3-srv_10.42.42.10(pid=30444): Terminating (SIGTERM) 17:43:56.987052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30445): Terminating (SIGTERM) 17:43:57.026241 run iperf3-srv_10.42.42.10(pid=30446): Terminating (SIGTERM) 17:43:57.065197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30447): Terminating (SIGTERM) 17:43:57.104278 run iperf3-srv_10.42.42.10(pid=30448): Terminating (SIGTERM) 17:43:57.143142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30449): Terminating (SIGTERM) 17:43:57.182024 run iperf3-srv_10.42.42.10(pid=30450): Terminating (SIGTERM) 17:43:57.220824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30453): Terminating (SIGTERM) 17:43:57.259856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30456): Terminating (SIGTERM) 17:43:57.298842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30459): Terminating (SIGTERM) 17:43:57.338006 --- ParallelTerminationStrategy: PID 30443 died... 17:43:57.356653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30443): Terminated: ok {rc=0} 17:43:57.400054 --- ParallelTerminationStrategy: PID 30444 died... 17:43:57.418633 run iperf3-srv_10.42.42.10(pid=30444): Terminated {rc=256} 17:43:57.462065 --- ParallelTerminationStrategy: PID 30445 died... 17:43:57.480254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30445): Terminated: ok {rc=0} 17:43:57.523763 --- ParallelTerminationStrategy: PID 30446 died... 17:43:57.541927 run iperf3-srv_10.42.42.10(pid=30446): Terminated {rc=256} 17:43:57.584733 --- ParallelTerminationStrategy: PID 30447 died... 17:43:57.602974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30447): Terminated: ok {rc=0} 17:43:57.645756 --- ParallelTerminationStrategy: PID 30448 died... 17:43:57.663881 run iperf3-srv_10.42.42.10(pid=30448): Terminated {rc=256} 17:43:57.707027 --- ParallelTerminationStrategy: PID 30449 died... 17:43:57.725343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30449): Terminated: ok {rc=0} 17:43:57.768113 --- ParallelTerminationStrategy: PID 30450 died... 17:43:57.786337 run iperf3-srv_10.42.42.10(pid=30450): Terminated {rc=256} 17:43:57.829095 --- ParallelTerminationStrategy: PID 30453 died... 17:43:57.847293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30453): Terminated: ok {rc=0} 17:43:57.890462 --- ParallelTerminationStrategy: PID 30456 died... 17:43:57.908753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30456): Terminated: ok {rc=0} 17:43:57.951766 --- ParallelTerminationStrategy: PID 30459 died... 17:43:57.970099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30459): Terminated: ok {rc=0} 17:43:58.051986 bus /gobi_4: Setting Powered False 17:43:59.146629 bus /gobi_4: Setting Powered False 17:44:00.261199 bus /gobi_1: Setting Powered False 17:44:01.361927 bus /gobi_1: Setting Powered False 17:44:02.480599 bus /gobi_0: Setting Powered False 17:44:03.578244 bus /gobi_0: Setting Powered False 17:44:04.695323 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:44:05.798258 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:05.810706 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:44:05.886431 tst ping.py: using LAC 29569 17:44:06.009930 tst ping.py: using RAC 244 17:44:06.133374 tst ping.py: using CellId 29569 17:44:06.259081 tst ping.py: using BVCI 29570 17:44:06.374792 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:06.386422 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:06.397927 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:06.410165 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:06.422616 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:06.434828 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:06.446963 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:06.459093 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:44:06.574927 tst ping.py:19: start network... 17:44:06.769784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:07.220865 run create_hlr_db(pid=30461): Launched 17:44:07.340490 bus /gobi_6: Setting Powered False 17:44:08.399498 run create_hlr_db(pid=30461): Terminated: ok {rc=0} 17:44:08.808021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30463): Launched 17:44:09.099888 run osmo-hlr_10.42.42.2(pid=30464): Launched 17:44:09.210977 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:09.717974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30466): Launched 17:44:10.011583 run osmo-stp_10.42.42.5(pid=30467): Launched 17:44:10.122836 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:44:10.627447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30469): Launched 17:44:10.740021 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:44:10.988011 run patchelf(pid=30470): Launched 17:44:11.151891 run osmo-stp_10.42.42.5(pid=30467): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30467)] 17:44:11.276550 run osmo-stp_10.42.42.5(pid=30467): stdout: | (launched: 2022-12-10_17:44:09.957895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:11.402977 run osmo-stp_10.42.42.5(pid=30467): stderr: | 20221210174410127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174410128 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174410128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174410128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174410129 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174410129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174410129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:11.529538 run osmo-stp_10.42.42.5(pid=30467): stdout: | (launched: 2022-12-10_17:44:09.957895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:11.650938 run osmo-stp_10.42.42.5(pid=30467): stderr: | 20221210174410127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174410128 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174410128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174410128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174410129 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174410129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174410129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:11.793822 run patchelf(pid=30470): Terminating (SIGINT) 17:44:11.958610 run patchelf(pid=30470): Terminated: ok {rc=0} 17:44:12.077397 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30467): Process ended prematurely: osmo-stp_10.42.42.5(pid=30467) [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30467)] [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 17:44:12.086176 tst ping.py:22: Test FAILED (6.3 sec) 17:44:12.112832 run osmo-hlr_10.42.42.2(pid=30464): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30464)] 17:44:12.160771 run osmo-hlr_10.42.42.2(pid=30464): stdout: | (launched: 2022-12-10_17:44:09.046172) 17:44:12.210178 run osmo-hlr_10.42.42.2(pid=30464): stderr: | 20221210174409220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174409220 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174409220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174409220 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174409220 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174409220 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174409233 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174409241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174409241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174409241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:12.259780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30463): Terminating (SIGTERM) 17:44:12.299875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30466): Terminating (SIGTERM) 17:44:12.339927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30469): Terminating (SIGTERM) 17:44:12.380019 --- ParallelTerminationStrategy: PID 30463 died... 17:44:12.399323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30463): Terminated: ok {rc=0} 17:44:12.443678 --- ParallelTerminationStrategy: PID 30466 died... 17:44:12.462544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30466): Terminated: ok {rc=0} 17:44:12.506775 --- ParallelTerminationStrategy: PID 30469 died... 17:44:12.525636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30469): Terminated: ok {rc=0} 17:44:12.609770 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:44:13.694235 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:13.706301 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:44:13.783874 tst ping_idle_ping.py: using LAC 29570 17:44:13.909213 tst ping_idle_ping.py: using RAC 245 17:44:14.028066 tst ping_idle_ping.py: using CellId 29570 17:44:14.145334 tst ping_idle_ping.py: using BVCI 29571 17:44:14.251887 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:14.263184 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:14.274497 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:14.285756 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:14.296722 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:14.307842 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:14.319103 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:14.330138 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:44:14.443422 tst ping_idle_ping.py:24: start network... 17:44:14.640768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:15.103407 run create_hlr_db(pid=30471): Launched 17:44:15.224021 bus /gobi_6: Setting Powered False 17:44:16.299598 run create_hlr_db(pid=30471): Terminated: ok {rc=0} 17:44:16.794320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30473): Launched 17:44:17.205775 run osmo-hlr_10.42.42.2(pid=30474): Launched 17:44:17.326546 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:17.838187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30476): Launched 17:44:18.131016 run osmo-stp_10.42.42.5(pid=30477): Launched 17:44:18.242834 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:44:18.748542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30479): Launched 17:44:18.861634 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:44:19.109055 run patchelf(pid=30480): Launched 17:44:19.273453 run osmo-stp_10.42.42.5(pid=30477): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30477)] 17:44:19.398239 run osmo-stp_10.42.42.5(pid=30477): stdout: | (launched: 2022-12-10_17:44:18.077108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:19.524566 run osmo-stp_10.42.42.5(pid=30477): stderr: | 20221210174418245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174418245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174418245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174418246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174418246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174418246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174418246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:19.651401 run osmo-stp_10.42.42.5(pid=30477): stdout: | (launched: 2022-12-10_17:44:18.077108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:19.771935 run osmo-stp_10.42.42.5(pid=30477): stderr: | 20221210174418245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174418245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174418245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174418246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174418246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174418246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174418246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:19.914681 run patchelf(pid=30480): Terminating (SIGINT) 17:44:20.079306 run patchelf(pid=30480): Terminated: ok {rc=0} 17:44:20.198097 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30477): Process ended prematurely: osmo-stp_10.42.42.5(pid=30477) [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30477)] [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:44:20.206971 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:44:20.233518 run osmo-hlr_10.42.42.2(pid=30474): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30474)] 17:44:20.280544 run osmo-hlr_10.42.42.2(pid=30474): stdout: | (launched: 2022-12-10_17:44:17.128880) 17:44:20.329453 run osmo-hlr_10.42.42.2(pid=30474): stderr: | 20221210174417406 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174417406 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174417406 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174417406 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174417406 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174417406 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174417420 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174417430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174417431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174417431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:20.378810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30473): Terminating (SIGTERM) 17:44:20.418183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30476): Terminating (SIGTERM) 17:44:20.457888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30479): Terminating (SIGTERM) 17:44:20.497685 --- ParallelTerminationStrategy: PID 30473 died... 17:44:20.516193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30473): Terminated: ok {rc=0} 17:44:20.559897 --- ParallelTerminationStrategy: PID 30476 died... 17:44:20.578290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30476): Terminated: ok {rc=0} 17:44:20.621674 --- ParallelTerminationStrategy: PID 30479 died... 17:44:20.639994 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30479): Terminated: ok {rc=0} 17:44:20.724866 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:44:22.030140 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:44:22.036567 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:44:22.070854 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:44:22.109045 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:44:22.195344 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:44:22.228609 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:44:22.266346 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:44:22.866731 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:44:22.915290 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:22.926457 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:44:23.009060 tst cs_paging_gprs_active.py: using LAC 29571 17:44:23.128627 tst cs_paging_gprs_active.py: using RAC 246 17:44:23.248616 tst cs_paging_gprs_active.py: using CellId 29571 17:44:23.368698 tst cs_paging_gprs_active.py: using BVCI 29572 17:44:23.479465 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:23.490515 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:23.501367 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:23.512309 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:23.523348 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:23.534226 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:23.545234 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:23.556063 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:23.567313 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:44:23.684358 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:44:23.800562 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:44:24.002302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:24.303757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30485): Launched 17:44:24.565684 run iperf3-srv_10.42.42.10(pid=30486): Launched 17:44:24.679119 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:44:24.879080 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:25.181485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30487): Launched 17:44:25.442946 run iperf3-srv_10.42.42.10(pid=30488): Launched 17:44:25.556214 tst cs_paging_gprs_active.py:38: start network... 17:44:25.756938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:26.222127 run create_hlr_db(pid=30489): Launched 17:44:26.345932 bus /gobi_6: Setting Powered False 17:44:27.407022 run create_hlr_db(pid=30489): Terminated: ok {rc=0} 17:44:27.844697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30491): Launched 17:44:28.165750 run osmo-hlr_10.42.42.2(pid=30492): Launched 17:44:28.290992 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:28.846046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30494): Launched 17:44:29.167735 run osmo-stp_10.42.42.5(pid=30495): Launched 17:44:29.291210 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:44:29.844579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30497): Launched 17:44:29.967749 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:44:30.238474 run patchelf(pid=30498): Launched 17:44:30.418496 run osmo-stp_10.42.42.5(pid=30495): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30495)] 17:44:30.554769 run osmo-stp_10.42.42.5(pid=30495): stdout: | (launched: 2022-12-10_17:44:29.109458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:30.691650 run osmo-stp_10.42.42.5(pid=30495): stderr: | 20221210174429299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174429300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174429300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174429300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174429301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174429301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174429301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:30.833447 run osmo-stp_10.42.42.5(pid=30495): stdout: | (launched: 2022-12-10_17:44:29.109458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:30.993249 run osmo-stp_10.42.42.5(pid=30495): stderr: | 20221210174429299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174429300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174429300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174429300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174429301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174429301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174429301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:31.162571 run patchelf(pid=30498): Terminating (SIGINT) 17:44:31.336193 run patchelf(pid=30498): Terminated: ok {rc=0} 17:44:31.460304 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30495): Process ended prematurely: osmo-stp_10.42.42.5(pid=30495) [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30495)] [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:44:31.470739 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 17:44:31.499755 run osmo-hlr_10.42.42.2(pid=30492): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30492)] 17:44:31.550695 run osmo-hlr_10.42.42.2(pid=30492): stdout: | (launched: 2022-12-10_17:44:28.107352) 17:44:31.602098 run osmo-hlr_10.42.42.2(pid=30492): stderr: | 20221210174428304 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174428305 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174428305 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174428305 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174428305 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174428305 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174428317 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174428325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174428325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174428325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:31.653291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30485): Terminating (SIGTERM) 17:44:31.696084 run iperf3-srv_10.42.42.10(pid=30486): Terminating (SIGTERM) 17:44:31.740417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30487): Terminating (SIGTERM) 17:44:31.781932 run iperf3-srv_10.42.42.10(pid=30488): Terminating (SIGTERM) 17:44:31.822476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30491): Terminating (SIGTERM) 17:44:31.863883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30494): Terminating (SIGTERM) 17:44:31.907710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30497): Terminating (SIGTERM) 17:44:31.952215 --- ParallelTerminationStrategy: PID 30485 died... 17:44:31.972336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30485): Terminated: ok {rc=0} 17:44:32.019327 --- ParallelTerminationStrategy: PID 30486 died... 17:44:32.039150 run iperf3-srv_10.42.42.10(pid=30486): Terminated {rc=256} 17:44:32.084794 --- ParallelTerminationStrategy: PID 30487 died... 17:44:32.104104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30487): Terminated: ok {rc=0} 17:44:32.150648 --- ParallelTerminationStrategy: PID 30488 died... 17:44:32.169749 run iperf3-srv_10.42.42.10(pid=30488): Terminated {rc=256} 17:44:32.214483 --- ParallelTerminationStrategy: PID 30491 died... 17:44:32.233950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30491): Terminated: ok {rc=0} 17:44:32.278793 --- ParallelTerminationStrategy: PID 30494 died... 17:44:32.297609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30494): Terminated: ok {rc=0} 17:44:32.341741 --- ParallelTerminationStrategy: PID 30497 died... 17:44:32.360414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30497): Terminated: ok {rc=0} 17:44:32.446648 bus /gobi_0: Setting Powered False 17:44:33.547691 bus /gobi_0: Setting Powered False 17:44:34.663643 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:44:35.813652 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:35.825810 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:44:35.902696 tst iperf3.py: using LAC 29572 17:44:36.031299 tst iperf3.py: using RAC 247 17:44:36.159592 tst iperf3.py: using CellId 29572 17:44:36.284663 tst iperf3.py: using BVCI 29573 17:44:36.400894 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:36.412350 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:36.423635 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:36.435469 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:36.447034 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:36.458479 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:36.470002 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:36.481433 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:36.492899 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:44:36.610033 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:44:36.811310 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:37.113034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30499): Launched 17:44:37.376021 run iperf3-srv_10.42.42.10(pid=30500): Launched 17:44:37.489955 tst iperf3.py:8: start network... 17:44:37.691001 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:38.156839 run create_hlr_db(pid=30501): Launched 17:44:38.280501 bus /gobi_6: Setting Powered False 17:44:39.341180 run create_hlr_db(pid=30501): Terminated: ok {rc=0} 17:44:39.759527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30503): Launched 17:44:40.060592 run osmo-hlr_10.42.42.2(pid=30504): Launched 17:44:40.175717 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:40.708607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30506): Launched 17:44:41.008925 run osmo-stp_10.42.42.5(pid=30507): Launched 17:44:41.123116 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:44:41.638964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30509): Launched 17:44:41.754002 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:44:42.008036 run patchelf(pid=30510): Launched 17:44:42.175160 run osmo-stp_10.42.42.5(pid=30507): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30507)] 17:44:42.301680 run osmo-stp_10.42.42.5(pid=30507): stdout: | (launched: 2022-12-10_17:44:40.953954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:42.429765 run osmo-stp_10.42.42.5(pid=30507): stderr: | 20221210174441124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174441124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174441124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174441125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174441125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174441125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174441125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:42.558187 run osmo-stp_10.42.42.5(pid=30507): stdout: | (launched: 2022-12-10_17:44:40.953954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:42.680754 run osmo-stp_10.42.42.5(pid=30507): stderr: | 20221210174441124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174441124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174441124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174441125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174441125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174441125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174441125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:42.825797 run patchelf(pid=30510): Terminating (SIGINT) 17:44:42.993709 run patchelf(pid=30510): Terminated: ok {rc=0} 17:44:43.114669 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30507): Process ended prematurely: osmo-stp_10.42.42.5(pid=30507) [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30507)] [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 17:44:43.123927 tst iperf3.py:8: Test FAILED (7.3 sec) 17:44:43.150992 run osmo-hlr_10.42.42.2(pid=30504): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30504)] 17:44:43.198073 run osmo-hlr_10.42.42.2(pid=30504): stdout: | (launched: 2022-12-10_17:44:40.005174) 17:44:43.246854 run osmo-hlr_10.42.42.2(pid=30504): stderr: | 20221210174440182 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174440182 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174440182 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174440182 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174440182 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174440182 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174440194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174440203 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174440203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174440203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:43.296114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30499): Terminating (SIGTERM) 17:44:43.335747 run iperf3-srv_10.42.42.10(pid=30500): Terminating (SIGTERM) 17:44:43.375935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30503): Terminating (SIGTERM) 17:44:43.415711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30506): Terminating (SIGTERM) 17:44:43.455316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30509): Terminating (SIGTERM) 17:44:43.495296 --- ParallelTerminationStrategy: PID 30499 died... 17:44:43.514029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30499): Terminated: ok {rc=0} 17:44:43.557756 --- ParallelTerminationStrategy: PID 30500 died... 17:44:43.576185 run iperf3-srv_10.42.42.10(pid=30500): Terminated {rc=256} 17:44:43.619806 --- ParallelTerminationStrategy: PID 30503 died... 17:44:43.638434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30503): Terminated: ok {rc=0} 17:44:43.682187 --- ParallelTerminationStrategy: PID 30506 died... 17:44:43.700845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30506): Terminated: ok {rc=0} 17:44:43.744526 --- ParallelTerminationStrategy: PID 30509 died... 17:44:43.763171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30509): Terminated: ok {rc=0} 17:44:43.847449 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:44:44.988638 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:45.000165 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:44:45.072356 tst iperf3m4.py: using LAC 29573 17:44:45.198783 tst iperf3m4.py: using RAC 248 17:44:45.323683 tst iperf3m4.py: using CellId 29573 17:44:45.453029 tst iperf3m4.py: using BVCI 29574 17:44:45.571348 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:45.583004 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:45.594471 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:45.606436 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:45.618339 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:45.630000 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:45.641888 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:45.653542 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:45.665648 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:44:45.788300 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:44:45.940089 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:44:46.074718 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:44:46.194930 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:44:46.401694 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:46.729747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30511): Launched 17:44:47.006212 run iperf3-srv_10.42.42.10(pid=30512): Launched 17:44:47.138629 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:44:47.347986 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:47.670132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30513): Launched 17:44:47.950010 run iperf3-srv_10.42.42.10(pid=30514): Launched 17:44:48.072135 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:44:48.287727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:48.609237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30515): Launched 17:44:48.890021 run iperf3-srv_10.42.42.10(pid=30516): Launched 17:44:49.011959 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:44:49.226936 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:49.548108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30517): Launched 17:44:49.826517 run iperf3-srv_10.42.42.10(pid=30518): Launched 17:44:49.949029 tst iperf3m4.py:8: start network... 17:44:50.163587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:50.660571 run create_hlr_db(pid=30520): Launched 17:44:50.784740 bus /gobi_6: Setting Powered False 17:44:51.848141 run create_hlr_db(pid=30520): Terminated: ok {rc=0} 17:44:52.275728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30522): Launched 17:44:52.576380 run osmo-hlr_10.42.42.2(pid=30523): Launched 17:44:52.691790 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:53.219866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30525): Launched 17:44:53.519835 run osmo-stp_10.42.42.5(pid=30526): Launched 17:44:53.634559 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:44:54.149507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30528): Launched 17:44:54.263224 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:44:54.514913 run patchelf(pid=30529): Launched 17:44:54.681383 run osmo-stp_10.42.42.5(pid=30526): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30526)] 17:44:54.807505 run osmo-stp_10.42.42.5(pid=30526): stdout: | (launched: 2022-12-10_17:44:53.463783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:54.935367 run osmo-stp_10.42.42.5(pid=30526): stderr: | 20221210174453629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174453629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174453630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174453630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174453630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174453630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174453631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:55.062867 run osmo-stp_10.42.42.5(pid=30526): stdout: | (launched: 2022-12-10_17:44:53.463783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:55.184755 run osmo-stp_10.42.42.5(pid=30526): stderr: | 20221210174453629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174453629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174453630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174453630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174453630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174453630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174453631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:55.329946 run patchelf(pid=30529): Terminating (SIGINT) 17:44:55.497425 run patchelf(pid=30529): Terminated: ok {rc=0} 17:44:55.617271 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30526): Process ended prematurely: osmo-stp_10.42.42.5(pid=30526) [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30526)] [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:44:55.626766 tst iperf3m4.py:8: Test FAILED (10.7 sec) 17:44:55.654033 run osmo-hlr_10.42.42.2(pid=30523): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30523)] 17:44:55.701163 run osmo-hlr_10.42.42.2(pid=30523): stdout: | (launched: 2022-12-10_17:44:52.521143) 17:44:55.750031 run osmo-hlr_10.42.42.2(pid=30523): stderr: | 20221210174452694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174452694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174452694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174452694 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174452694 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174452694 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174452706 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174452716 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174452716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174452716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:55.799085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30511): Terminating (SIGTERM) 17:44:55.838532 run iperf3-srv_10.42.42.10(pid=30512): Terminating (SIGTERM) 17:44:55.878041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30513): Terminating (SIGTERM) 17:44:55.918057 run iperf3-srv_10.42.42.10(pid=30514): Terminating (SIGTERM) 17:44:55.957300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30515): Terminating (SIGTERM) 17:44:55.997091 run iperf3-srv_10.42.42.10(pid=30516): Terminating (SIGTERM) 17:44:56.036115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30517): Terminating (SIGTERM) 17:44:56.075232 run iperf3-srv_10.42.42.10(pid=30518): Terminating (SIGTERM) 17:44:56.114371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30522): Terminating (SIGTERM) 17:44:56.153610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30525): Terminating (SIGTERM) 17:44:56.192758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30528): Terminating (SIGTERM) 17:44:56.232201 --- ParallelTerminationStrategy: PID 30511 died... 17:44:56.251091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30511): Terminated: ok {rc=0} 17:44:56.294796 --- ParallelTerminationStrategy: PID 30512 died... 17:44:56.313179 run iperf3-srv_10.42.42.10(pid=30512): Terminated {rc=256} 17:44:56.356406 --- ParallelTerminationStrategy: PID 30513 died... 17:44:56.374884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30513): Terminated: ok {rc=0} 17:44:56.418415 --- ParallelTerminationStrategy: PID 30514 died... 17:44:56.437031 run iperf3-srv_10.42.42.10(pid=30514): Terminated {rc=256} 17:44:56.481122 --- ParallelTerminationStrategy: PID 30515 died... 17:44:56.499545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30515): Terminated: ok {rc=0} 17:44:56.543303 --- ParallelTerminationStrategy: PID 30516 died... 17:44:56.561776 run iperf3-srv_10.42.42.10(pid=30516): Terminated {rc=256} 17:44:56.605834 --- ParallelTerminationStrategy: PID 30517 died... 17:44:56.624331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30517): Terminated: ok {rc=0} 17:44:56.668106 --- ParallelTerminationStrategy: PID 30518 died... 17:44:56.686649 run iperf3-srv_10.42.42.10(pid=30518): Terminated {rc=256} 17:44:56.729925 --- ParallelTerminationStrategy: PID 30522 died... 17:44:56.748460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30522): Terminated: ok {rc=0} 17:44:56.791785 --- ParallelTerminationStrategy: PID 30525 died... 17:44:56.810336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30525): Terminated: ok {rc=0} 17:44:56.853752 --- ParallelTerminationStrategy: PID 30528 died... 17:44:56.872350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30528): Terminated: ok {rc=0} 17:44:56.958863 bus /gobi_4: Setting Powered False 17:44:58.058856 bus /gobi_4: Setting Powered False 17:44:59.173959 bus /gobi_1: Setting Powered False 17:45:00.272986 bus /gobi_1: Setting Powered False 17:45:01.395542 bus /gobi_0: Setting Powered False 17:45:02.493532 bus /gobi_0: Setting Powered False 17:45:03.609065 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:45:04.709330 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:04.720871 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:45:04.791868 tst ping.py: using LAC 29574 17:45:04.906470 tst ping.py: using RAC 249 17:45:05.026239 tst ping.py: using CellId 29574 17:45:05.140807 tst ping.py: using BVCI 29575 17:45:05.246879 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:05.258025 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:05.268779 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:05.279685 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:05.290424 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:05.301311 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:05.312118 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:05.322950 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:45:05.436856 tst ping.py:19: start network... 17:45:05.632707 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:06.086057 run create_hlr_db(pid=30533): Launched 17:45:06.208877 bus /gobi_6: Setting Powered False 17:45:07.268028 run create_hlr_db(pid=30533): Terminated: ok {rc=0} 17:45:07.678009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30535): Launched 17:45:07.970563 run osmo-hlr_10.42.42.2(pid=30536): Launched 17:45:08.081898 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:08.591160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30538): Launched 17:45:08.882638 run osmo-stp_10.42.42.5(pid=30539): Launched 17:45:08.995273 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:45:09.501707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30541): Launched 17:45:09.613396 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:45:09.859749 run patchelf(pid=30542): Launched 17:45:10.023282 run osmo-stp_10.42.42.5(pid=30539): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30539)] 17:45:10.147602 run osmo-stp_10.42.42.5(pid=30539): stdout: | (launched: 2022-12-10_17:45:08.828681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:10.273135 run osmo-stp_10.42.42.5(pid=30539): stderr: | 20221210174508998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174508998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174508998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174508998 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174508999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174508999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174508999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:10.398573 run osmo-stp_10.42.42.5(pid=30539): stdout: | (launched: 2022-12-10_17:45:08.828681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:10.518358 run osmo-stp_10.42.42.5(pid=30539): stderr: | 20221210174508998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174508998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174508998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174508998 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174508999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174508999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174508999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:10.660128 run patchelf(pid=30542): Terminating (SIGINT) 17:45:10.823218 run patchelf(pid=30542): Terminated: ok {rc=0} 17:45:10.941270 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30539): Process ended prematurely: osmo-stp_10.42.42.5(pid=30539) [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30539)] [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 17:45:10.949982 tst ping.py:22: Test FAILED (6.2 sec) 17:45:10.976437 run osmo-hlr_10.42.42.2(pid=30536): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30536)] 17:45:11.023333 run osmo-hlr_10.42.42.2(pid=30536): stdout: | (launched: 2022-12-10_17:45:07.916771) 17:45:11.071825 run osmo-hlr_10.42.42.2(pid=30536): stderr: | 20221210174508091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174508092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174508092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174508092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174508092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174508092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174508104 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174508112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174508112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174508112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:11.120858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30535): Terminating (SIGTERM) 17:45:11.160046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30538): Terminating (SIGTERM) 17:45:11.199083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30541): Terminating (SIGTERM) 17:45:11.238611 --- ParallelTerminationStrategy: PID 30535 died... 17:45:11.257540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30535): Terminated: ok {rc=0} 17:45:11.301592 --- ParallelTerminationStrategy: PID 30538 died... 17:45:11.319973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30538): Terminated: ok {rc=0} 17:45:11.363180 --- ParallelTerminationStrategy: PID 30541 died... 17:45:11.381561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30541): Terminated: ok {rc=0} 17:45:11.466064 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:45:12.551874 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:12.564261 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:45:12.640650 tst ping_idle_ping.py: using LAC 29575 17:45:12.765464 tst ping_idle_ping.py: using RAC 250 17:45:12.881430 tst ping_idle_ping.py: using CellId 29575 17:45:12.996691 tst ping_idle_ping.py: using BVCI 29576 17:45:13.102297 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:13.113452 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:13.124486 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:13.135309 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:13.146274 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:13.157110 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:13.167952 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:13.178761 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:45:13.295157 tst ping_idle_ping.py:24: start network... 17:45:13.508475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:13.997861 run create_hlr_db(pid=30543): Launched 17:45:14.120625 bus /gobi_6: Setting Powered False 17:45:15.183543 run create_hlr_db(pid=30543): Terminated: ok {rc=0} 17:45:15.605714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30545): Launched 17:45:15.931666 run osmo-hlr_10.42.42.2(pid=30546): Launched 17:45:16.115737 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:16.948711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30548): Launched 17:45:17.281826 run osmo-stp_10.42.42.5(pid=30549): Launched 17:45:17.419130 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:45:17.929432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30551): Launched 17:45:18.042924 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:45:18.293017 run patchelf(pid=30552): Launched 17:45:18.458098 run osmo-stp_10.42.42.5(pid=30549): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30549)] 17:45:18.583904 run osmo-stp_10.42.42.5(pid=30549): stdout: | (launched: 2022-12-10_17:45:17.221974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:18.711103 run osmo-stp_10.42.42.5(pid=30549): stderr: | 20221210174517411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174517411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174517411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174517412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174517412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174517412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174517412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:18.838350 run osmo-stp_10.42.42.5(pid=30549): stdout: | (launched: 2022-12-10_17:45:17.221974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:18.959628 run osmo-stp_10.42.42.5(pid=30549): stderr: | 20221210174517411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174517411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174517411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174517412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174517412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174517412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174517412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:19.103061 run patchelf(pid=30552): Terminating (SIGINT) 17:45:19.268832 run patchelf(pid=30552): Terminated: ok {rc=0} 17:45:19.388414 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30549): Process ended prematurely: osmo-stp_10.42.42.5(pid=30549) [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30549)] [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:45:19.397400 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 17:45:19.424366 run osmo-hlr_10.42.42.2(pid=30546): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30546)] 17:45:19.471720 run osmo-hlr_10.42.42.2(pid=30546): stdout: | (launched: 2022-12-10_17:45:15.847160) 17:45:19.520390 run osmo-hlr_10.42.42.2(pid=30546): stderr: | 20221210174516153 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174516153 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174516153 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174516153 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174516153 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174516154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174516168 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174516191 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174516191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174516191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:19.569676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30545): Terminating (SIGTERM) 17:45:19.609336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30548): Terminating (SIGTERM) 17:45:19.648973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30551): Terminating (SIGTERM) 17:45:19.688755 --- ParallelTerminationStrategy: PID 30545 died... 17:45:19.707666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30545): Terminated: ok {rc=0} 17:45:19.751883 --- ParallelTerminationStrategy: PID 30548 died... 17:45:19.770544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30548): Terminated: ok {rc=0} 17:45:19.814066 --- ParallelTerminationStrategy: PID 30551 died... 17:45:19.832601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30551): Terminated: ok {rc=0} 17:45:19.915894 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:45:21.219280 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:45:21.225864 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:45:21.259700 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:45:21.294056 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:45:21.347077 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:45:21.380833 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:45:21.415040 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:45:21.974937 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2377 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:45:21.980276 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:21.991862 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:45:22.061068 tst switch_tch_pdch.py: using LAC 29576 17:45:22.175025 tst switch_tch_pdch.py: using RAC 251 17:45:22.288317 tst switch_tch_pdch.py: using CellId 29576 17:45:22.401423 tst switch_tch_pdch.py: using BVCI 29577 17:45:22.509892 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:22.521366 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:22.532548 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:22.543996 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:22.555480 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:22.566768 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:22.578241 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:22.589673 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:45:22.708514 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:45:22.826238 tst switch_tch_pdch.py:51: start network... 17:45:23.022949 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:23.476323 run create_hlr_db(pid=30556): Launched 17:45:23.597051 bus /gobi_6: Setting Powered False 17:45:24.655815 run create_hlr_db(pid=30556): Terminated: ok {rc=0} 17:45:25.085937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30558): Launched 17:45:25.401299 run osmo-hlr_10.42.42.2(pid=30559): Launched 17:45:25.524926 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:26.065078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30561): Launched 17:45:26.378619 run osmo-stp_10.42.42.5(pid=30562): Launched 17:45:26.499116 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:45:27.044497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30564): Launched 17:45:27.164682 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:45:27.429418 run patchelf(pid=30565): Launched 17:45:27.605672 run osmo-stp_10.42.42.5(pid=30562): ERR: Terminated: ERROR {rc=1} [trial-2377↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30562)] 17:45:27.738517 run osmo-stp_10.42.42.5(pid=30562): stdout: | (launched: 2022-12-10_17:45:26.321016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:27.873120 run osmo-stp_10.42.42.5(pid=30562): stderr: | 20221210174526512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174526512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174526513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174526513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174526514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174526514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174526514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:28.007808 run osmo-stp_10.42.42.5(pid=30562): stdout: | (launched: 2022-12-10_17:45:26.321016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:28.136623 run osmo-stp_10.42.42.5(pid=30562): stderr: | 20221210174526512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174526512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174526513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174526513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174526514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174526514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174526514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:28.289100 run patchelf(pid=30565): Terminating (SIGINT) 17:45:28.464123 run patchelf(pid=30565): Terminated: ok {rc=0} 17:45:28.590707 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30562): Process ended prematurely: osmo-stp_10.42.42.5(pid=30562) [trial-2377↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30562)] [trial-2377↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:45:28.600088 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 17:45:28.628332 run osmo-hlr_10.42.42.2(pid=30559): ERR: Terminated: ERROR {rc=237} [trial-2377↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30559)] 17:45:28.678296 run osmo-hlr_10.42.42.2(pid=30559): stdout: | (launched: 2022-12-10_17:45:25.343885) 17:45:28.730035 run osmo-hlr_10.42.42.2(pid=30559): stderr: | 20221210174525540 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174525540 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174525540 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174525540 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174525540 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174525540 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174525552 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174525560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174525560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174525560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:28.782179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30558): Terminating (SIGTERM) 17:45:28.824171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30561): Terminating (SIGTERM) 17:45:28.866348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30564): Terminating (SIGTERM) 17:45:28.908480 --- ParallelTerminationStrategy: PID 30558 died... 17:45:28.928395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30558): Terminated: ok {rc=0} 17:45:28.975078 --- ParallelTerminationStrategy: PID 30561 died... 17:45:28.994728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30561): Terminated: ok {rc=0} 17:45:29.041142 --- ParallelTerminationStrategy: PID 30564 died... 17:45:29.060688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30564): Terminated: ok {rc=0} 17:45:29.148804 bus /gobi_0: Setting Powered False 17:45:30.247412 bus /gobi_0: Setting Powered False 17:45:31.367033 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:45:32.638290 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:45:32.644591 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:45:32.680273 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:45:32.715591 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:45:32.769793 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:45:32.804086 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:45:32.839178 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:45:33.396930 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2377 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:45:33.402137 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:33.413565 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:45:33.485977 tst switch_tch_pdch.py: using LAC 29577 17:45:33.609435 tst switch_tch_pdch.py: using RAC 252 17:45:33.725160 tst switch_tch_pdch.py: using CellId 29577 17:45:33.840009 tst switch_tch_pdch.py: using BVCI 29578 17:45:33.946137 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:33.957329 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:33.968247 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:33.979226 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:33.990242 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:34.001283 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:34.012283 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:34.023286 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:45:34.141363 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:45:34.260407 tst switch_tch_pdch.py:51: start network... 17:45:34.472066 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:34.931430 run create_hlr_db(pid=30569): Launched 17:45:35.051755 bus /gobi_6: Setting Powered False 17:45:36.115094 run create_hlr_db(pid=30569): Terminated: ok {rc=0} 17:45:36.512424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30571): Launched 17:45:36.808397 run osmo-hlr_10.42.42.2(pid=30572): Launched 17:45:36.920449 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:37.412071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30574): Launched 17:45:37.704703 run osmo-stp_10.42.42.5(pid=30575): Launched 17:45:37.815922 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:45:38.299343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30577): Launched 17:45:38.411776 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:45:38.659175 run patchelf(pid=30578): Launched 17:45:38.823080 run osmo-stp_10.42.42.5(pid=30575): ERR: Terminated: ERROR {rc=1} [trial-2377↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30575)] 17:45:38.947589 run osmo-stp_10.42.42.5(pid=30575): stdout: | (launched: 2022-12-10_17:45:37.650745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:39.073525 run osmo-stp_10.42.42.5(pid=30575): stderr: | 20221210174537820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174537820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174537820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174537821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174537821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174537821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174537821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:39.199407 run osmo-stp_10.42.42.5(pid=30575): stdout: | (launched: 2022-12-10_17:45:37.650745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:39.319740 run osmo-stp_10.42.42.5(pid=30575): stderr: | 20221210174537820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174537820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174537820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174537821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174537821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174537821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174537821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:39.462446 run patchelf(pid=30578): Terminating (SIGINT) 17:45:39.627095 run patchelf(pid=30578): Terminated: ok {rc=0} 17:45:39.746161 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30575): Process ended prematurely: osmo-stp_10.42.42.5(pid=30575) [trial-2377↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30575)] [trial-2377↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:45:39.755047 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 17:45:39.781455 run osmo-hlr_10.42.42.2(pid=30572): ERR: Terminated: ERROR {rc=237} [trial-2377↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30572)] 17:45:39.828543 run osmo-hlr_10.42.42.2(pid=30572): stdout: | (launched: 2022-12-10_17:45:36.754282) 17:45:39.877341 run osmo-hlr_10.42.42.2(pid=30572): stderr: | 20221210174536933 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174536933 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174536933 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174536933 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174536933 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174536933 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174536945 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174536954 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174536954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174536954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:39.926417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30571): Terminating (SIGTERM) 17:45:39.965812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30574): Terminating (SIGTERM) 17:45:40.005051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30577): Terminating (SIGTERM) 17:45:40.044604 --- ParallelTerminationStrategy: PID 30571 died... 17:45:40.063651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30571): Terminated: ok {rc=0} 17:45:40.107421 --- ParallelTerminationStrategy: PID 30574 died... 17:45:40.125840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30574): Terminated: ok {rc=0} 17:45:40.169409 --- ParallelTerminationStrategy: PID 30577 died... 17:45:40.187855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30577): Terminated: ok {rc=0} 17:45:40.273131 bus /gobi_0: Setting Powered False 17:45:41.372603 bus /gobi_0: Setting Powered False 17:45:42.487179 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 nitb_sms:trx-umtrx --------------------------------------------------------------------- 17:45:43.739554 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:45:43.743239 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:45:43.775466 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 17:45:43.782192 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 17:45:43.834759 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:45:43.866775 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 17:45:43.873364 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 17:45:44.413112 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 17:45:44.418423 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 17:45:44.429709 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 17:45:44.477879 tst mo_mt_sms.py: using LAC 29578 17:45:44.602359 tst mo_mt_sms.py: using RAC 253 17:45:44.725928 tst mo_mt_sms.py: using CellId 29578 17:45:44.848453 tst mo_mt_sms.py: using BVCI 29579 17:45:44.954286 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 17:45:45.072105 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 17:45:45.188918 tst mo_mt_sms.py:9: start nitb and bts... 17:45:45.401287 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:45:46.075422 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30582): Launched 17:45:46.389604 run osmo-nitb_10.42.42.2(pid=30583): Launched 17:45:46.579345 run osmo-nitb_10.42.42.2(pid=30583): ERR: Terminated: ERROR {rc=2} [trial-2377↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30583)] 17:45:46.716228 run osmo-nitb_10.42.42.2(pid=30583): stdout: | (launched: 2022-12-10_17:45:46.333703) 17:45:46.853441 run osmo-nitb_10.42.42.2(pid=30583): stderr: | (launched: 2022-12-10_17:45:46.378520) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:45:46.991189 run osmo-nitb_10.42.42.2(pid=30583): stdout: | (launched: 2022-12-10_17:45:46.333703) 17:45:47.124197 run osmo-nitb_10.42.42.2(pid=30583): stderr: | (launched: 2022-12-10_17:45:46.378520) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f2803594268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30583): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30583) [trial-2377↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30583)] 17:45:47.524129 tst osmo-nitb_10.42.42.2(pid=30583): stdout: | (launched: 2022-12-10_17:45:46.333703) 17:45:47.643183 tst osmo-nitb_10.42.42.2(pid=30583): stderr: | (launched: 2022-12-10_17:45:46.378520) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:45:47.782766 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30583): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30583) [trial-2377↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30583)] [trial-2377↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 17:45:47.791179 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 17:45:47.797649 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30582): Terminating (SIGTERM) 17:45:48.005882 --- ParallelTerminationStrategy: PID 30582 died... 17:45:48.026756 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30582): Terminated: ok {rc=0} 17:45:48.112020 bus /sierra_3: Setting Powered False 17:45:49.212368 bus /sierra_3: Setting Powered False 17:45:50.326748 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 sms:trx-umtrx --------------------------------------------------------------------- 17:45:51.522488 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:45:51.526583 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:45:51.559348 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:45:51.586279 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 17:45:51.638460 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:45:51.673784 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:45:51.701594 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 17:45:52.245873 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 17:45:52.250970 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:45:52.262014 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 17:45:52.311098 tst mo_mt_sms.py: using LAC 29579 17:45:52.434109 tst mo_mt_sms.py: using RAC 254 17:45:52.557389 tst mo_mt_sms.py: using CellId 29579 17:45:52.678622 tst mo_mt_sms.py: using BVCI 29580 17:45:52.792546 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:45:52.803615 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:45:52.814535 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:45:52.826072 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:45:52.837499 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:45:52.849030 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 17:45:52.963359 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 17:45:53.075431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:53.532293 run create_hlr_db(pid=30588): Launched 17:45:53.655319 bus /sierra_2: Setting Powered False 17:45:54.714306 run create_hlr_db(pid=30588): Terminated: ok {rc=0} 17:45:55.143719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30590): Launched 17:45:55.456428 run osmo-hlr_10.42.42.2(pid=30591): Launched 17:45:55.577604 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:56.120409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30593): Launched 17:45:56.417257 run osmo-stp_10.42.42.5(pid=30594): Launched 17:45:56.529438 run osmo-msc_10.42.42.6: Starting osmo-msc 17:45:57.061077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30596): Launched 17:45:57.355284 run osmo-msc_10.42.42.6(pid=30597): Launched 17:45:57.519302 run osmo-stp_10.42.42.5(pid=30594): ERR: Terminated: ERROR {rc=1} [trial-2377↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30594)] 17:45:57.642819 run osmo-stp_10.42.42.5(pid=30594): stdout: | (launched: 2022-12-10_17:45:56.362649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:57.768286 run osmo-stp_10.42.42.5(pid=30594): stderr: | 20221210174556533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174556533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174556533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174556534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174556534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174556534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174556534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:57.890822 run osmo-stp_10.42.42.5(pid=30594): stdout: | (launched: 2022-12-10_17:45:56.362649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:58.007770 run osmo-stp_10.42.42.5(pid=30594): stderr: | 20221210174556533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174556533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174556533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174556534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174556534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174556534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174556534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:58.147205 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30594): Process ended prematurely: osmo-stp_10.42.42.5(pid=30594) [trial-2377↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30594)] [trial-2377↪sms:trx-umtrx↪mo_mt_sms.py:16] 17:45:58.155627 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 17:45:58.181880 run osmo-hlr_10.42.42.2(pid=30591): ERR: Terminated: ERROR {rc=237} [trial-2377↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30591)] 17:45:58.229447 run osmo-hlr_10.42.42.2(pid=30591): stdout: | (launched: 2022-12-10_17:45:55.399487) 17:45:58.278756 run osmo-hlr_10.42.42.2(pid=30591): stderr: | 20221210174555598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174555598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174555598 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174555598 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174555598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174555598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174555611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174555619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174555620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174555620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:58.347257 run osmo-msc_10.42.42.6(pid=30597): ERR: Terminated: ERROR {rc=2} [trial-2377↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30597)] 17:45:58.395108 run osmo-msc_10.42.42.6(pid=30597): stdout: | (launched: 2022-12-10_17:45:57.301333) 17:45:58.444204 run osmo-msc_10.42.42.6(pid=30597): stderr: | 20221210174557572 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174557572 DLGLOBAL DEBUG validating counter group 0x7f0161a07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174557572 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174557572 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174557573 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174557573 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174557574 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174557575 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174557575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174557575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:45:58.493504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30590): Terminating (SIGTERM) 17:45:58.532842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30593): Terminating (SIGTERM) 17:45:58.572199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30596): Terminating (SIGTERM) 17:45:58.611891 --- ParallelTerminationStrategy: PID 30590 died... 17:45:58.630758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30590): Terminated: ok {rc=0} 17:45:58.674013 --- ParallelTerminationStrategy: PID 30593 died... 17:45:58.692839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30593): Terminated: ok {rc=0} 17:45:58.736270 --- ParallelTerminationStrategy: PID 30596 died... 17:45:58.754683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30596): Terminated: ok {rc=0} 17:45:58.839403 bus /sierra_3: Setting Powered False 17:45:59.939590 bus /sierra_3: Setting Powered False 17:46:01.053462 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 17:46:02.289197 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:02.292901 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:46:02.325926 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 17:46:02.332724 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 17:46:02.368070 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:46:02.400867 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 17:46:02.407586 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 17:46:02.927073 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2377 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 17:46:02.931982 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 17:46:02.942835 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 17:46:02.989349 tst assert_extension.py: using LAC 29580 17:46:03.105488 tst assert_extension.py: using RAC 255 17:46:03.230266 tst assert_extension.py: using CellId 29580 17:46:03.345464 tst assert_extension.py: using BVCI 29581 17:46:03.450888 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 17:46:03.566637 tst assert_extension.py:10: start nitb and bts... 17:46:03.776762 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:46:04.416881 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30602): Launched 17:46:04.732099 run osmo-nitb_10.42.42.2(pid=30603): Launched 17:46:04.906082 run osmo-nitb_10.42.42.2(pid=30603): ERR: Terminated: ERROR {rc=2} [trial-2377↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30603)] 17:46:05.047114 run osmo-nitb_10.42.42.2(pid=30603): stdout: | (launched: 2022-12-10_17:46:04.674927) 17:46:05.189303 run osmo-nitb_10.42.42.2(pid=30603): stderr: | (launched: 2022-12-10_17:46:04.721646) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:46:05.332020 run osmo-nitb_10.42.42.2(pid=30603): stdout: | (launched: 2022-12-10_17:46:04.674927) 17:46:05.468649 run osmo-nitb_10.42.42.2(pid=30603): stderr: | (launched: 2022-12-10_17:46:04.721646) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f2803594268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30603): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30603) [trial-2377↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30603)] 17:46:05.851142 tst osmo-nitb_10.42.42.2(pid=30603): stdout: | (launched: 2022-12-10_17:46:04.674927) 17:46:05.978127 tst osmo-nitb_10.42.42.2(pid=30603): stderr: | (launched: 2022-12-10_17:46:04.721646) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:46:06.127861 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=30603): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30603) [trial-2377↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30603)] [trial-2377↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 17:46:06.137085 tst assert_extension.py:12: Test FAILED (3.2 sec) 17:46:06.144421 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30602): Terminating (SIGTERM) 17:46:06.355415 --- ParallelTerminationStrategy: PID 30602 died... 17:46:06.376800 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30602): Terminated: ok {rc=0} 17:46:06.465683 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 ussd:trx-umtrx --------------------------------------------------------------------- 17:46:07.640131 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:07.644515 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:46:07.678430 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:46:07.706067 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 17:46:07.742883 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:46:07.776386 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:46:07.803846 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 17:46:08.331417 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2377 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 17:46:08.336736 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:08.347802 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 17:46:08.397915 tst assert_extension.py: using LAC 29581 17:46:08.523686 tst assert_extension.py: using RAC 1 17:46:08.648287 tst assert_extension.py: using CellId 29581 17:46:08.770577 tst assert_extension.py: using BVCI 29582 17:46:08.884552 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:08.895709 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:08.906859 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:08.918081 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:08.929380 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:08.940491 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 17:46:09.057035 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:09.543071 run create_hlr_db(pid=30607): Launched 17:46:09.662904 bus /sierra_2: Setting Powered False 17:46:10.725107 run create_hlr_db(pid=30607): Terminated: ok {rc=0} 17:46:11.146500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30609): Launched 17:46:11.440768 run osmo-hlr_10.42.42.2(pid=30610): Launched 17:46:11.553505 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:12.065574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30612): Launched 17:46:12.360623 run osmo-stp_10.42.42.5(pid=30613): Launched 17:46:12.472693 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:13.005672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30615): Launched 17:46:13.298828 run osmo-msc_10.42.42.6(pid=30616): Launched 17:46:13.464048 run osmo-stp_10.42.42.5(pid=30613): ERR: Terminated: ERROR {rc=1} [trial-2377↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30613)] 17:46:13.589179 run osmo-stp_10.42.42.5(pid=30613): stdout: | (launched: 2022-12-10_17:46:12.306529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:13.713709 run osmo-stp_10.42.42.5(pid=30613): stderr: | 20221210174612475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174612475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174612476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174612476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174612478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174612479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174612479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:13.835999 run osmo-stp_10.42.42.5(pid=30613): stdout: | (launched: 2022-12-10_17:46:12.306529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:13.952167 run osmo-stp_10.42.42.5(pid=30613): stderr: | 20221210174612475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174612475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174612476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174612476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174612478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174612479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174612479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:14.091373 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30613): Process ended prematurely: osmo-stp_10.42.42.5(pid=30613) [trial-2377↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30613)] [trial-2377↪ussd:trx-umtrx↪assert_extension.py:17] 17:46:14.099741 tst assert_extension.py:17: Test FAILED (5.8 sec) 17:46:14.125925 run osmo-hlr_10.42.42.2(pid=30610): ERR: Terminated: ERROR {rc=237} [trial-2377↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30610)] 17:46:14.173452 run osmo-hlr_10.42.42.2(pid=30610): stdout: | (launched: 2022-12-10_17:46:11.386930) 17:46:14.222535 run osmo-hlr_10.42.42.2(pid=30610): stderr: | 20221210174611561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174611561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174611561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174611561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174611561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174611561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174611573 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174611582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174611582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174611582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:14.290860 run osmo-msc_10.42.42.6(pid=30616): ERR: Terminated: ERROR {rc=2} [trial-2377↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30616)] 17:46:14.338138 run osmo-msc_10.42.42.6(pid=30616): stdout: | (launched: 2022-12-10_17:46:13.244749) 17:46:14.386967 run osmo-msc_10.42.42.6(pid=30616): stderr: | 20221210174613535 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174613535 DLGLOBAL DEBUG validating counter group 0x7ff742ffcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174613535 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174613535 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174613535 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174613535 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174613537 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174613538 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174613538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174613538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:14.436242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30609): Terminating (SIGTERM) 17:46:14.475653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30612): Terminating (SIGTERM) 17:46:14.515464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30615): Terminating (SIGTERM) 17:46:14.555727 --- ParallelTerminationStrategy: PID 30609 died... 17:46:14.574824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30609): Terminated: ok {rc=0} 17:46:14.618863 --- ParallelTerminationStrategy: PID 30612 died... 17:46:14.637401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30612): Terminated: ok {rc=0} 17:46:14.681338 --- ParallelTerminationStrategy: PID 30615 died... 17:46:14.700027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30615): Terminated: ok {rc=0} 17:46:14.786192 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:46:16.038526 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:16.045824 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:46:16.080909 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:46:16.108373 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:46:16.161828 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:46:16.201750 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:46:16.235556 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:46:16.790787 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:46:16.846587 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:16.858673 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:46:16.933713 tst mo_mt_call.py: using LAC 29582 17:46:17.066814 tst mo_mt_call.py: using RAC 2 17:46:17.218658 tst mo_mt_call.py: using CellId 29582 17:46:17.348578 tst mo_mt_call.py: using BVCI 29583 17:46:17.466436 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:17.478077 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:17.490099 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:17.502252 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:17.514341 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:17.526005 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:46:17.641709 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:46:17.756856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:18.222941 run create_hlr_db(pid=30621): Launched 17:46:18.345741 bus /sierra_2: Setting Powered False 17:46:19.405632 run create_hlr_db(pid=30621): Terminated: ok {rc=0} 17:46:19.823345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30623): Launched 17:46:20.123034 run osmo-hlr_10.42.42.2(pid=30624): Launched 17:46:20.236581 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:20.751525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30626): Launched 17:46:21.051748 run osmo-stp_10.42.42.5(pid=30627): Launched 17:46:21.166618 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:21.710652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30629): Launched 17:46:22.012412 run osmo-msc_10.42.42.6(pid=30630): Launched 17:46:22.180561 run osmo-stp_10.42.42.5(pid=30627): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30627)] 17:46:22.307209 run osmo-stp_10.42.42.5(pid=30627): stdout: | (launched: 2022-12-10_17:46:20.996143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:22.433806 run osmo-stp_10.42.42.5(pid=30627): stderr: | 20221210174621167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174621167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174621167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174621168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174621168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174621168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174621168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:22.559171 run osmo-stp_10.42.42.5(pid=30627): stdout: | (launched: 2022-12-10_17:46:20.996143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:22.679072 run osmo-stp_10.42.42.5(pid=30627): stderr: | 20221210174621167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174621167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174621167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174621168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174621168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174621168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174621168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:22.821691 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30627): Process ended prematurely: osmo-stp_10.42.42.5(pid=30627) [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30627)] [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:46:22.830725 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:46:22.856745 run osmo-hlr_10.42.42.2(pid=30624): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30624)] 17:46:22.905064 run osmo-hlr_10.42.42.2(pid=30624): stdout: | (launched: 2022-12-10_17:46:20.068091) 17:46:22.953744 run osmo-hlr_10.42.42.2(pid=30624): stderr: | 20221210174620244 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174620244 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174620244 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174620244 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174620244 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174620244 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174620261 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174620270 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174620271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174620271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:23.021879 run osmo-msc_10.42.42.6(pid=30630): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30630)] 17:46:23.069259 run osmo-msc_10.42.42.6(pid=30630): stdout: | (launched: 2022-12-10_17:46:21.957520) 17:46:23.118045 run osmo-msc_10.42.42.6(pid=30630): stderr: | 20221210174622230 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174622230 DLGLOBAL DEBUG validating counter group 0x7fc5d2842c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174622230 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174622230 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174622230 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174622231 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174622232 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174622233 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174622233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174622233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:23.166879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30623): Terminating (SIGTERM) 17:46:23.206019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30626): Terminating (SIGTERM) 17:46:23.245228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30629): Terminating (SIGTERM) 17:46:23.284434 --- ParallelTerminationStrategy: PID 30623 died... 17:46:23.303197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30623): Terminated: ok {rc=0} 17:46:23.346528 --- ParallelTerminationStrategy: PID 30626 died... 17:46:23.364799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30626): Terminated: ok {rc=0} 17:46:23.407983 --- ParallelTerminationStrategy: PID 30629 died... 17:46:23.426281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30629): Terminated: ok {rc=0} 17:46:23.509119 bus /sierra_3: Setting Powered False 17:46:24.603534 bus /sierra_3: Setting Powered False 17:46:25.718231 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:46:26.863137 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:26.874942 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:46:26.944850 tst mo_mt_call_osmux.py: using LAC 29583 17:46:27.066669 tst mo_mt_call_osmux.py: using RAC 3 17:46:27.184850 tst mo_mt_call_osmux.py: using CellId 29583 17:46:27.300601 tst mo_mt_call_osmux.py: using BVCI 29584 17:46:27.408574 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:27.419745 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:27.430608 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:27.441589 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:27.452435 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:27.463274 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:46:27.581339 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:46:27.702542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:28.197749 run create_hlr_db(pid=30632): Launched 17:46:28.320286 bus /sierra_2: Setting Powered False 17:46:29.379429 run create_hlr_db(pid=30632): Terminated: ok {rc=0} 17:46:29.823959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30634): Launched 17:46:30.143185 run osmo-hlr_10.42.42.2(pid=30635): Launched 17:46:30.265612 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:30.818795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30637): Launched 17:46:31.149639 run osmo-stp_10.42.42.5(pid=30638): Launched 17:46:31.423903 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:32.017753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30640): Launched 17:46:32.324588 run osmo-msc_10.42.42.6(pid=30641): Launched 17:46:32.492242 run osmo-stp_10.42.42.5(pid=30638): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30638)] 17:46:32.621488 run osmo-stp_10.42.42.5(pid=30638): stdout: | (launched: 2022-12-10_17:46:31.088719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:32.751581 run osmo-stp_10.42.42.5(pid=30638): stderr: | 20221210174631279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174631279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174631279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174631280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174631282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174631282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174631282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:32.875753 run osmo-stp_10.42.42.5(pid=30638): stdout: | (launched: 2022-12-10_17:46:31.088719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:32.994736 run osmo-stp_10.42.42.5(pid=30638): stderr: | 20221210174631279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174631279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174631279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174631280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174631282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174631282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174631282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:33.137266 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30638): Process ended prematurely: osmo-stp_10.42.42.5(pid=30638) [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30638)] [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:46:33.146073 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:46:33.172301 run osmo-hlr_10.42.42.2(pid=30635): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30635)] 17:46:33.219645 run osmo-hlr_10.42.42.2(pid=30635): stdout: | (launched: 2022-12-10_17:46:30.085230) 17:46:33.268384 run osmo-hlr_10.42.42.2(pid=30635): stderr: | 20221210174630280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174630280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174630280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174630280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174630280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174630280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174630292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174630301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174630301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174630301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:33.336743 run osmo-msc_10.42.42.6(pid=30641): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30641)] 17:46:33.384028 run osmo-msc_10.42.42.6(pid=30641): stdout: | (launched: 2022-12-10_17:46:32.269353) 17:46:33.433051 run osmo-msc_10.42.42.6(pid=30641): stderr: | 20221210174632540 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174632540 DLGLOBAL DEBUG validating counter group 0x7f8adbe34c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174632540 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174632540 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174632541 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174632541 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174632542 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174632544 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174632544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174632544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:33.482215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30634): Terminating (SIGTERM) 17:46:33.521450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30637): Terminating (SIGTERM) 17:46:33.561308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30640): Terminating (SIGTERM) 17:46:33.601493 --- ParallelTerminationStrategy: PID 30634 died... 17:46:33.620447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30634): Terminated: ok {rc=0} 17:46:33.664121 --- ParallelTerminationStrategy: PID 30637 died... 17:46:33.682584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30637): Terminated: ok {rc=0} 17:46:33.725937 --- ParallelTerminationStrategy: PID 30640 died... 17:46:33.744219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30640): Terminated: ok {rc=0} 17:46:33.827132 bus /sierra_3: Setting Powered False 17:46:34.923575 bus /sierra_3: Setting Powered False 17:46:36.041163 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:46:37.289263 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:37.295490 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:46:37.329087 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:46:37.355982 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:46:37.408626 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:46:37.441091 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:46:37.467194 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:46:38.017487 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:46:38.066255 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:38.077439 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:46:38.146458 tst mo_mt_call.py: using LAC 29584 17:46:38.264655 tst mo_mt_call.py: using RAC 4 17:46:38.382304 tst mo_mt_call.py: using CellId 29584 17:46:38.499474 tst mo_mt_call.py: using BVCI 29585 17:46:38.609399 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:38.620348 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:38.631118 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:38.641961 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:38.652752 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:38.663618 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:46:38.782310 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:46:38.897785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:39.362999 run create_hlr_db(pid=30647): Launched 17:46:39.485823 bus /sierra_2: Setting Powered False 17:46:40.546351 run create_hlr_db(pid=30647): Terminated: ok {rc=0} 17:46:40.984250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30649): Launched 17:46:41.305698 run osmo-hlr_10.42.42.2(pid=30650): Launched 17:46:41.428310 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:41.984375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30652): Launched 17:46:42.305184 run osmo-stp_10.42.42.5(pid=30653): Launched 17:46:42.427797 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:43.009194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30655): Launched 17:46:43.330932 run osmo-msc_10.42.42.6(pid=30656): Launched 17:46:43.511978 run osmo-stp_10.42.42.5(pid=30653): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30653)] 17:46:43.648281 run osmo-stp_10.42.42.5(pid=30653): stdout: | (launched: 2022-12-10_17:46:42.246773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:43.784494 run osmo-stp_10.42.42.5(pid=30653): stderr: | 20221210174642440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174642441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174642441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174642441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174642442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174642442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174642442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:43.919795 run osmo-stp_10.42.42.5(pid=30653): stdout: | (launched: 2022-12-10_17:46:42.246773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:44.047709 run osmo-stp_10.42.42.5(pid=30653): stderr: | 20221210174642440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174642441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174642441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174642441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174642442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174642442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174642442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:44.200556 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30653): Process ended prematurely: osmo-stp_10.42.42.5(pid=30653) [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30653)] [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:46:44.210109 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:46:44.238549 run osmo-hlr_10.42.42.2(pid=30650): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30650)] 17:46:44.289136 run osmo-hlr_10.42.42.2(pid=30650): stdout: | (launched: 2022-12-10_17:46:41.247311) 17:46:44.341452 run osmo-hlr_10.42.42.2(pid=30650): stderr: | 20221210174641445 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174641445 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174641445 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174641445 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174641445 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174641445 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174641460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174641470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174641470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174641470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:44.414093 run osmo-msc_10.42.42.6(pid=30656): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30656)] 17:46:44.464759 run osmo-msc_10.42.42.6(pid=30656): stdout: | (launched: 2022-12-10_17:46:43.271992) 17:46:44.517325 run osmo-msc_10.42.42.6(pid=30656): stderr: | 20221210174643594 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174643594 DLGLOBAL DEBUG validating counter group 0x7f0cea723c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174643594 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174643594 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174643594 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174643594 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174643596 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174643596 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174643597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174643597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:44.569815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30649): Terminating (SIGTERM) 17:46:44.611884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30652): Terminating (SIGTERM) 17:46:44.653893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30655): Terminating (SIGTERM) 17:46:44.696218 --- ParallelTerminationStrategy: PID 30649 died... 17:46:44.716293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30649): Terminated: ok {rc=0} 17:46:44.763313 --- ParallelTerminationStrategy: PID 30652 died... 17:46:44.783013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30652): Terminated: ok {rc=0} 17:46:44.829471 --- ParallelTerminationStrategy: PID 30655 died... 17:46:44.849136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30655): Terminated: ok {rc=0} 17:46:44.937930 bus /sierra_3: Setting Powered False 17:46:46.044271 bus /sierra_3: Setting Powered False 17:46:47.177251 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:46:48.333006 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:48.345538 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:46:48.417409 tst mo_mt_call_osmux.py: using LAC 29585 17:46:48.545086 tst mo_mt_call_osmux.py: using RAC 5 17:46:48.671872 tst mo_mt_call_osmux.py: using CellId 29585 17:46:48.797041 tst mo_mt_call_osmux.py: using BVCI 29586 17:46:48.907951 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:48.919313 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:48.930415 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:48.942093 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:48.953747 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:48.965473 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:46:49.078900 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:46:49.198262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:49.664878 run create_hlr_db(pid=30658): Launched 17:46:49.788619 bus /sierra_2: Setting Powered False 17:46:50.849373 run create_hlr_db(pid=30658): Terminated: ok {rc=0} 17:46:51.287278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30660): Launched 17:46:51.611565 run osmo-hlr_10.42.42.2(pid=30661): Launched 17:46:51.735063 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:52.292676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30663): Launched 17:46:52.614026 run osmo-stp_10.42.42.5(pid=30664): Launched 17:46:52.737941 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:53.318614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30666): Launched 17:46:53.640463 run osmo-msc_10.42.42.6(pid=30667): Launched 17:46:53.823055 run osmo-stp_10.42.42.5(pid=30664): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30664)] 17:46:53.958852 run osmo-stp_10.42.42.5(pid=30664): stdout: | (launched: 2022-12-10_17:46:52.555622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:54.095157 run osmo-stp_10.42.42.5(pid=30664): stderr: | 20221210174652750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174652750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174652750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174652751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174652751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174652751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174652751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:54.230450 run osmo-stp_10.42.42.5(pid=30664): stdout: | (launched: 2022-12-10_17:46:52.555622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:54.358266 run osmo-stp_10.42.42.5(pid=30664): stderr: | 20221210174652750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174652750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174652750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174652751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174652751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174652751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174652751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:54.511575 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30664): Process ended prematurely: osmo-stp_10.42.42.5(pid=30664) [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30664)] [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:46:54.521475 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:46:54.550107 run osmo-hlr_10.42.42.2(pid=30661): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30661)] 17:46:54.600790 run osmo-hlr_10.42.42.2(pid=30661): stdout: | (launched: 2022-12-10_17:46:51.553004) 17:46:54.654121 run osmo-hlr_10.42.42.2(pid=30661): stderr: | 20221210174651755 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174651755 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174651755 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174651755 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174651755 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174651755 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174651768 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174651778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174651778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174651778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:54.726591 run osmo-msc_10.42.42.6(pid=30667): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30667)] 17:46:54.776794 run osmo-msc_10.42.42.6(pid=30667): stdout: | (launched: 2022-12-10_17:46:53.582045) 17:46:54.828934 run osmo-msc_10.42.42.6(pid=30667): stderr: | 20221210174653903 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174653903 DLGLOBAL DEBUG validating counter group 0x7fd4fdbb2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174653903 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174653903 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174653903 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174653904 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174653905 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174653906 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174653906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174653906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:54.881535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30660): Terminating (SIGTERM) 17:46:54.923247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30663): Terminating (SIGTERM) 17:46:54.964870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30666): Terminating (SIGTERM) 17:46:55.007449 --- ParallelTerminationStrategy: PID 30660 died... 17:46:55.027406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30660): Terminated: ok {rc=0} 17:46:55.074041 --- ParallelTerminationStrategy: PID 30663 died... 17:46:55.093741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30663): Terminated: ok {rc=0} 17:46:55.139994 --- ParallelTerminationStrategy: PID 30666 died... 17:46:55.159485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30666): Terminated: ok {rc=0} 17:46:55.247599 bus /sierra_3: Setting Powered False 17:46:56.346767 bus /sierra_3: Setting Powered False 17:46:57.461849 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:46:58.706543 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:58.712623 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:46:58.745916 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:46:58.772375 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:46:58.824217 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:46:58.856528 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:46:58.883590 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:46:59.433945 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:46:59.481947 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:46:59.493010 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:46:59.561571 tst mo_mt_call.py: using LAC 29586 17:46:59.681396 tst mo_mt_call.py: using RAC 6 17:46:59.801839 tst mo_mt_call.py: using CellId 29586 17:46:59.924419 tst mo_mt_call.py: using BVCI 29587 17:47:00.034378 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:00.045415 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:00.056253 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:00.067570 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:00.078439 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:00.089178 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:47:00.202543 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:47:00.315901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:00.781777 run create_hlr_db(pid=30672): Launched 17:47:00.939426 bus /sierra_2: Setting Powered False 17:47:01.998860 run create_hlr_db(pid=30672): Terminated: ok {rc=0} 17:47:02.432119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30674): Launched 17:47:02.737723 run osmo-hlr_10.42.42.2(pid=30675): Launched 17:47:02.882563 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:03.398411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30677): Launched 17:47:03.699547 run osmo-stp_10.42.42.5(pid=30678): Launched 17:47:03.813623 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:04.357538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30680): Launched 17:47:04.658445 run osmo-msc_10.42.42.6(pid=30681): Launched 17:47:04.827531 run osmo-stp_10.42.42.5(pid=30678): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30678)] 17:47:04.954472 run osmo-stp_10.42.42.5(pid=30678): stdout: | (launched: 2022-12-10_17:47:03.644696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:05.080883 run osmo-stp_10.42.42.5(pid=30678): stderr: | 20221210174703814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174703815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174703815 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174703815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174703817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174703818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174703818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:05.205769 run osmo-stp_10.42.42.5(pid=30678): stdout: | (launched: 2022-12-10_17:47:03.644696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:05.324830 run osmo-stp_10.42.42.5(pid=30678): stderr: | 20221210174703814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174703815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174703815 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174703815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174703817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174703818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174703818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:05.467233 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30678): Process ended prematurely: osmo-stp_10.42.42.5(pid=30678) [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30678)] [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:47:05.476353 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:47:05.502932 run osmo-hlr_10.42.42.2(pid=30675): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30675)] 17:47:05.550543 run osmo-hlr_10.42.42.2(pid=30675): stdout: | (launched: 2022-12-10_17:47:02.677908) 17:47:05.599708 run osmo-hlr_10.42.42.2(pid=30675): stderr: | 20221210174702867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174702867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174702867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174702867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174702867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174702867 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174702879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174702888 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174702888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174702888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:05.668432 run osmo-msc_10.42.42.6(pid=30681): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30681)] 17:47:05.716221 run osmo-msc_10.42.42.6(pid=30681): stdout: | (launched: 2022-12-10_17:47:04.603302) 17:47:05.765300 run osmo-msc_10.42.42.6(pid=30681): stderr: | 20221210174704875 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174704875 DLGLOBAL DEBUG validating counter group 0x7fc7e691cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174704875 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174704875 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174704875 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174704875 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174704878 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174704879 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174704879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174704879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:05.814640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30674): Terminating (SIGTERM) 17:47:05.854046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30677): Terminating (SIGTERM) 17:47:05.893657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30680): Terminating (SIGTERM) 17:47:05.933905 --- ParallelTerminationStrategy: PID 30674 died... 17:47:05.952987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30674): Terminated: ok {rc=0} 17:47:05.996899 --- ParallelTerminationStrategy: PID 30677 died... 17:47:06.015880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30677): Terminated: ok {rc=0} 17:47:06.059154 --- ParallelTerminationStrategy: PID 30680 died... 17:47:06.077768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30680): Terminated: ok {rc=0} 17:47:06.160750 bus /sierra_3: Setting Powered False 17:47:07.258130 bus /sierra_3: Setting Powered False 17:47:08.376137 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:47:09.526810 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:09.539262 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:47:09.612527 tst mo_mt_call_osmux.py: using LAC 29587 17:47:09.740156 tst mo_mt_call_osmux.py: using RAC 7 17:47:09.864926 tst mo_mt_call_osmux.py: using CellId 29587 17:47:09.992306 tst mo_mt_call_osmux.py: using BVCI 29588 17:47:10.108825 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:10.120330 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:10.131640 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:10.143291 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:10.155316 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:10.167202 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:47:10.287134 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:47:10.406457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:10.904435 run create_hlr_db(pid=30683): Launched 17:47:11.027583 bus /sierra_2: Setting Powered False 17:47:12.090562 run create_hlr_db(pid=30683): Terminated: ok {rc=0} 17:47:12.536684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30685): Launched 17:47:12.857236 run osmo-hlr_10.42.42.2(pid=30686): Launched 17:47:12.979793 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:13.533521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30688): Launched 17:47:13.854553 run osmo-stp_10.42.42.5(pid=30689): Launched 17:47:13.978416 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:14.556869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30691): Launched 17:47:14.876292 run osmo-msc_10.42.42.6(pid=30692): Launched 17:47:15.056108 run osmo-stp_10.42.42.5(pid=30689): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30689)] 17:47:15.191489 run osmo-stp_10.42.42.5(pid=30689): stdout: | (launched: 2022-12-10_17:47:13.796177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:15.327411 run osmo-stp_10.42.42.5(pid=30689): stderr: | 20221210174713986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174713986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174713987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174713987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174713987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174713988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174713988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:15.461917 run osmo-stp_10.42.42.5(pid=30689): stdout: | (launched: 2022-12-10_17:47:13.796177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:15.589713 run osmo-stp_10.42.42.5(pid=30689): stderr: | 20221210174713986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174713986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174713987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174713987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174713987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174713988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174713988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:15.742257 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30689): Process ended prematurely: osmo-stp_10.42.42.5(pid=30689) [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30689)] [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:47:15.752024 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:47:15.781029 run osmo-hlr_10.42.42.2(pid=30686): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30686)] 17:47:15.841057 run osmo-hlr_10.42.42.2(pid=30686): stdout: | (launched: 2022-12-10_17:47:12.798917) 17:47:15.894158 run osmo-hlr_10.42.42.2(pid=30686): stderr: | 20221210174712998 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174712998 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174712999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174712999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174712999 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174712999 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174713011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174713019 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174713019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174713020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:15.964145 run osmo-msc_10.42.42.6(pid=30692): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30692)] 17:47:16.012916 run osmo-msc_10.42.42.6(pid=30692): stdout: | (launched: 2022-12-10_17:47:14.818172) 17:47:16.063093 run osmo-msc_10.42.42.6(pid=30692): stderr: | 20221210174715138 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174715138 DLGLOBAL DEBUG validating counter group 0x7f2e18987c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174715138 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174715138 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174715138 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174715139 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174715140 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174715141 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174715141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174715141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:16.113771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30685): Terminating (SIGTERM) 17:47:16.155520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30688): Terminating (SIGTERM) 17:47:16.198425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30691): Terminating (SIGTERM) 17:47:16.242127 --- ParallelTerminationStrategy: PID 30685 died... 17:47:16.261417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30685): Terminated: ok {rc=0} 17:47:16.308049 --- ParallelTerminationStrategy: PID 30688 died... 17:47:16.328255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30688): Terminated: ok {rc=0} 17:47:16.372875 --- ParallelTerminationStrategy: PID 30691 died... 17:47:16.392136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30691): Terminated: ok {rc=0} 17:47:16.477571 bus /sierra_3: Setting Powered False 17:47:17.572150 bus /sierra_3: Setting Powered False 17:47:18.685342 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:47:19.933194 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:47:19.939574 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:47:19.971784 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:47:19.998454 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:47:20.052848 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:47:20.085769 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:47:20.112118 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:47:20.659616 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:47:20.708056 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:20.719366 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:47:20.788032 tst mo_mt_call.py: using LAC 29588 17:47:20.907296 tst mo_mt_call.py: using RAC 8 17:47:21.024907 tst mo_mt_call.py: using CellId 29588 17:47:21.147525 tst mo_mt_call.py: using BVCI 29589 17:47:21.257157 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:21.268164 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:21.279181 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:21.290095 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:21.301027 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:21.311915 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:47:21.429559 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:47:21.552517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:22.048547 run create_hlr_db(pid=30698): Launched 17:47:22.171509 bus /sierra_2: Setting Powered False 17:47:23.235414 run create_hlr_db(pid=30698): Terminated: ok {rc=0} 17:47:23.663237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30700): Launched 17:47:23.986981 run osmo-hlr_10.42.42.2(pid=30701): Launched 17:47:24.109417 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:24.662924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30703): Launched 17:47:24.987005 run osmo-stp_10.42.42.5(pid=30704): Launched 17:47:25.111086 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:25.694692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30706): Launched 17:47:26.016652 run osmo-msc_10.42.42.6(pid=30707): Launched 17:47:26.197396 run osmo-stp_10.42.42.5(pid=30704): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30704)] 17:47:26.333006 run osmo-stp_10.42.42.5(pid=30704): stdout: | (launched: 2022-12-10_17:47:24.928647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:26.469500 run osmo-stp_10.42.42.5(pid=30704): stderr: | 20221210174725120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174725120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174725120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174725121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174725121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174725121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174725121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:26.605485 run osmo-stp_10.42.42.5(pid=30704): stdout: | (launched: 2022-12-10_17:47:24.928647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:26.733810 run osmo-stp_10.42.42.5(pid=30704): stderr: | 20221210174725120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174725120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174725120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174725121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174725121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174725121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174725121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:26.886938 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30704): Process ended prematurely: osmo-stp_10.42.42.5(pid=30704) [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30704)] [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:47:26.896557 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:47:26.925783 run osmo-hlr_10.42.42.2(pid=30701): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30701)] 17:47:26.977513 run osmo-hlr_10.42.42.2(pid=30701): stdout: | (launched: 2022-12-10_17:47:23.928557) 17:47:27.030739 run osmo-hlr_10.42.42.2(pid=30701): stderr: | 20221210174724128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174724129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174724129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174724129 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174724129 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174724129 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174724142 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174724152 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174724152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174724152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:27.104546 run osmo-msc_10.42.42.6(pid=30707): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30707)] 17:47:27.155772 run osmo-msc_10.42.42.6(pid=30707): stdout: | (launched: 2022-12-10_17:47:25.958107) 17:47:27.208809 run osmo-msc_10.42.42.6(pid=30707): stderr: | 20221210174726280 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174726280 DLGLOBAL DEBUG validating counter group 0x7efcda2c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174726280 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174726280 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174726281 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174726281 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174726282 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174726283 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174726283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174726283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:27.262399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30700): Terminating (SIGTERM) 17:47:27.305756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30703): Terminating (SIGTERM) 17:47:27.348654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30706): Terminating (SIGTERM) 17:47:27.391900 --- ParallelTerminationStrategy: PID 30700 died... 17:47:27.412119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30700): Terminated: ok {rc=0} 17:47:27.459823 --- ParallelTerminationStrategy: PID 30703 died... 17:47:27.479685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30703): Terminated: ok {rc=0} 17:47:27.527339 --- ParallelTerminationStrategy: PID 30706 died... 17:47:27.547261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30706): Terminated: ok {rc=0} 17:47:27.636208 bus /sierra_3: Setting Powered False 17:47:28.735800 bus /sierra_3: Setting Powered False 17:47:29.852573 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:47:31.009551 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:31.022438 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:47:31.094425 tst mo_mt_call_osmux.py: using LAC 29589 17:47:31.266383 tst mo_mt_call_osmux.py: using RAC 9 17:47:31.397430 tst mo_mt_call_osmux.py: using CellId 29589 17:47:31.549472 tst mo_mt_call_osmux.py: using BVCI 29590 17:47:31.672317 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:31.683564 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:31.695569 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:31.707445 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:31.719575 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:31.730950 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:47:31.846476 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:47:31.985223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:32.490507 run create_hlr_db(pid=30709): Launched 17:47:32.615445 bus /sierra_2: Setting Powered False 17:47:33.678620 run create_hlr_db(pid=30709): Terminated: ok {rc=0} 17:47:34.105782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30711): Launched 17:47:34.405502 run osmo-hlr_10.42.42.2(pid=30712): Launched 17:47:34.519216 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:35.039547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30714): Launched 17:47:35.341672 run osmo-stp_10.42.42.5(pid=30715): Launched 17:47:35.456109 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:36.000910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30718): Launched 17:47:36.301115 run osmo-msc_10.42.42.6(pid=30724): Launched 17:47:36.468213 run osmo-stp_10.42.42.5(pid=30715): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30715)] 17:47:36.595128 run osmo-stp_10.42.42.5(pid=30715): stdout: | (launched: 2022-12-10_17:47:35.286287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:36.721312 run osmo-stp_10.42.42.5(pid=30715): stderr: | 20221210174735455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174735455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174735455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174735456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174735456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174735456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174735456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:36.845830 run osmo-stp_10.42.42.5(pid=30715): stdout: | (launched: 2022-12-10_17:47:35.286287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:36.964195 run osmo-stp_10.42.42.5(pid=30715): stderr: | 20221210174735455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174735455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174735455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174735456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174735456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174735456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174735456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:37.106644 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30715): Process ended prematurely: osmo-stp_10.42.42.5(pid=30715) [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30715)] [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:47:37.115509 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:47:37.142095 run osmo-hlr_10.42.42.2(pid=30712): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30712)] 17:47:37.190323 run osmo-hlr_10.42.42.2(pid=30712): stdout: | (launched: 2022-12-10_17:47:34.350512) 17:47:37.239691 run osmo-hlr_10.42.42.2(pid=30712): stderr: | 20221210174734527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174734527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174734527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174734527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174734527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174734527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174734540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174734550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174734550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174734551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:37.308273 run osmo-msc_10.42.42.6(pid=30724): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30724)] 17:47:37.355713 run osmo-msc_10.42.42.6(pid=30724): stdout: | (launched: 2022-12-10_17:47:36.245974) 17:47:37.404735 run osmo-msc_10.42.42.6(pid=30724): stderr: | 20221210174736519 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174736519 DLGLOBAL DEBUG validating counter group 0x7fddd8e6dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174736519 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174736519 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174736519 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174736519 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174736523 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174736523 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174736524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174736524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:37.453956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30711): Terminating (SIGTERM) 17:47:37.493468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30714): Terminating (SIGTERM) 17:47:37.532933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30718): Terminating (SIGTERM) 17:47:37.572504 --- ParallelTerminationStrategy: PID 30711 died... 17:47:37.591697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30711): Terminated: ok {rc=0} 17:47:37.635399 --- ParallelTerminationStrategy: PID 30714 died... 17:47:37.653936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30714): Terminated: ok {rc=0} 17:47:37.697816 --- ParallelTerminationStrategy: PID 30718 died... 17:47:37.716358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30718): Terminated: ok {rc=0} 17:47:37.802214 bus /sierra_3: Setting Powered False 17:47:38.899364 bus /sierra_3: Setting Powered False 17:47:40.011252 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:47:41.261798 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:47:41.269289 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:47:41.304077 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:47:41.332171 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:47:41.386780 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:47:41.421206 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:47:41.449671 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:47:41.998814 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:47:42.051431 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:42.063219 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:47:42.134268 tst mo_mt_call.py: using LAC 29590 17:47:42.260211 tst mo_mt_call.py: using RAC 10 17:47:42.386163 tst mo_mt_call.py: using CellId 29590 17:47:42.513228 tst mo_mt_call.py: using BVCI 29591 17:47:42.623409 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:42.634740 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:42.645918 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:42.657088 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:42.668256 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:42.679282 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:47:42.792244 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:47:42.909710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:43.406551 run create_hlr_db(pid=30729): Launched 17:47:43.529600 bus /sierra_2: Setting Powered False 17:47:44.590623 run create_hlr_db(pid=30729): Terminated: ok {rc=0} 17:47:45.034648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30731): Launched 17:47:45.357649 run osmo-hlr_10.42.42.2(pid=30732): Launched 17:47:45.480645 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:46.065757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30734): Launched 17:47:46.397367 run osmo-stp_10.42.42.5(pid=30735): Launched 17:47:46.715052 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:47.424831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30737): Launched 17:47:47.726954 run osmo-msc_10.42.42.6(pid=30738): Launched 17:47:47.894478 run osmo-stp_10.42.42.5(pid=30735): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30735)] 17:47:48.021985 run osmo-stp_10.42.42.5(pid=30735): stdout: | (launched: 2022-12-10_17:47:46.337590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:48.148329 run osmo-stp_10.42.42.5(pid=30735): stderr: | 20221210174746596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174746596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174746597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174746598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174746600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174746600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174746600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:48.273677 run osmo-stp_10.42.42.5(pid=30735): stdout: | (launched: 2022-12-10_17:47:46.337590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:48.393119 run osmo-stp_10.42.42.5(pid=30735): stderr: | 20221210174746596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174746596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174746597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174746598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174746600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174746600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174746600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:48.535628 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30735): Process ended prematurely: osmo-stp_10.42.42.5(pid=30735) [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30735)] [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:47:48.544759 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 17:47:48.571403 run osmo-hlr_10.42.42.2(pid=30732): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30732)] 17:47:48.619043 run osmo-hlr_10.42.42.2(pid=30732): stdout: | (launched: 2022-12-10_17:47:45.298727) 17:47:48.668048 run osmo-hlr_10.42.42.2(pid=30732): stderr: | 20221210174745496 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174745496 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174745496 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174745496 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174745496 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174745496 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174745508 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174745516 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174745516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174745516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:48.736488 run osmo-msc_10.42.42.6(pid=30738): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30738)] 17:47:48.784597 run osmo-msc_10.42.42.6(pid=30738): stdout: | (launched: 2022-12-10_17:47:47.671739) 17:47:48.833847 run osmo-msc_10.42.42.6(pid=30738): stderr: | 20221210174747942 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174747942 DLGLOBAL DEBUG validating counter group 0x7f10f4034c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174747942 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174747943 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174747943 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174747943 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174747945 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174747946 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174747946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174747946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:48.883217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30731): Terminating (SIGTERM) 17:47:48.922799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30734): Terminating (SIGTERM) 17:47:48.962129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30737): Terminating (SIGTERM) 17:47:49.001889 --- ParallelTerminationStrategy: PID 30731 died... 17:47:49.021142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30731): Terminated: ok {rc=0} 17:47:49.065408 --- ParallelTerminationStrategy: PID 30734 died... 17:47:49.084204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30734): Terminated: ok {rc=0} 17:47:49.128171 --- ParallelTerminationStrategy: PID 30737 died... 17:47:49.146909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30737): Terminated: ok {rc=0} 17:47:49.232340 bus /sierra_3: Setting Powered False 17:47:50.333359 bus /sierra_3: Setting Powered False 17:47:51.446928 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:47:52.596753 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:52.609225 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:47:52.684087 tst mo_mt_call_osmux.py: using LAC 29591 17:47:52.808509 tst mo_mt_call_osmux.py: using RAC 11 17:47:52.932220 tst mo_mt_call_osmux.py: using CellId 29591 17:47:53.047506 tst mo_mt_call_osmux.py: using BVCI 29592 17:47:53.164186 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:53.175911 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:53.187322 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:53.199184 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:53.211496 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:53.223289 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:47:53.339955 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:47:53.455249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:53.917544 run create_hlr_db(pid=30740): Launched 17:47:54.040820 bus /sierra_2: Setting Powered False 17:47:55.101335 run create_hlr_db(pid=30740): Terminated: ok {rc=0} 17:47:55.517338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30742): Launched 17:47:55.816275 run osmo-hlr_10.42.42.2(pid=30743): Launched 17:47:55.930899 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:56.449226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30745): Launched 17:47:56.748472 run osmo-stp_10.42.42.5(pid=30746): Launched 17:47:56.862282 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:57.403513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30748): Launched 17:47:57.705567 run osmo-msc_10.42.42.6(pid=30749): Launched 17:47:57.872554 run osmo-stp_10.42.42.5(pid=30746): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30746)] 17:47:57.998504 run osmo-stp_10.42.42.5(pid=30746): stdout: | (launched: 2022-12-10_17:47:56.693612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:58.125231 run osmo-stp_10.42.42.5(pid=30746): stderr: | 20221210174756864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174756864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174756864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174756865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174756865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174756865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174756865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:58.250099 run osmo-stp_10.42.42.5(pid=30746): stdout: | (launched: 2022-12-10_17:47:56.693612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:58.368788 run osmo-stp_10.42.42.5(pid=30746): stderr: | 20221210174756864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174756864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174756864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174756865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174756865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174756865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174756865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:58.511186 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30746): Process ended prematurely: osmo-stp_10.42.42.5(pid=30746) [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30746)] [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:47:58.520169 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 17:47:58.546668 run osmo-hlr_10.42.42.2(pid=30743): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30743)] 17:47:58.594311 run osmo-hlr_10.42.42.2(pid=30743): stdout: | (launched: 2022-12-10_17:47:55.761282) 17:47:58.643744 run osmo-hlr_10.42.42.2(pid=30743): stderr: | 20221210174755940 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174755940 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174755940 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174755940 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174755940 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174755940 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174755951 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174755960 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174755960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174755960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:58.712332 run osmo-msc_10.42.42.6(pid=30749): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30749)] 17:47:58.759471 run osmo-msc_10.42.42.6(pid=30749): stdout: | (launched: 2022-12-10_17:47:57.650374) 17:47:58.808373 run osmo-msc_10.42.42.6(pid=30749): stderr: | 20221210174757922 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174757922 DLGLOBAL DEBUG validating counter group 0x7f79f5d67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174757922 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174757922 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174757922 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174757923 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174757924 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174757926 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174757927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174757927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:58.857573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30742): Terminating (SIGTERM) 17:47:58.896890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30745): Terminating (SIGTERM) 17:47:58.936019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30748): Terminating (SIGTERM) 17:47:58.975596 --- ParallelTerminationStrategy: PID 30742 died... 17:47:58.994573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30742): Terminated: ok {rc=0} 17:47:59.038141 --- ParallelTerminationStrategy: PID 30745 died... 17:47:59.056569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30745): Terminated: ok {rc=0} 17:47:59.100454 --- ParallelTerminationStrategy: PID 30748 died... 17:47:59.118867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30748): Terminated: ok {rc=0} 17:47:59.203586 bus /sierra_3: Setting Powered False 17:48:00.300924 bus /sierra_3: Setting Powered False 17:48:01.423472 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:48:02.681850 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:48:02.688237 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:48:02.720555 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:48:02.746835 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:48:02.799920 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:48:02.831976 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:48:02.858007 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:48:03.408022 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:48:03.455737 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:03.466976 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:48:03.535539 tst mo_mt_call.py: using LAC 29592 17:48:03.654293 tst mo_mt_call.py: using RAC 12 17:48:03.773032 tst mo_mt_call.py: using CellId 29592 17:48:03.890036 tst mo_mt_call.py: using BVCI 29593 17:48:03.998108 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:04.009283 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:04.020292 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:04.031377 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:04.042462 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:04.053444 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:48:04.169885 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:48:04.287256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:04.787457 run create_hlr_db(pid=30754): Launched 17:48:04.910409 bus /sierra_2: Setting Powered False 17:48:05.974344 run create_hlr_db(pid=30754): Terminated: ok {rc=0} 17:48:06.419875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Launched 17:48:06.742219 run osmo-hlr_10.42.42.2(pid=30757): Launched 17:48:06.864908 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:07.414606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Launched 17:48:07.735577 run osmo-stp_10.42.42.5(pid=30760): Launched 17:48:07.858154 run osmo-msc_10.42.42.6: Starting osmo-msc 17:48:08.437940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30762): Launched 17:48:08.760652 run osmo-msc_10.42.42.6(pid=30763): Launched 17:48:08.941089 run osmo-stp_10.42.42.5(pid=30760): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30760)] 17:48:09.076614 run osmo-stp_10.42.42.5(pid=30760): stdout: | (launched: 2022-12-10_17:48:07.677693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:09.212810 run osmo-stp_10.42.42.5(pid=30760): stderr: | 20221210174807868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174807868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174807868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174807869 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174807869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174807869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174807869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:09.348452 run osmo-stp_10.42.42.5(pid=30760): stdout: | (launched: 2022-12-10_17:48:07.677693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:09.477099 run osmo-stp_10.42.42.5(pid=30760): stderr: | 20221210174807868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174807868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174807868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174807869 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174807869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174807869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174807869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:09.631269 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30760): Process ended prematurely: osmo-stp_10.42.42.5(pid=30760) [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30760)] [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:48:09.641041 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:48:09.669831 run osmo-hlr_10.42.42.2(pid=30757): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30757)] 17:48:09.720469 run osmo-hlr_10.42.42.2(pid=30757): stdout: | (launched: 2022-12-10_17:48:06.683201) 17:48:09.772670 run osmo-hlr_10.42.42.2(pid=30757): stderr: | 20221210174806880 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174806880 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174806880 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174806880 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174806880 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174806880 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174806892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174806900 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174806900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174806900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:09.845922 run osmo-msc_10.42.42.6(pid=30763): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30763)] 17:48:09.896473 run osmo-msc_10.42.42.6(pid=30763): stdout: | (launched: 2022-12-10_17:48:08.702269) 17:48:09.948635 run osmo-msc_10.42.42.6(pid=30763): stderr: | 20221210174809025 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174809025 DLGLOBAL DEBUG validating counter group 0x7f7e6ecc3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174809025 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174809025 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174809026 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174809026 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174809027 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174809028 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174809028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174809028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:48:10.001397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Terminating (SIGTERM) 17:48:10.043738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Terminating (SIGTERM) 17:48:10.086041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30762): Terminating (SIGTERM) 17:48:10.128624 --- ParallelTerminationStrategy: PID 30756 died... 17:48:10.148680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Terminated: ok {rc=0} 17:48:10.196084 --- ParallelTerminationStrategy: PID 30759 died... 17:48:10.215881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Terminated: ok {rc=0} 17:48:10.262778 --- ParallelTerminationStrategy: PID 30762 died... 17:48:10.282558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30762): Terminated: ok {rc=0} 17:48:10.370252 bus /sierra_3: Setting Powered False 17:48:11.469743 bus /sierra_3: Setting Powered False 17:48:12.585292 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:48:13.729058 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:13.741022 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:48:13.809705 tst mo_mt_call_osmux.py: using LAC 29593 17:48:13.935416 tst mo_mt_call_osmux.py: using RAC 13 17:48:14.060073 tst mo_mt_call_osmux.py: using CellId 29593 17:48:14.188193 tst mo_mt_call_osmux.py: using BVCI 29594 17:48:14.304165 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:14.316070 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:14.327669 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:14.339425 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:14.351371 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:14.363002 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:48:14.481331 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:48:14.597475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:15.060801 run create_hlr_db(pid=30765): Launched 17:48:15.183982 bus /sierra_2: Setting Powered False 17:48:16.245158 run create_hlr_db(pid=30765): Terminated: ok {rc=0} 17:48:16.670958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30767): Launched 17:48:16.993806 run osmo-hlr_10.42.42.2(pid=30768): Launched 17:48:17.213574 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:17.799167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30770): Launched 17:48:18.121770 run osmo-stp_10.42.42.5(pid=30771): Launched 17:48:18.245749 run osmo-msc_10.42.42.6: Starting osmo-msc 17:48:18.826308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30773): Launched 17:48:19.149044 run osmo-msc_10.42.42.6(pid=30774): Launched 17:48:19.328510 run osmo-stp_10.42.42.5(pid=30771): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30771)] 17:48:19.464458 run osmo-stp_10.42.42.5(pid=30771): stdout: | (launched: 2022-12-10_17:48:18.063237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:19.601478 run osmo-stp_10.42.42.5(pid=30771): stderr: | 20221210174818256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174818256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174818257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174818257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174818257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174818258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174818258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:19.736763 run osmo-stp_10.42.42.5(pid=30771): stdout: | (launched: 2022-12-10_17:48:18.063237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:19.865085 run osmo-stp_10.42.42.5(pid=30771): stderr: | 20221210174818256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174818256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174818257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174818257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174818257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174818258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174818258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:20.018284 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30771): Process ended prematurely: osmo-stp_10.42.42.5(pid=30771) [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30771)] [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:48:20.028173 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:48:20.057171 run osmo-hlr_10.42.42.2(pid=30768): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30768)] 17:48:20.107688 run osmo-hlr_10.42.42.2(pid=30768): stdout: | (launched: 2022-12-10_17:48:16.931222) 17:48:20.159856 run osmo-hlr_10.42.42.2(pid=30768): stderr: | 20221210174817130 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174817130 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174817130 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174817130 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174817130 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174817130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174817143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174817151 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174817151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174817152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:20.232532 run osmo-msc_10.42.42.6(pid=30774): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30774)] 17:48:20.282894 run osmo-msc_10.42.42.6(pid=30774): stdout: | (launched: 2022-12-10_17:48:19.090512) 17:48:20.335083 run osmo-msc_10.42.42.6(pid=30774): stderr: | 20221210174819413 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174819413 DLGLOBAL DEBUG validating counter group 0x7f9c1b2e0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174819413 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174819413 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174819413 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174819414 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174819415 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174819416 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174819416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174819416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:48:20.387490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30767): Terminating (SIGTERM) 17:48:20.429452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30770): Terminating (SIGTERM) 17:48:20.471654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30773): Terminating (SIGTERM) 17:48:20.514300 --- ParallelTerminationStrategy: PID 30767 died... 17:48:20.534144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30767): Terminated: ok {rc=0} 17:48:20.581079 --- ParallelTerminationStrategy: PID 30770 died... 17:48:20.600622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30770): Terminated: ok {rc=0} 17:48:20.646783 --- ParallelTerminationStrategy: PID 30773 died... 17:48:20.666341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30773): Terminated: ok {rc=0} 17:48:20.754213 bus /sierra_3: Setting Powered False 17:48:21.852776 bus /sierra_3: Setting Powered False 17:48:22.967677 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:48:24.221333 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:48:24.227578 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:48:24.259690 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:48:24.286605 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:48:24.339735 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:48:24.376033 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:48:24.403872 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:48:24.945633 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:48:24.994900 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:25.006105 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:48:25.075998 tst mo_mt_call.py: using LAC 29594 17:48:25.198595 tst mo_mt_call.py: using RAC 14 17:48:25.316693 tst mo_mt_call.py: using CellId 29594 17:48:25.436311 tst mo_mt_call.py: using BVCI 29595 17:48:25.547589 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:25.558723 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:25.569869 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:25.580726 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:25.591619 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:25.602453 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:48:25.719020 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:48:25.839655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:26.337225 run create_hlr_db(pid=30779): Launched 17:48:26.462766 bus /sierra_2: Setting Powered False 17:48:27.526467 run create_hlr_db(pid=30779): Terminated: ok {rc=0} 17:48:27.958023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30781): Launched 17:48:28.257933 run osmo-hlr_10.42.42.2(pid=30782): Launched 17:48:28.372131 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:28.886587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30784): Launched 17:48:29.185571 run osmo-stp_10.42.42.5(pid=30785): Launched 17:48:29.299900 run osmo-msc_10.42.42.6: Starting osmo-msc 17:48:29.842184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30787): Launched 17:48:30.142342 run osmo-msc_10.42.42.6(pid=30788): Launched 17:48:30.309164 run osmo-stp_10.42.42.5(pid=30785): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30785)] 17:48:30.435802 run osmo-stp_10.42.42.5(pid=30785): stdout: | (launched: 2022-12-10_17:48:29.130702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:30.561346 run osmo-stp_10.42.42.5(pid=30785): stderr: | 20221210174829301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174829301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174829301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174829302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174829302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174829302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174829302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:30.685819 run osmo-stp_10.42.42.5(pid=30785): stdout: | (launched: 2022-12-10_17:48:29.130702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:30.804311 run osmo-stp_10.42.42.5(pid=30785): stderr: | 20221210174829301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174829301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174829301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174829302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174829302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174829302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174829302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:30.963017 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30785): Process ended prematurely: osmo-stp_10.42.42.5(pid=30785) [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30785)] [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:48:30.972353 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:48:31.000406 run osmo-hlr_10.42.42.2(pid=30782): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30782)] 17:48:31.049122 run osmo-hlr_10.42.42.2(pid=30782): stdout: | (launched: 2022-12-10_17:48:28.203100) 17:48:31.099988 run osmo-hlr_10.42.42.2(pid=30782): stderr: | 20221210174828380 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174828381 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174828381 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174828381 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174828381 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174828381 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174828438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174828448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174828448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174828448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:31.171048 run osmo-msc_10.42.42.6(pid=30788): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30788)] 17:48:31.220563 run osmo-msc_10.42.42.6(pid=30788): stdout: | (launched: 2022-12-10_17:48:30.086952) 17:48:31.270956 run osmo-msc_10.42.42.6(pid=30788): stderr: | 20221210174830361 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174830361 DLGLOBAL DEBUG validating counter group 0x7f5a24ec6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174830361 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174830361 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174830362 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174830362 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174830363 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174830364 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174830364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174830364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:48:31.322217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30781): Terminating (SIGTERM) 17:48:31.363101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30784): Terminating (SIGTERM) 17:48:31.405620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30787): Terminating (SIGTERM) 17:48:31.447122 --- ParallelTerminationStrategy: PID 30781 died... 17:48:31.466349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30781): Terminated: ok {rc=0} 17:48:31.512560 --- ParallelTerminationStrategy: PID 30784 died... 17:48:31.532270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30784): Terminated: ok {rc=0} 17:48:31.577164 --- ParallelTerminationStrategy: PID 30787 died... 17:48:31.597157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30787): Terminated: ok {rc=0} 17:48:31.681428 bus /sierra_3: Setting Powered False 17:48:32.777529 bus /sierra_3: Setting Powered False 17:48:33.891575 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:48:35.041108 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:35.053295 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:48:35.126552 tst mo_mt_call_osmux.py: using LAC 29595 17:48:35.254536 tst mo_mt_call_osmux.py: using RAC 15 17:48:35.380780 tst mo_mt_call_osmux.py: using CellId 29595 17:48:35.507157 tst mo_mt_call_osmux.py: using BVCI 29596 17:48:35.624589 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:35.636064 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:35.647236 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:35.658736 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:35.670216 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:35.681718 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:48:35.802654 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:48:35.925281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:36.423822 run create_hlr_db(pid=30790): Launched 17:48:36.546962 bus /sierra_2: Setting Powered False 17:48:37.611162 run create_hlr_db(pid=30790): Terminated: ok {rc=0} 17:48:38.040341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30792): Launched 17:48:38.340517 run osmo-hlr_10.42.42.2(pid=30793): Launched 17:48:38.455056 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:38.971564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30795): Launched 17:48:39.272209 run osmo-stp_10.42.42.5(pid=30796): Launched 17:48:39.387201 run osmo-msc_10.42.42.6: Starting osmo-msc 17:48:39.937428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30798): Launched 17:48:40.238747 run osmo-msc_10.42.42.6(pid=30799): Launched 17:48:40.407740 run osmo-stp_10.42.42.5(pid=30796): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30796)] 17:48:40.534337 run osmo-stp_10.42.42.5(pid=30796): stdout: | (launched: 2022-12-10_17:48:39.217136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:40.661447 run osmo-stp_10.42.42.5(pid=30796): stderr: | 20221210174839387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174839388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174839388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174839388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174839389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174839389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174839389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:40.786219 run osmo-stp_10.42.42.5(pid=30796): stdout: | (launched: 2022-12-10_17:48:39.217136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:40.905551 run osmo-stp_10.42.42.5(pid=30796): stderr: | 20221210174839387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174839388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174839388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174839388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174839389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174839389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174839389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:41.048245 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30796): Process ended prematurely: osmo-stp_10.42.42.5(pid=30796) [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30796)] [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:48:41.057350 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:48:41.083907 run osmo-hlr_10.42.42.2(pid=30793): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30793)] 17:48:41.131517 run osmo-hlr_10.42.42.2(pid=30793): stdout: | (launched: 2022-12-10_17:48:38.285667) 17:48:41.181128 run osmo-hlr_10.42.42.2(pid=30793): stderr: | 20221210174838461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174838461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174838461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174838461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174838461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174838461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174838499 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174838509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174838509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174838509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:41.249426 run osmo-msc_10.42.42.6(pid=30799): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30799)] 17:48:41.296647 run osmo-msc_10.42.42.6(pid=30799): stdout: | (launched: 2022-12-10_17:48:40.183232) 17:48:41.345645 run osmo-msc_10.42.42.6(pid=30799): stderr: | 20221210174840456 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174840456 DLGLOBAL DEBUG validating counter group 0x7fcd6573ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174840456 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174840456 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174840456 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174840456 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174840458 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174840459 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174840459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174840460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:48:41.395151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30792): Terminating (SIGTERM) 17:48:41.434472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30795): Terminating (SIGTERM) 17:48:41.473778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30798): Terminating (SIGTERM) 17:48:41.513315 --- ParallelTerminationStrategy: PID 30792 died... 17:48:41.532299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30792): Terminated: ok {rc=0} 17:48:41.576464 --- ParallelTerminationStrategy: PID 30795 died... 17:48:41.595135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30795): Terminated: ok {rc=0} 17:48:41.638612 --- ParallelTerminationStrategy: PID 30798 died... 17:48:41.657131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30798): Terminated: ok {rc=0} 17:48:41.740114 bus /sierra_3: Setting Powered False 17:48:42.835143 bus /sierra_3: Setting Powered False 17:48:43.949670 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 17:48:45.197572 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:48:45.204118 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 17:48:45.238636 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 17:48:45.266475 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 17:48:45.319890 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 17:48:45.353467 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 17:48:45.381128 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 17:48:45.940768 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 17:48:45.998493 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:46.011425 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:48:46.067112 tst mo_mt_call.py: using LAC 29596 17:48:46.233292 tst mo_mt_call.py: using RAC 16 17:48:46.391877 tst mo_mt_call.py: using CellId 29596 17:48:46.513550 tst mo_mt_call.py: using BVCI 29597 17:48:46.633942 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:46.646105 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:46.659567 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:46.672510 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:46.688418 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:46.701108 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:48:46.827193 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:48:46.953871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:47.453677 run create_hlr_db(pid=30804): Launched 17:48:47.577268 bus /sierra_2: Setting Powered False 17:48:48.637485 run create_hlr_db(pid=30804): Terminated: ok {rc=0} 17:48:49.071995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30806): Launched 17:48:49.391269 run osmo-hlr_10.42.42.2(pid=30807): Launched 17:48:49.514705 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:50.067052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30809): Launched 17:48:50.387045 run osmo-stp_10.42.42.5(pid=30810): Launched 17:48:50.510288 run osmo-msc_10.42.42.6: Starting osmo-msc 17:48:51.089889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30812): Launched 17:48:51.410728 run osmo-msc_10.42.42.6(pid=30813): Launched 17:48:51.591907 run osmo-stp_10.42.42.5(pid=30810): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30810)] 17:48:51.726887 run osmo-stp_10.42.42.5(pid=30810): stdout: | (launched: 2022-12-10_17:48:50.328701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:51.863204 run osmo-stp_10.42.42.5(pid=30810): stderr: | 20221210174850518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174850518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174850518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174850519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174850521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174850521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174850521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:51.999013 run osmo-stp_10.42.42.5(pid=30810): stdout: | (launched: 2022-12-10_17:48:50.328701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:52.126936 run osmo-stp_10.42.42.5(pid=30810): stderr: | 20221210174850518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174850518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174850518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174850519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174850521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174850521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174850521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:52.279997 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30810): Process ended prematurely: osmo-stp_10.42.42.5(pid=30810) [trial-2377↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30810)] [trial-2377↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 17:48:52.289925 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:48:52.318549 run osmo-hlr_10.42.42.2(pid=30807): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30807)] 17:48:52.369092 run osmo-hlr_10.42.42.2(pid=30807): stdout: | (launched: 2022-12-10_17:48:49.333152) 17:48:52.420741 run osmo-hlr_10.42.42.2(pid=30807): stderr: | 20221210174849532 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174849532 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174849532 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174849532 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174849532 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174849532 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174849545 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174849553 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174849553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174849554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:52.492829 run osmo-msc_10.42.42.6(pid=30813): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30813)] 17:48:52.542999 run osmo-msc_10.42.42.6(pid=30813): stdout: | (launched: 2022-12-10_17:48:51.352273) 17:48:52.595102 run osmo-msc_10.42.42.6(pid=30813): stderr: | 20221210174851673 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174851673 DLGLOBAL DEBUG validating counter group 0x7f289a55dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174851673 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174851673 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174851674 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174851674 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174851675 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174851676 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174851676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174851676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:48:52.647107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30806): Terminating (SIGTERM) 17:48:52.689040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30809): Terminating (SIGTERM) 17:48:52.730937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30812): Terminating (SIGTERM) 17:48:52.773161 --- ParallelTerminationStrategy: PID 30806 died... 17:48:52.792919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30806): Terminated: ok {rc=0} 17:48:52.839775 --- ParallelTerminationStrategy: PID 30809 died... 17:48:52.859269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30809): Terminated: ok {rc=0} 17:48:52.905974 --- ParallelTerminationStrategy: PID 30812 died... 17:48:52.925658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30812): Terminated: ok {rc=0} 17:48:53.013965 bus /sierra_3: Setting Powered False 17:48:54.112925 bus /sierra_3: Setting Powered False 17:48:55.229094 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 17:48:56.377391 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:56.390097 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:48:56.445108 tst mo_mt_call_osmux.py: using LAC 29597 17:48:56.572863 tst mo_mt_call_osmux.py: using RAC 17 17:48:56.692181 tst mo_mt_call_osmux.py: using CellId 29597 17:48:56.811768 tst mo_mt_call_osmux.py: using BVCI 29598 17:48:56.921943 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:56.933452 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:56.944552 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:56.955844 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:56.966993 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:56.977981 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:48:57.095559 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:48:57.214599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:57.712673 run create_hlr_db(pid=30815): Launched 17:48:57.838118 bus /sierra_2: Setting Powered False 17:48:58.901273 run create_hlr_db(pid=30815): Terminated: ok {rc=0} 17:48:59.346507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30817): Launched 17:48:59.670223 run osmo-hlr_10.42.42.2(pid=30818): Launched 17:48:59.793398 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:00.348486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30820): Launched 17:49:00.669763 run osmo-stp_10.42.42.5(pid=30821): Launched 17:49:00.794047 run osmo-msc_10.42.42.6: Starting osmo-msc 17:49:01.471039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30823): Launched 17:49:01.841760 run osmo-msc_10.42.42.6(pid=30824): Launched 17:49:02.104500 run osmo-stp_10.42.42.5(pid=30821): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30821)] 17:49:02.396034 run osmo-stp_10.42.42.5(pid=30821): stdout: | (launched: 2022-12-10_17:49:00.610919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:02.532575 run osmo-stp_10.42.42.5(pid=30821): stderr: | 20221210174900804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174900804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174900804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174900805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174900805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174900805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174900805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:02.667512 run osmo-stp_10.42.42.5(pid=30821): stdout: | (launched: 2022-12-10_17:49:00.610919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:02.795488 run osmo-stp_10.42.42.5(pid=30821): stderr: | 20221210174900804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174900804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174900804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174900805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174900805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174900805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174900805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:02.948522 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30821): Process ended prematurely: osmo-stp_10.42.42.5(pid=30821) [trial-2377↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30821)] [trial-2377↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 17:49:02.958397 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 17:49:02.987471 run osmo-hlr_10.42.42.2(pid=30818): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30818)] 17:49:03.038270 run osmo-hlr_10.42.42.2(pid=30818): stdout: | (launched: 2022-12-10_17:48:59.610733) 17:49:03.090837 run osmo-hlr_10.42.42.2(pid=30818): stderr: | 20221210174859810 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174859810 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174859810 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174859810 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174859810 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174859810 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174859825 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174859833 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174859834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174859834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:03.163602 run osmo-msc_10.42.42.6(pid=30824): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30824)] 17:49:03.214123 run osmo-msc_10.42.42.6(pid=30824): stdout: | (launched: 2022-12-10_17:49:01.783261) 17:49:03.266320 run osmo-msc_10.42.42.6(pid=30824): stderr: | 20221210174902230 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174902230 DLGLOBAL DEBUG validating counter group 0x7fd6709b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174902230 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174902230 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174902230 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174902231 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174902232 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174902233 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174902233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174902233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:49:03.319107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30817): Terminating (SIGTERM) 17:49:03.361369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30820): Terminating (SIGTERM) 17:49:03.403585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30823): Terminating (SIGTERM) 17:49:03.446192 --- ParallelTerminationStrategy: PID 30817 died... 17:49:03.466081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30817): Terminated: ok {rc=0} 17:49:03.513570 --- ParallelTerminationStrategy: PID 30820 died... 17:49:03.533231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30820): Terminated: ok {rc=0} 17:49:03.580638 --- ParallelTerminationStrategy: PID 30823 died... 17:49:03.600260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30823): Terminated: ok {rc=0} 17:49:03.689279 bus /sierra_3: Setting Powered False 17:49:04.785114 bus /sierra_3: Setting Powered False 17:49:05.900627 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 emergency:trx-umtrx --------------------------------------------------------------------- 17:49:07.149374 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:49:07.154954 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:49:07.189519 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:49:07.217390 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 17:49:07.304142 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:49:07.337877 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:49:07.365506 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 17:49:07.949409 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2377 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 17:49:07.955511 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:07.966702 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 17:49:08.018570 tst emergency_mo_mt_call.py: using LAC 29598 17:49:08.133523 tst emergency_mo_mt_call.py: using RAC 18 17:49:08.255387 tst emergency_mo_mt_call.py: using CellId 29598 17:49:08.377378 tst emergency_mo_mt_call.py: using BVCI 29599 17:49:08.491439 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:08.502789 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:08.513997 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:08.525373 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:08.536411 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:08.547334 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:08.662108 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:08.777086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:09.233856 run create_hlr_db(pid=30829): Launched 17:49:09.354476 bus /sierra_2: Setting Powered False 17:49:10.413085 run create_hlr_db(pid=30829): Terminated: ok {rc=0} 17:49:10.844177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30831): Launched 17:49:11.159399 run osmo-hlr_10.42.42.2(pid=30832): Launched 17:49:11.279595 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:11.825726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30834): Launched 17:49:12.143386 run osmo-stp_10.42.42.5(pid=30835): Launched 17:49:12.275846 tst emergency_mo_mt_call.py: using MSISDN 7825 17:49:12.437526 run osmo-msc_10.42.42.6: Starting osmo-msc 17:49:13.005796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30837): Launched 17:49:13.321602 run osmo-msc_10.42.42.6(pid=30838): Launched 17:49:13.500367 run osmo-stp_10.42.42.5(pid=30835): ERR: Terminated: ERROR {rc=1} [trial-2377↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30835)] 17:49:13.634648 run osmo-stp_10.42.42.5(pid=30835): stdout: | (launched: 2022-12-10_17:49:12.085301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:13.769207 run osmo-stp_10.42.42.5(pid=30835): stderr: | 20221210174912278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174912279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174912279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174912279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174912280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174912280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174912280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:13.902866 run osmo-stp_10.42.42.5(pid=30835): stdout: | (launched: 2022-12-10_17:49:12.085301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:14.029039 run osmo-stp_10.42.42.5(pid=30835): stderr: | 20221210174912278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174912279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174912279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174912279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174912280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174912280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174912280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:14.179745 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30835): Process ended prematurely: osmo-stp_10.42.42.5(pid=30835) [trial-2377↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30835)] [trial-2377↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 17:49:14.188872 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 17:49:14.216567 run osmo-hlr_10.42.42.2(pid=30832): ERR: Terminated: ERROR {rc=237} [trial-2377↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30832)] 17:49:14.267127 run osmo-hlr_10.42.42.2(pid=30832): stdout: | (launched: 2022-12-10_17:49:11.101948) 17:49:14.319085 run osmo-hlr_10.42.42.2(pid=30832): stderr: | 20221210174911298 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174911298 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174911298 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174911298 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174911298 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174911298 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174911310 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174911319 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174911319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174911319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:14.391216 run osmo-msc_10.42.42.6(pid=30838): ERR: Terminated: ERROR {rc=2} [trial-2377↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30838)] 17:49:14.441257 run osmo-msc_10.42.42.6(pid=30838): stdout: | (launched: 2022-12-10_17:49:13.263634) 17:49:14.492836 run osmo-msc_10.42.42.6(pid=30838): stderr: | 20221210174913585 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174913585 DLGLOBAL DEBUG validating counter group 0x7f17cfd7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174913586 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174913586 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174913586 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174913586 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174913588 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174913588 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174913588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174913588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:49:14.544811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30831): Terminating (SIGTERM) 17:49:14.586820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30834): Terminating (SIGTERM) 17:49:14.628791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30837): Terminating (SIGTERM) 17:49:14.670886 --- ParallelTerminationStrategy: PID 30831 died... 17:49:14.690855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30831): Terminated: ok {rc=0} 17:49:14.737502 --- ParallelTerminationStrategy: PID 30834 died... 17:49:14.756833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30834): Terminated: ok {rc=0} 17:49:14.803233 --- ParallelTerminationStrategy: PID 30837 died... 17:49:14.822664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30837): Terminated: ok {rc=0} 17:49:14.909165 bus /sierra_3: Setting Powered False 17:49:16.019930 bus /sierra_3: Setting Powered False 17:49:17.162871 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 17:49:18.252427 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:18.264654 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 17:49:18.319748 tst emergency_preemptive_call.py: using LAC 29599 17:49:18.443653 tst emergency_preemptive_call.py: using RAC 19 17:49:18.560702 tst emergency_preemptive_call.py: using CellId 29599 17:49:18.687381 tst emergency_preemptive_call.py: using BVCI 29600 17:49:18.802546 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:18.813907 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:18.825062 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:18.836722 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:18.848631 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:18.860589 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:18.979483 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:19.094767 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:19.206416 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:19.323237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:19.815586 run create_hlr_db(pid=30840): Launched 17:49:19.936037 bus /sierra_2: Setting Powered False 17:49:20.998094 run create_hlr_db(pid=30840): Terminated: ok {rc=0} 17:49:21.437877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30842): Launched 17:49:21.756336 run osmo-hlr_10.42.42.2(pid=30843): Launched 17:49:21.870239 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:22.381793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30845): Launched 17:49:22.677511 run osmo-stp_10.42.42.5(pid=30846): Launched 17:49:22.799439 tst emergency_preemptive_call.py: using MSISDN 7826 17:49:22.948163 run osmo-msc_10.42.42.6: Starting osmo-msc 17:49:23.476504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30848): Launched 17:49:23.771976 run osmo-msc_10.42.42.6(pid=30849): Launched 17:49:23.936700 run osmo-stp_10.42.42.5(pid=30846): ERR: Terminated: ERROR {rc=1} [trial-2377↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30846)] 17:49:24.062440 run osmo-stp_10.42.42.5(pid=30846): stdout: | (launched: 2022-12-10_17:49:22.623120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:24.188044 run osmo-stp_10.42.42.5(pid=30846): stderr: | 20221210174922795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174922795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174922796 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174922796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174922797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174922797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174922797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:24.310956 run osmo-stp_10.42.42.5(pid=30846): stdout: | (launched: 2022-12-10_17:49:22.623120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:24.427885 run osmo-stp_10.42.42.5(pid=30846): stderr: | 20221210174922795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174922795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174922796 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174922796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174922797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174922797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174922797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:24.567533 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30846): Process ended prematurely: osmo-stp_10.42.42.5(pid=30846) [trial-2377↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30846)] [trial-2377↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 17:49:24.575825 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 17:49:24.601893 run osmo-hlr_10.42.42.2(pid=30843): ERR: Terminated: ERROR {rc=237} [trial-2377↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30843)] 17:49:24.649261 run osmo-hlr_10.42.42.2(pid=30843): stdout: | (launched: 2022-12-10_17:49:21.698107) 17:49:24.698399 run osmo-hlr_10.42.42.2(pid=30843): stderr: | 20221210174921873 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174921873 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174921873 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174921874 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174921874 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174921874 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174921886 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174921894 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174921895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174921895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:24.767281 run osmo-msc_10.42.42.6(pid=30849): ERR: Terminated: ERROR {rc=2} [trial-2377↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30849)] 17:49:24.814580 run osmo-msc_10.42.42.6(pid=30849): stdout: | (launched: 2022-12-10_17:49:23.717438) 17:49:24.863686 run osmo-msc_10.42.42.6(pid=30849): stderr: | 20221210174923988 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210174923989 DLGLOBAL DEBUG validating counter group 0x7f5823130c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210174923989 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210174923989 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210174923989 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210174923989 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210174923991 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210174923991 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210174923992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210174923992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:49:24.912990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30842): Terminating (SIGTERM) 17:49:24.952094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30845): Terminating (SIGTERM) 17:49:24.991372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30848): Terminating (SIGTERM) 17:49:25.030801 --- ParallelTerminationStrategy: PID 30842 died... 17:49:25.049820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30842): Terminated: ok {rc=0} 17:49:25.093245 --- ParallelTerminationStrategy: PID 30845 died... 17:49:25.111635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30845): Terminated: ok {rc=0} 17:49:25.155415 --- ParallelTerminationStrategy: PID 30848 died... 17:49:25.173873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30848): Terminated: ok {rc=0} 17:49:25.256617 bus /sierra_9: Setting Powered False 17:49:26.353921 bus /sierra_9: Setting Powered False 17:49:27.469816 bus /sierra_8: Setting Powered False 17:49:28.567286 bus /sierra_8: Setting Powered False 17:49:29.683528 bus /sierra_3: Setting Powered False 17:49:30.779212 bus /sierra_3: Setting Powered False 17:49:31.902372 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-umtrx --------------------------------------------------------------------- 17:49:33.172376 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:49:33.176506 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:49:33.208617 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 17:49:33.246525 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 17:49:33.332569 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:49:33.364494 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 17:49:33.402308 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 17:49:33.997153 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 17:49:34.050710 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:34.061995 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 17:49:34.111556 tst cs_paging_gprs_active.py: using LAC 29600 17:49:34.238799 tst cs_paging_gprs_active.py: using RAC 20 17:49:34.364068 tst cs_paging_gprs_active.py: using CellId 29600 17:49:34.489307 tst cs_paging_gprs_active.py: using BVCI 29601 17:49:34.606232 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:34.617350 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:34.628040 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:34.639544 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:34.650839 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:34.662087 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:34.673999 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:34.685459 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:34.696942 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:34.813302 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:34.931749 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:49:35.148930 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:49:35.469832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30855): Launched 17:49:35.751336 run iperf3-srv_10.42.42.10(pid=30856): Launched 17:49:35.874242 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:49:36.090640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:49:36.412160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30857): Launched 17:49:36.693266 run iperf3-srv_10.42.42.10(pid=30858): Launched 17:49:36.814824 tst cs_paging_gprs_active.py:38: start network... 17:49:37.031078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:37.530545 run create_hlr_db(pid=30859): Launched 17:49:37.655826 bus /sierra_2: Setting Powered False 17:49:38.718575 run create_hlr_db(pid=30859): Terminated: ok {rc=0} 17:49:39.164908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30861): Launched 17:49:39.486855 run osmo-hlr_10.42.42.2(pid=30862): Launched 17:49:39.611830 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:40.165519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30864): Launched 17:49:40.487588 run osmo-stp_10.42.42.5(pid=30865): Launched 17:49:40.613130 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:49:41.166013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30867): Launched 17:49:41.290737 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:49:41.561904 run patchelf(pid=30868): Launched 17:49:41.742744 run osmo-stp_10.42.42.5(pid=30865): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30865)] 17:49:41.879246 run osmo-stp_10.42.42.5(pid=30865): stdout: | (launched: 2022-12-10_17:49:40.428682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:42.016934 run osmo-stp_10.42.42.5(pid=30865): stderr: | 20221210174940621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174940621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174940621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174940622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174940622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174940622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174940622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:42.155443 run osmo-stp_10.42.42.5(pid=30865): stdout: | (launched: 2022-12-10_17:49:40.428682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:42.287672 run osmo-stp_10.42.42.5(pid=30865): stderr: | 20221210174940621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174940621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174940621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174940622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174940622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174940622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174940622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:42.444750 run patchelf(pid=30868): Terminating (SIGINT) 17:49:42.625124 run patchelf(pid=30868): Terminated: ok {rc=0} 17:49:42.754481 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30865): Process ended prematurely: osmo-stp_10.42.42.5(pid=30865) [trial-2377↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30865)] [trial-2377↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 17:49:42.764548 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 17:49:42.794097 run osmo-hlr_10.42.42.2(pid=30862): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30862)] 17:49:42.843764 run osmo-hlr_10.42.42.2(pid=30862): stdout: | (launched: 2022-12-10_17:49:39.427903) 17:49:42.895542 run osmo-hlr_10.42.42.2(pid=30862): stderr: | 20221210174939627 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174939627 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174939627 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174939627 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174939627 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174939627 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174939638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174939646 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174939647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174939647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:42.947629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30855): Terminating (SIGTERM) 17:49:42.989519 run iperf3-srv_10.42.42.10(pid=30856): Terminating (SIGTERM) 17:49:43.031217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30857): Terminating (SIGTERM) 17:49:43.073046 run iperf3-srv_10.42.42.10(pid=30858): Terminating (SIGTERM) 17:49:43.114774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30861): Terminating (SIGTERM) 17:49:43.156589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30864): Terminating (SIGTERM) 17:49:43.198301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30867): Terminating (SIGTERM) 17:49:43.240411 --- ParallelTerminationStrategy: PID 30855 died... 17:49:43.260445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30855): Terminated: ok {rc=0} 17:49:43.307435 --- ParallelTerminationStrategy: PID 30856 died... 17:49:43.326980 run iperf3-srv_10.42.42.10(pid=30856): Terminated {rc=256} 17:49:43.373117 --- ParallelTerminationStrategy: PID 30857 died... 17:49:43.392622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30857): Terminated: ok {rc=0} 17:49:43.439387 --- ParallelTerminationStrategy: PID 30858 died... 17:49:43.458911 run iperf3-srv_10.42.42.10(pid=30858): Terminated {rc=256} 17:49:43.505156 --- ParallelTerminationStrategy: PID 30861 died... 17:49:43.524587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30861): Terminated: ok {rc=0} 17:49:43.571022 --- ParallelTerminationStrategy: PID 30864 died... 17:49:43.590953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30864): Terminated: ok {rc=0} 17:49:43.637796 --- ParallelTerminationStrategy: PID 30867 died... 17:49:43.657628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30867): Terminated: ok {rc=0} 17:49:43.745062 bus /gobi_0: Setting Powered False 17:49:44.843558 bus /gobi_0: Setting Powered False 17:49:45.970918 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx iperf3.py ---------------------------------------------- 17:49:47.131179 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:47.144075 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 17:49:47.199592 tst iperf3.py: using LAC 29601 17:49:47.329793 tst iperf3.py: using RAC 21 17:49:47.457449 tst iperf3.py: using CellId 29601 17:49:47.577341 tst iperf3.py: using BVCI 29602 17:49:47.687280 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:47.698793 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:47.709479 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:47.720008 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:47.730631 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:47.741214 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:47.751784 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:47.762246 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:47.772797 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:47.890294 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:49:48.108619 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:49:48.431512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30869): Launched 17:49:48.714488 run iperf3-srv_10.42.42.10(pid=30870): Launched 17:49:48.836146 tst iperf3.py:8: start network... 17:49:49.052765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:49.551365 run create_hlr_db(pid=30871): Launched 17:49:49.677564 bus /gobi_6: Setting Powered False 17:49:50.741662 run create_hlr_db(pid=30871): Terminated: ok {rc=0} 17:49:51.173248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30873): Launched 17:49:51.476599 run osmo-hlr_10.42.42.2(pid=30874): Launched 17:49:51.592875 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:52.118268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30876): Launched 17:49:52.419912 run osmo-stp_10.42.42.5(pid=30877): Launched 17:49:52.534486 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:49:53.052741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30879): Launched 17:49:53.168464 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:49:53.423432 run patchelf(pid=30880): Launched 17:49:53.591897 run osmo-stp_10.42.42.5(pid=30877): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30877)] 17:49:53.719824 run osmo-stp_10.42.42.5(pid=30877): stdout: | (launched: 2022-12-10_17:49:52.364641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:53.850595 run osmo-stp_10.42.42.5(pid=30877): stderr: | 20221210174952534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174952534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174952534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174952535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174952537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174952537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174952537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:53.980057 run osmo-stp_10.42.42.5(pid=30877): stdout: | (launched: 2022-12-10_17:49:52.364641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:54.104119 run osmo-stp_10.42.42.5(pid=30877): stderr: | 20221210174952534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210174952534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210174952534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210174952535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210174952537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210174952537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210174952537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:54.251209 run patchelf(pid=30880): Terminating (SIGINT) 17:49:54.420405 run patchelf(pid=30880): Terminated: ok {rc=0} 17:49:54.541942 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30877): Process ended prematurely: osmo-stp_10.42.42.5(pid=30877) [trial-2377↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30877)] [trial-2377↪gprs:trx-umtrx↪iperf3.py:8] 17:49:54.551176 tst iperf3.py:8: Test FAILED (7.5 sec) 17:49:54.578068 run osmo-hlr_10.42.42.2(pid=30874): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30874)] 17:49:54.625676 run osmo-hlr_10.42.42.2(pid=30874): stdout: | (launched: 2022-12-10_17:49:51.420816) 17:49:54.674618 run osmo-hlr_10.42.42.2(pid=30874): stderr: | 20221210174951598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210174951598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210174951598 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210174951598 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210174951598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210174951598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210174951610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210174951619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210174951619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210174951619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:54.723841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30869): Terminating (SIGTERM) 17:49:54.763404 run iperf3-srv_10.42.42.10(pid=30870): Terminating (SIGTERM) 17:49:54.803186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30873): Terminating (SIGTERM) 17:49:54.842911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30876): Terminating (SIGTERM) 17:49:54.882617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30879): Terminating (SIGTERM) 17:49:54.922785 --- ParallelTerminationStrategy: PID 30869 died... 17:49:54.941865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30869): Terminated: ok {rc=0} 17:49:54.985729 --- ParallelTerminationStrategy: PID 30870 died... 17:49:55.004200 run iperf3-srv_10.42.42.10(pid=30870): Terminated {rc=256} 17:49:55.048257 --- ParallelTerminationStrategy: PID 30873 died... 17:49:55.066948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30873): Terminated: ok {rc=0} 17:49:55.110801 --- ParallelTerminationStrategy: PID 30876 died... 17:49:55.129474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30876): Terminated: ok {rc=0} 17:49:55.173292 --- ParallelTerminationStrategy: PID 30879 died... 17:49:55.191631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30879): Terminated: ok {rc=0} 17:49:55.274988 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 17:49:56.424248 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:56.436037 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 17:49:56.490092 tst iperf3m4.py: using LAC 29602 17:49:56.616830 tst iperf3m4.py: using RAC 22 17:49:56.741350 tst iperf3m4.py: using CellId 29602 17:49:56.866141 tst iperf3m4.py: using BVCI 29603 17:49:56.983237 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:56.994546 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:57.005564 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:57.016597 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:57.027668 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:57.038807 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:57.050137 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:57.061555 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:57.072631 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:57.192326 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:57.315650 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:57.435400 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:57.552046 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:49:57.755308 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:49:58.058188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30881): Launched 17:49:58.324242 run iperf3-srv_10.42.42.10(pid=30882): Launched 17:49:58.437937 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:49:58.639299 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:49:58.941844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30883): Launched 17:49:59.205440 run iperf3-srv_10.42.42.10(pid=30884): Launched 17:49:59.318751 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:49:59.519766 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:49:59.822390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30885): Launched 17:50:00.087479 run iperf3-srv_10.42.42.10(pid=30886): Launched 17:50:00.200934 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:50:00.403306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:00.706527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30887): Launched 17:50:00.997686 run iperf3-srv_10.42.42.10(pid=30888): Launched 17:50:01.139734 tst iperf3m4.py:8: start network... 17:50:01.367226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:01.889558 run create_hlr_db(pid=30892): Launched 17:50:02.038603 bus /gobi_6: Setting Powered False 17:50:03.098975 run create_hlr_db(pid=30892): Terminated: ok {rc=0} 17:50:03.537755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30895): Launched 17:50:03.862712 run osmo-hlr_10.42.42.2(pid=30896): Launched 17:50:03.985667 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:04.541081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30898): Launched 17:50:04.851846 run osmo-stp_10.42.42.5(pid=30899): Launched 17:50:04.966233 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:05.483915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30901): Launched 17:50:05.599549 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:05.853620 run patchelf(pid=30902): Launched 17:50:06.021535 run osmo-stp_10.42.42.5(pid=30899): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30899)] 17:50:06.149484 run osmo-stp_10.42.42.5(pid=30899): stdout: | (launched: 2022-12-10_17:50:04.796142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:06.278255 run osmo-stp_10.42.42.5(pid=30899): stderr: | 20221210175004963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175004963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175004963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175004963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175004964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175004964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175004964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:06.407787 run osmo-stp_10.42.42.5(pid=30899): stdout: | (launched: 2022-12-10_17:50:04.796142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:06.530701 run osmo-stp_10.42.42.5(pid=30899): stderr: | 20221210175004963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175004963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175004963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175004963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175004964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175004964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175004964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:06.676738 run patchelf(pid=30902): Terminating (SIGINT) 17:50:06.844825 run patchelf(pid=30902): Terminated: ok {rc=0} 17:50:06.965794 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30899): Process ended prematurely: osmo-stp_10.42.42.5(pid=30899) [trial-2377↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30899)] [trial-2377↪gprs:trx-umtrx↪iperf3m4.py:8] 17:50:06.975024 tst iperf3m4.py:8: Test FAILED (10.6 sec) 17:50:07.002226 run osmo-hlr_10.42.42.2(pid=30896): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30896)] 17:50:07.049793 run osmo-hlr_10.42.42.2(pid=30896): stdout: | (launched: 2022-12-10_17:50:03.803897) 17:50:07.099032 run osmo-hlr_10.42.42.2(pid=30896): stderr: | 20221210175003999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175003999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175003999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175003999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175003999 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175003999 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175004011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175004020 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175004020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175004020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:07.148808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30881): Terminating (SIGTERM) 17:50:07.188491 run iperf3-srv_10.42.42.10(pid=30882): Terminating (SIGTERM) 17:50:07.228071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30883): Terminating (SIGTERM) 17:50:07.267847 run iperf3-srv_10.42.42.10(pid=30884): Terminating (SIGTERM) 17:50:07.307761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30885): Terminating (SIGTERM) 17:50:07.347704 run iperf3-srv_10.42.42.10(pid=30886): Terminating (SIGTERM) 17:50:07.387457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30887): Terminating (SIGTERM) 17:50:07.427269 run iperf3-srv_10.42.42.10(pid=30888): Terminating (SIGTERM) 17:50:07.466893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30895): Terminating (SIGTERM) 17:50:07.506808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30898): Terminating (SIGTERM) 17:50:07.546625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30901): Terminating (SIGTERM) 17:50:07.586656 --- ParallelTerminationStrategy: PID 30881 died... 17:50:07.605850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30881): Terminated: ok {rc=0} 17:50:07.649883 --- ParallelTerminationStrategy: PID 30882 died... 17:50:07.668569 run iperf3-srv_10.42.42.10(pid=30882): Terminated {rc=256} 17:50:07.712312 --- ParallelTerminationStrategy: PID 30883 died... 17:50:07.730992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30883): Terminated: ok {rc=0} 17:50:07.775116 --- ParallelTerminationStrategy: PID 30884 died... 17:50:07.793826 run iperf3-srv_10.42.42.10(pid=30884): Terminated {rc=256} 17:50:07.837637 --- ParallelTerminationStrategy: PID 30885 died... 17:50:07.856278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30885): Terminated: ok {rc=0} 17:50:07.900048 --- ParallelTerminationStrategy: PID 30886 died... 17:50:07.918649 run iperf3-srv_10.42.42.10(pid=30886): Terminated {rc=256} 17:50:07.962285 --- ParallelTerminationStrategy: PID 30887 died... 17:50:07.980998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30887): Terminated: ok {rc=0} 17:50:08.025411 --- ParallelTerminationStrategy: PID 30888 died... 17:50:08.044051 run iperf3-srv_10.42.42.10(pid=30888): Terminated {rc=256} 17:50:08.087927 --- ParallelTerminationStrategy: PID 30895 died... 17:50:08.106665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30895): Terminated: ok {rc=0} 17:50:08.150544 --- ParallelTerminationStrategy: PID 30898 died... 17:50:08.169503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30898): Terminated: ok {rc=0} 17:50:08.214604 --- ParallelTerminationStrategy: PID 30901 died... 17:50:08.233474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30901): Terminated: ok {rc=0} 17:50:08.319257 bus /gobi_4: Setting Powered False 17:50:09.419021 bus /gobi_4: Setting Powered False 17:50:10.531607 bus /gobi_1: Setting Powered False 17:50:11.628440 bus /gobi_1: Setting Powered False 17:50:12.743026 bus /gobi_0: Setting Powered False 17:50:13.842656 bus /gobi_0: Setting Powered False 17:50:14.959685 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx ping.py ---------------------------------------------- 17:50:16.072565 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:16.089439 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 17:50:16.155016 tst ping.py: using LAC 29603 17:50:16.322784 tst ping.py: using RAC 23 17:50:16.489167 tst ping.py: using CellId 29603 17:50:16.618845 tst ping.py: using BVCI 29604 17:50:16.731006 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:16.741881 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:16.753692 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:16.764285 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:16.775364 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:16.786542 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:16.798624 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:16.809992 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:16.926180 tst ping.py:19: start network... 17:50:17.164730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:17.655667 run create_hlr_db(pid=30903): Launched 17:50:17.777479 bus /gobi_6: Setting Powered False 17:50:18.840100 run create_hlr_db(pid=30903): Terminated: ok {rc=0} 17:50:19.260283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30905): Launched 17:50:19.555494 run osmo-hlr_10.42.42.2(pid=30906): Launched 17:50:19.668307 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:20.176695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30908): Launched 17:50:20.472594 run osmo-stp_10.42.42.5(pid=30909): Launched 17:50:20.585231 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:21.091977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30911): Launched 17:50:21.205775 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:21.455505 run patchelf(pid=30912): Launched 17:50:21.620652 run osmo-stp_10.42.42.5(pid=30909): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30909)] 17:50:21.746394 run osmo-stp_10.42.42.5(pid=30909): stdout: | (launched: 2022-12-10_17:50:20.417184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:21.873274 run osmo-stp_10.42.42.5(pid=30909): stderr: | 20221210175020588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175020588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175020589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175020589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175020591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175020591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175020591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:22.000262 run osmo-stp_10.42.42.5(pid=30909): stdout: | (launched: 2022-12-10_17:50:20.417184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:22.121653 run osmo-stp_10.42.42.5(pid=30909): stderr: | 20221210175020588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175020588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175020589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175020589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175020591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175020591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175020591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:22.265128 run patchelf(pid=30912): Terminating (SIGINT) 17:50:22.430588 run patchelf(pid=30912): Terminated: ok {rc=0} 17:50:22.550982 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30909): Process ended prematurely: osmo-stp_10.42.42.5(pid=30909) [trial-2377↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30909)] [trial-2377↪gprs:trx-umtrx↪ping.py:22] 17:50:22.559810 tst ping.py:22: Test FAILED (6.5 sec) 17:50:22.586634 run osmo-hlr_10.42.42.2(pid=30906): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30906)] 17:50:22.633685 run osmo-hlr_10.42.42.2(pid=30906): stdout: | (launched: 2022-12-10_17:50:19.500761) 17:50:22.682734 run osmo-hlr_10.42.42.2(pid=30906): stderr: | 20221210175019674 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175019674 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175019674 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175019674 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175019674 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175019674 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175019695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175019705 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175019705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175019705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:22.731963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30905): Terminating (SIGTERM) 17:50:22.771604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30908): Terminating (SIGTERM) 17:50:22.811227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30911): Terminating (SIGTERM) 17:50:22.851303 --- ParallelTerminationStrategy: PID 30905 died... 17:50:22.870237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30905): Terminated: ok {rc=0} 17:50:22.914271 --- ParallelTerminationStrategy: PID 30908 died... 17:50:22.933066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30908): Terminated: ok {rc=0} 17:50:22.976867 --- ParallelTerminationStrategy: PID 30911 died... 17:50:22.995778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30911): Terminated: ok {rc=0} 17:50:23.079154 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 17:50:24.166059 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:24.178428 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 17:50:24.230222 tst ping_idle_ping.py: using LAC 29604 17:50:24.354136 tst ping_idle_ping.py: using RAC 24 17:50:24.480341 tst ping_idle_ping.py: using CellId 29604 17:50:24.609704 tst ping_idle_ping.py: using BVCI 29605 17:50:24.726050 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:24.737065 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:24.747938 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:24.758955 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:24.770030 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:24.781028 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:24.792093 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:24.803265 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:24.916928 tst ping_idle_ping.py:24: start network... 17:50:25.114955 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:25.574296 run create_hlr_db(pid=30913): Launched 17:50:25.696176 bus /gobi_6: Setting Powered False 17:50:26.756249 run create_hlr_db(pid=30913): Terminated: ok {rc=0} 17:50:27.168939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30915): Launched 17:50:27.464392 run osmo-hlr_10.42.42.2(pid=30916): Launched 17:50:27.577958 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:28.085774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30918): Launched 17:50:28.381302 run osmo-stp_10.42.42.5(pid=30919): Launched 17:50:28.493693 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:29.006110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30921): Launched 17:50:29.119703 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:29.369964 run patchelf(pid=30922): Launched 17:50:29.535455 run osmo-stp_10.42.42.5(pid=30919): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30919)] 17:50:29.661364 run osmo-stp_10.42.42.5(pid=30919): stdout: | (launched: 2022-12-10_17:50:28.326498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:29.788312 run osmo-stp_10.42.42.5(pid=30919): stderr: | 20221210175028498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175028498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175028498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175028498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175028499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175028499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175028499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:29.915597 run osmo-stp_10.42.42.5(pid=30919): stdout: | (launched: 2022-12-10_17:50:28.326498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:30.036698 run osmo-stp_10.42.42.5(pid=30919): stderr: | 20221210175028498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175028498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175028498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175028498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175028499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175028499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175028499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:30.180576 run patchelf(pid=30922): Terminating (SIGINT) 17:50:30.346718 run patchelf(pid=30922): Terminated: ok {rc=0} 17:50:30.466139 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30919): Process ended prematurely: osmo-stp_10.42.42.5(pid=30919) [trial-2377↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30919)] [trial-2377↪gprs:trx-umtrx↪ping_idle_ping.py:27] 17:50:30.474904 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 17:50:30.501437 run osmo-hlr_10.42.42.2(pid=30916): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30916)] 17:50:30.549532 run osmo-hlr_10.42.42.2(pid=30916): stdout: | (launched: 2022-12-10_17:50:27.409639) 17:50:30.598922 run osmo-hlr_10.42.42.2(pid=30916): stderr: | 20221210175027585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175027585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175027585 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175027585 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175027585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175027586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175027598 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175027606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175027607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175027607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:30.648542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30915): Terminating (SIGTERM) 17:50:30.687937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30918): Terminating (SIGTERM) 17:50:30.727206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30921): Terminating (SIGTERM) 17:50:30.766869 --- ParallelTerminationStrategy: PID 30915 died... 17:50:30.786039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30915): Terminated: ok {rc=0} 17:50:30.838000 --- ParallelTerminationStrategy: PID 30918 died... 17:50:30.869649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30918): Terminated: ok {rc=0} 17:50:30.914700 --- ParallelTerminationStrategy: PID 30921 died... 17:50:30.940770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30921): Terminated: ok {rc=0} 17:50:31.033289 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 17:50:32.354121 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:50:32.360520 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:50:32.393467 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:50:32.431675 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:50:32.517987 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:50:32.550171 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:50:32.588742 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:50:33.180130 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:50:33.228775 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:33.239776 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:50:33.289738 tst cs_paging_gprs_active.py: using LAC 29605 17:50:33.413485 tst cs_paging_gprs_active.py: using RAC 25 17:50:33.531869 tst cs_paging_gprs_active.py: using CellId 29605 17:50:33.648556 tst cs_paging_gprs_active.py: using BVCI 29606 17:50:33.757748 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:33.768412 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:33.779319 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:33.789879 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:33.800275 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:33.810831 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:33.821464 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:33.831817 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:33.842693 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:50:33.962011 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:50:34.080805 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:50:34.297759 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:34.620721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30926): Launched 17:50:34.900787 run iperf3-srv_10.42.42.10(pid=30927): Launched 17:50:35.022184 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:50:35.238800 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:35.561709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30928): Launched 17:50:35.842610 run iperf3-srv_10.42.42.10(pid=30929): Launched 17:50:35.963803 tst cs_paging_gprs_active.py:38: start network... 17:50:36.180342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:36.679609 run create_hlr_db(pid=30930): Launched 17:50:36.803923 bus /gobi_6: Setting Powered False 17:50:37.867124 run create_hlr_db(pid=30930): Terminated: ok {rc=0} 17:50:38.313731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30932): Launched 17:50:38.637164 run osmo-hlr_10.42.42.2(pid=30933): Launched 17:50:38.761365 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:39.314652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30935): Launched 17:50:39.637030 run osmo-stp_10.42.42.5(pid=30936): Launched 17:50:39.760787 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:40.316701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30938): Launched 17:50:40.440147 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:40.712701 run patchelf(pid=30939): Launched 17:50:40.891677 run osmo-stp_10.42.42.5(pid=30936): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30936)] 17:50:41.028657 run osmo-stp_10.42.42.5(pid=30936): stdout: | (launched: 2022-12-10_17:50:39.577635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:41.166659 run osmo-stp_10.42.42.5(pid=30936): stderr: | 20221210175039769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175039769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175039769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175039770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175039770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175039770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175039770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:41.304080 run osmo-stp_10.42.42.5(pid=30936): stdout: | (launched: 2022-12-10_17:50:39.577635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:41.436531 run osmo-stp_10.42.42.5(pid=30936): stderr: | 20221210175039769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175039769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175039769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175039770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175039770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175039770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175039770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:41.593260 run patchelf(pid=30939): Terminating (SIGINT) 17:50:41.773556 run patchelf(pid=30939): Terminated: ok {rc=0} 17:50:41.903221 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30936): Process ended prematurely: osmo-stp_10.42.42.5(pid=30936) [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30936)] [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:50:41.913485 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:50:41.942922 run osmo-hlr_10.42.42.2(pid=30933): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30933)] 17:50:41.993321 run osmo-hlr_10.42.42.2(pid=30933): stdout: | (launched: 2022-12-10_17:50:38.577250) 17:50:42.045340 run osmo-hlr_10.42.42.2(pid=30933): stderr: | 20221210175038776 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175038776 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175038776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175038776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175038776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175038776 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175038789 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175038797 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175038798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175038798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:42.097789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30926): Terminating (SIGTERM) 17:50:42.139926 run iperf3-srv_10.42.42.10(pid=30927): Terminating (SIGTERM) 17:50:42.182443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30928): Terminating (SIGTERM) 17:50:42.224596 run iperf3-srv_10.42.42.10(pid=30929): Terminating (SIGTERM) 17:50:42.266660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30932): Terminating (SIGTERM) 17:50:42.309023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30935): Terminating (SIGTERM) 17:50:42.351164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30938): Terminating (SIGTERM) 17:50:42.393442 --- ParallelTerminationStrategy: PID 30926 died... 17:50:42.413467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30926): Terminated: ok {rc=0} 17:50:42.460161 --- ParallelTerminationStrategy: PID 30927 died... 17:50:42.479708 run iperf3-srv_10.42.42.10(pid=30927): Terminated {rc=256} 17:50:42.526111 --- ParallelTerminationStrategy: PID 30928 died... 17:50:42.545435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30928): Terminated: ok {rc=0} 17:50:42.591810 --- ParallelTerminationStrategy: PID 30929 died... 17:50:42.611295 run iperf3-srv_10.42.42.10(pid=30929): Terminated {rc=256} 17:50:42.658155 --- ParallelTerminationStrategy: PID 30932 died... 17:50:42.677849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30932): Terminated: ok {rc=0} 17:50:42.723973 --- ParallelTerminationStrategy: PID 30935 died... 17:50:42.743544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30935): Terminated: ok {rc=0} 17:50:42.789686 --- ParallelTerminationStrategy: PID 30938 died... 17:50:42.809238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30938): Terminated: ok {rc=0} 17:50:42.897608 bus /gobi_0: Setting Powered False 17:50:43.995031 bus /gobi_0: Setting Powered False 17:50:45.112600 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:50:46.283324 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:46.298679 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:50:46.359652 tst iperf3.py: using LAC 29606 17:50:46.491479 tst iperf3.py: using RAC 26 17:50:46.624297 tst iperf3.py: using CellId 29606 17:50:46.785647 tst iperf3.py: using BVCI 29607 17:50:46.901626 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:46.912919 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:46.924128 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:46.935479 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:46.946594 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:46.958154 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:46.969931 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:46.981536 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:46.992818 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:50:47.107464 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:50:47.329575 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:47.652184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30940): Launched 17:50:47.931839 run iperf3-srv_10.42.42.10(pid=30941): Launched 17:50:48.052637 tst iperf3.py:8: start network... 17:50:48.268740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:48.764827 run create_hlr_db(pid=30942): Launched 17:50:48.887865 bus /gobi_6: Setting Powered False 17:50:49.950335 run create_hlr_db(pid=30942): Terminated: ok {rc=0} 17:50:50.376672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30944): Launched 17:50:50.675820 run osmo-hlr_10.42.42.2(pid=30945): Launched 17:50:50.790669 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:51.310663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30947): Launched 17:50:51.609972 run osmo-stp_10.42.42.5(pid=30948): Launched 17:50:51.723808 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:52.238854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30950): Launched 17:50:52.353375 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:52.605812 run patchelf(pid=30951): Launched 17:50:52.773227 run osmo-stp_10.42.42.5(pid=30948): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30948)] 17:50:52.899344 run osmo-stp_10.42.42.5(pid=30948): stdout: | (launched: 2022-12-10_17:50:51.554865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:53.027188 run osmo-stp_10.42.42.5(pid=30948): stderr: | 20221210175051723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175051723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175051724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175051724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175051725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175051725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175051725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:53.155116 run osmo-stp_10.42.42.5(pid=30948): stdout: | (launched: 2022-12-10_17:50:51.554865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:53.277895 run osmo-stp_10.42.42.5(pid=30948): stderr: | 20221210175051723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175051723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175051724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175051724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175051725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175051725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175051725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:53.422883 run patchelf(pid=30951): Terminating (SIGINT) 17:50:53.590049 run patchelf(pid=30951): Terminated: ok {rc=0} 17:50:53.710502 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30948): Process ended prematurely: osmo-stp_10.42.42.5(pid=30948) [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30948)] [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 17:50:53.719759 tst iperf3.py:8: Test FAILED (7.5 sec) 17:50:53.746683 run osmo-hlr_10.42.42.2(pid=30945): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30945)] 17:50:53.793630 run osmo-hlr_10.42.42.2(pid=30945): stdout: | (launched: 2022-12-10_17:50:50.620764) 17:50:53.842227 run osmo-hlr_10.42.42.2(pid=30945): stderr: | 20221210175050796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175050796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175050796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175050796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175050796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175050796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175050809 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175050818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175050818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175050818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:53.891268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30940): Terminating (SIGTERM) 17:50:53.930453 run iperf3-srv_10.42.42.10(pid=30941): Terminating (SIGTERM) 17:50:53.969598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30944): Terminating (SIGTERM) 17:50:54.008672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30947): Terminating (SIGTERM) 17:50:54.047720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30950): Terminating (SIGTERM) 17:50:54.087111 --- ParallelTerminationStrategy: PID 30940 died... 17:50:54.106013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30940): Terminated: ok {rc=0} 17:50:54.149811 --- ParallelTerminationStrategy: PID 30941 died... 17:50:54.168245 run iperf3-srv_10.42.42.10(pid=30941): Terminated {rc=256} 17:50:54.211858 --- ParallelTerminationStrategy: PID 30944 died... 17:50:54.230365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30944): Terminated: ok {rc=0} 17:50:54.274566 --- ParallelTerminationStrategy: PID 30947 died... 17:50:54.293327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30947): Terminated: ok {rc=0} 17:50:54.337119 --- ParallelTerminationStrategy: PID 30950 died... 17:50:54.355742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30950): Terminated: ok {rc=0} 17:50:54.440889 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:50:55.586347 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:55.597985 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:50:55.648883 tst iperf3m4.py: using LAC 29607 17:50:55.772076 tst iperf3m4.py: using RAC 27 17:50:55.890410 tst iperf3m4.py: using CellId 29607 17:50:56.008673 tst iperf3m4.py: using BVCI 29608 17:50:56.118711 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:56.129727 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:56.140395 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:56.150972 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:56.161520 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:56.172149 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:56.182943 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:56.193579 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:56.204671 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:50:56.319087 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:50:56.440818 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:50:56.559407 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:50:56.675642 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:50:56.892892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:57.214466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30952): Launched 17:50:57.494495 run iperf3-srv_10.42.42.10(pid=30953): Launched 17:50:57.615680 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:50:57.832758 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:58.155129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30954): Launched 17:50:58.434295 run iperf3-srv_10.42.42.10(pid=30955): Launched 17:50:58.555288 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:50:58.771956 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:59.093551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30956): Launched 17:50:59.372843 run iperf3-srv_10.42.42.10(pid=30957): Launched 17:50:59.493378 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:50:59.709109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:00.030015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30958): Launched 17:51:00.309335 run iperf3-srv_10.42.42.10(pid=30959): Launched 17:51:00.429795 tst iperf3m4.py:8: start network... 17:51:00.645377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:01.169418 run create_hlr_db(pid=30960): Launched 17:51:01.330608 bus /gobi_6: Setting Powered False 17:51:02.390657 run create_hlr_db(pid=30960): Terminated: ok {rc=0} 17:51:02.839240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30962): Launched 17:51:03.141250 run osmo-hlr_10.42.42.2(pid=30963): Launched 17:51:03.255054 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:03.789133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30965): Launched 17:51:04.090638 run osmo-stp_10.42.42.5(pid=30966): Launched 17:51:04.204397 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:04.721931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30968): Launched 17:51:04.837779 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:05.091488 run patchelf(pid=30969): Launched 17:51:05.259933 run osmo-stp_10.42.42.5(pid=30966): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30966)] 17:51:05.387995 run osmo-stp_10.42.42.5(pid=30966): stdout: | (launched: 2022-12-10_17:51:04.035281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:05.517962 run osmo-stp_10.42.42.5(pid=30966): stderr: | 20221210175104202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175104203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175104203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175104203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175104204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175104204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175104204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:05.647739 run osmo-stp_10.42.42.5(pid=30966): stdout: | (launched: 2022-12-10_17:51:04.035281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:05.771971 run osmo-stp_10.42.42.5(pid=30966): stderr: | 20221210175104202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175104203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175104203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175104203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175104204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175104204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175104204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:05.918741 run patchelf(pid=30969): Terminating (SIGINT) 17:51:06.088204 run patchelf(pid=30969): Terminated: ok {rc=0} 17:51:06.209975 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30966): Process ended prematurely: osmo-stp_10.42.42.5(pid=30966) [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30966)] [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 17:51:06.219616 tst iperf3m4.py:8: Test FAILED (10.7 sec) 17:51:06.247269 run osmo-hlr_10.42.42.2(pid=30963): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30963)] 17:51:06.295077 run osmo-hlr_10.42.42.2(pid=30963): stdout: | (launched: 2022-12-10_17:51:03.086128) 17:51:06.344384 run osmo-hlr_10.42.42.2(pid=30963): stderr: | 20221210175103259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175103259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175103259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175103259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175103259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175103259 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175103271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175103281 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175103281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175103281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:06.394320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30952): Terminating (SIGTERM) 17:51:06.433960 run iperf3-srv_10.42.42.10(pid=30953): Terminating (SIGTERM) 17:51:06.473660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30954): Terminating (SIGTERM) 17:51:06.513354 run iperf3-srv_10.42.42.10(pid=30955): Terminating (SIGTERM) 17:51:06.552886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30956): Terminating (SIGTERM) 17:51:06.592854 run iperf3-srv_10.42.42.10(pid=30957): Terminating (SIGTERM) 17:51:06.632444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30958): Terminating (SIGTERM) 17:51:06.672237 run iperf3-srv_10.42.42.10(pid=30959): Terminating (SIGTERM) 17:51:06.711797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30962): Terminating (SIGTERM) 17:51:06.751652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30965): Terminating (SIGTERM) 17:51:06.791319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30968): Terminating (SIGTERM) 17:51:06.832158 --- ParallelTerminationStrategy: PID 30952 died... 17:51:06.851581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30952): Terminated: ok {rc=0} 17:51:06.895576 --- ParallelTerminationStrategy: PID 30953 died... 17:51:06.914173 run iperf3-srv_10.42.42.10(pid=30953): Terminated {rc=256} 17:51:06.957631 --- ParallelTerminationStrategy: PID 30954 died... 17:51:06.976062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30954): Terminated: ok {rc=0} 17:51:07.019630 --- ParallelTerminationStrategy: PID 30955 died... 17:51:07.038092 run iperf3-srv_10.42.42.10(pid=30955): Terminated {rc=256} 17:51:07.081434 --- ParallelTerminationStrategy: PID 30956 died... 17:51:07.099806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30956): Terminated: ok {rc=0} 17:51:07.143257 --- ParallelTerminationStrategy: PID 30957 died... 17:51:07.161793 run iperf3-srv_10.42.42.10(pid=30957): Terminated {rc=256} 17:51:07.205312 --- ParallelTerminationStrategy: PID 30958 died... 17:51:07.223766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30958): Terminated: ok {rc=0} 17:51:07.267370 --- ParallelTerminationStrategy: PID 30959 died... 17:51:07.286043 run iperf3-srv_10.42.42.10(pid=30959): Terminated {rc=256} 17:51:07.330119 --- ParallelTerminationStrategy: PID 30962 died... 17:51:07.348688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30962): Terminated: ok {rc=0} 17:51:07.392409 --- ParallelTerminationStrategy: PID 30965 died... 17:51:07.411208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30965): Terminated: ok {rc=0} 17:51:07.454865 --- ParallelTerminationStrategy: PID 30968 died... 17:51:07.473387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30968): Terminated: ok {rc=0} 17:51:07.556050 bus /gobi_4: Setting Powered False 17:51:08.655324 bus /gobi_4: Setting Powered False 17:51:09.769901 bus /gobi_1: Setting Powered False 17:51:10.869306 bus /gobi_1: Setting Powered False 17:51:11.983682 bus /gobi_0: Setting Powered False 17:51:13.083846 bus /gobi_0: Setting Powered False 17:51:14.199760 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 17:51:15.302314 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:15.313848 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:51:15.365418 tst ping.py: using LAC 29608 17:51:15.482382 tst ping.py: using RAC 28 17:51:15.597564 tst ping.py: using CellId 29608 17:51:15.725291 tst ping.py: using BVCI 29609 17:51:15.846104 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:15.859107 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:15.871089 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:15.884153 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:15.899955 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:15.917993 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:15.935045 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:15.947086 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:16.068476 tst ping.py:19: start network... 17:51:16.302749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:16.776865 run create_hlr_db(pid=30970): Launched 17:51:16.938557 bus /gobi_6: Setting Powered False 17:51:17.997616 run create_hlr_db(pid=30970): Terminated: ok {rc=0} 17:51:18.429785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30972): Launched 17:51:18.748134 run osmo-hlr_10.42.42.2(pid=30973): Launched 17:51:18.869036 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:19.412141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30975): Launched 17:51:19.726547 run osmo-stp_10.42.42.5(pid=30976): Launched 17:51:19.846709 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:20.392238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30978): Launched 17:51:20.515936 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:20.782401 run patchelf(pid=30979): Launched 17:51:20.958354 run osmo-stp_10.42.42.5(pid=30976): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30976)] 17:51:21.091958 run osmo-stp_10.42.42.5(pid=30976): stdout: | (launched: 2022-12-10_17:51:19.669333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:21.227302 run osmo-stp_10.42.42.5(pid=30976): stderr: | 20221210175119863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175119863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175119863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175119864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175119864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175119864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175119864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:21.363056 run osmo-stp_10.42.42.5(pid=30976): stdout: | (launched: 2022-12-10_17:51:19.669333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:21.492374 run osmo-stp_10.42.42.5(pid=30976): stderr: | 20221210175119863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175119863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175119863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175119864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175119864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175119864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175119864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:21.646789 run patchelf(pid=30979): Terminating (SIGINT) 17:51:21.823109 run patchelf(pid=30979): Terminated: ok {rc=0} 17:51:21.950396 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30976): Process ended prematurely: osmo-stp_10.42.42.5(pid=30976) [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30976)] [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 17:51:21.960406 tst ping.py:22: Test FAILED (6.7 sec) 17:51:21.989212 run osmo-hlr_10.42.42.2(pid=30973): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30973)] 17:51:22.039280 run osmo-hlr_10.42.42.2(pid=30973): stdout: | (launched: 2022-12-10_17:51:18.690507) 17:51:22.091129 run osmo-hlr_10.42.42.2(pid=30973): stderr: | 20221210175118890 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175118890 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175118890 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175118890 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175118890 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175118891 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175118937 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175118947 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175118947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175118947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:22.143341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30972): Terminating (SIGTERM) 17:51:22.184932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30975): Terminating (SIGTERM) 17:51:22.226892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30978): Terminating (SIGTERM) 17:51:22.269241 --- ParallelTerminationStrategy: PID 30972 died... 17:51:22.289153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30972): Terminated: ok {rc=0} 17:51:22.336198 --- ParallelTerminationStrategy: PID 30975 died... 17:51:22.355696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30975): Terminated: ok {rc=0} 17:51:22.401729 --- ParallelTerminationStrategy: PID 30978 died... 17:51:22.421283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30978): Terminated: ok {rc=0} 17:51:22.509655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:51:23.595455 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:23.607684 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:51:23.662752 tst ping_idle_ping.py: using LAC 29609 17:51:23.792452 tst ping_idle_ping.py: using RAC 29 17:51:23.915874 tst ping_idle_ping.py: using CellId 29609 17:51:24.038426 tst ping_idle_ping.py: using BVCI 29610 17:51:24.153042 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:24.164344 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:24.175601 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:24.186928 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:24.198165 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:24.209463 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:24.220833 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:24.232373 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:24.347270 tst ping_idle_ping.py:24: start network... 17:51:24.546126 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:25.007141 run create_hlr_db(pid=30980): Launched 17:51:25.130834 bus /gobi_6: Setting Powered False 17:51:26.194066 run create_hlr_db(pid=30980): Terminated: ok {rc=0} 17:51:26.620253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30982): Launched 17:51:26.918240 run osmo-hlr_10.42.42.2(pid=30983): Launched 17:51:27.032768 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:27.542765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30985): Launched 17:51:27.839675 run osmo-stp_10.42.42.5(pid=30986): Launched 17:51:27.952053 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:28.464035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30988): Launched 17:51:28.578207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:28.829539 run patchelf(pid=30989): Launched 17:51:28.995940 run osmo-stp_10.42.42.5(pid=30986): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30986)] 17:51:29.123146 run osmo-stp_10.42.42.5(pid=30986): stdout: | (launched: 2022-12-10_17:51:27.784772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:29.250346 run osmo-stp_10.42.42.5(pid=30986): stderr: | 20221210175127957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175127958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175127958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175127958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175127959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175127959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175127959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:29.377685 run osmo-stp_10.42.42.5(pid=30986): stdout: | (launched: 2022-12-10_17:51:27.784772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:29.499429 run osmo-stp_10.42.42.5(pid=30986): stderr: | 20221210175127957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175127958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175127958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175127958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175127959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175127959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175127959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:29.643180 run patchelf(pid=30989): Terminating (SIGINT) 17:51:29.809918 run patchelf(pid=30989): Terminated: ok {rc=0} 17:51:29.929833 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30986): Process ended prematurely: osmo-stp_10.42.42.5(pid=30986) [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30986)] [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 17:51:29.938728 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 17:51:29.965390 run osmo-hlr_10.42.42.2(pid=30983): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30983)] 17:51:30.012910 run osmo-hlr_10.42.42.2(pid=30983): stdout: | (launched: 2022-12-10_17:51:26.863293) 17:51:30.062104 run osmo-hlr_10.42.42.2(pid=30983): stderr: | 20221210175127040 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175127040 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175127040 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175127040 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175127040 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175127040 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175127064 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175127074 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175127075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175127075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:30.112663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30982): Terminating (SIGTERM) 17:51:30.152398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30985): Terminating (SIGTERM) 17:51:30.191791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30988): Terminating (SIGTERM) 17:51:30.231539 --- ParallelTerminationStrategy: PID 30982 died... 17:51:30.250590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30982): Terminated: ok {rc=0} 17:51:30.294200 --- ParallelTerminationStrategy: PID 30985 died... 17:51:30.312801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30985): Terminated: ok {rc=0} 17:51:30.356129 --- ParallelTerminationStrategy: PID 30988 died... 17:51:30.374920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30988): Terminated: ok {rc=0} 17:51:30.459701 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:51:31.814390 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:51:31.823440 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:51:31.865689 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:51:31.914856 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:51:32.008756 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:51:32.044182 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:51:32.087929 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:51:32.672467 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:51:32.721826 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:32.732745 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:51:32.802398 tst cs_paging_gprs_active.py: using LAC 29610 17:51:32.923008 tst cs_paging_gprs_active.py: using RAC 30 17:51:33.045807 tst cs_paging_gprs_active.py: using CellId 29610 17:51:33.164716 tst cs_paging_gprs_active.py: using BVCI 29611 17:51:33.274166 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:33.284996 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:33.295661 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:33.306330 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:33.316802 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:33.327434 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:33.338185 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:33.348702 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:33.359989 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:51:33.478589 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:51:33.598155 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:51:33.817139 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:34.141629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30993): Launched 17:51:34.423121 run iperf3-srv_10.42.42.10(pid=30994): Launched 17:51:34.546572 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:51:34.764528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:35.088042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30995): Launched 17:51:35.369056 run iperf3-srv_10.42.42.10(pid=30996): Launched 17:51:35.492315 tst cs_paging_gprs_active.py:38: start network... 17:51:35.710194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:36.209903 run create_hlr_db(pid=30997): Launched 17:51:36.336009 bus /gobi_6: Setting Powered False 17:51:37.399608 run create_hlr_db(pid=30997): Terminated: ok {rc=0} 17:51:37.849894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30999): Launched 17:51:38.174601 run osmo-hlr_10.42.42.2(pid=31000): Launched 17:51:38.300212 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:38.855548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31002): Launched 17:51:39.178569 run osmo-stp_10.42.42.5(pid=31003): Launched 17:51:39.303103 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:39.858601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31005): Launched 17:51:39.985246 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:40.265404 run patchelf(pid=31006): Launched 17:51:40.447506 run osmo-stp_10.42.42.5(pid=31003): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31003)] 17:51:40.584525 run osmo-stp_10.42.42.5(pid=31003): stdout: | (launched: 2022-12-10_17:51:39.119759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:40.723469 run osmo-stp_10.42.42.5(pid=31003): stderr: | 20221210175139309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175139309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175139309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175139310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175139310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175139310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175139310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:40.862198 run osmo-stp_10.42.42.5(pid=31003): stdout: | (launched: 2022-12-10_17:51:39.119759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:40.995083 run osmo-stp_10.42.42.5(pid=31003): stderr: | 20221210175139309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175139309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175139309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175139310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175139310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175139310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175139310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:41.152498 run patchelf(pid=31006): Terminating (SIGINT) 17:51:41.332810 run patchelf(pid=31006): Terminated: ok {rc=0} 17:51:41.462790 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31003): Process ended prematurely: osmo-stp_10.42.42.5(pid=31003) [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31003)] [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:51:41.473018 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 17:51:41.502160 run osmo-hlr_10.42.42.2(pid=31000): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31000)] 17:51:41.552363 run osmo-hlr_10.42.42.2(pid=31000): stdout: | (launched: 2022-12-10_17:51:38.115541) 17:51:41.604218 run osmo-hlr_10.42.42.2(pid=31000): stderr: | 20221210175138312 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175138312 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175138313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175138313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175138313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175138313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175138325 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175138333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175138333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175138333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:41.656866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30993): Terminating (SIGTERM) 17:51:41.698945 run iperf3-srv_10.42.42.10(pid=30994): Terminating (SIGTERM) 17:51:41.740814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30995): Terminating (SIGTERM) 17:51:41.782958 run iperf3-srv_10.42.42.10(pid=30996): Terminating (SIGTERM) 17:51:41.824644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30999): Terminating (SIGTERM) 17:51:41.866511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31002): Terminating (SIGTERM) 17:51:41.908458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31005): Terminating (SIGTERM) 17:51:41.950510 --- ParallelTerminationStrategy: PID 30993 died... 17:51:41.970490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30993): Terminated: ok {rc=0} 17:51:42.017353 --- ParallelTerminationStrategy: PID 30994 died... 17:51:42.037040 run iperf3-srv_10.42.42.10(pid=30994): Terminated {rc=256} 17:51:42.083281 --- ParallelTerminationStrategy: PID 30995 died... 17:51:42.103051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30995): Terminated: ok {rc=0} 17:51:42.149334 --- ParallelTerminationStrategy: PID 30996 died... 17:51:42.168920 run iperf3-srv_10.42.42.10(pid=30996): Terminated {rc=256} 17:51:42.215171 --- ParallelTerminationStrategy: PID 30999 died... 17:51:42.234741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30999): Terminated: ok {rc=0} 17:51:42.281301 --- ParallelTerminationStrategy: PID 31002 died... 17:51:42.300699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31002): Terminated: ok {rc=0} 17:51:42.347342 --- ParallelTerminationStrategy: PID 31005 died... 17:51:42.367008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31005): Terminated: ok {rc=0} 17:51:42.454657 bus /gobi_0: Setting Powered False 17:51:43.553140 bus /gobi_0: Setting Powered False 17:51:44.668512 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:51:45.817822 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:45.839205 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:51:45.914504 tst iperf3.py: using LAC 29611 17:51:46.051490 tst iperf3.py: using RAC 31 17:51:46.179979 tst iperf3.py: using CellId 29611 17:51:46.307679 tst iperf3.py: using BVCI 29612 17:51:46.432398 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:46.444406 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:46.456600 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:46.469128 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:46.481927 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:46.494010 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:46.505967 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:46.517992 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:46.530358 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:51:46.652032 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:51:46.924237 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:47.236580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31007): Launched 17:51:47.526781 run iperf3-srv_10.42.42.10(pid=31008): Launched 17:51:47.650428 tst iperf3.py:8: start network... 17:51:47.868018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:48.368177 run create_hlr_db(pid=31009): Launched 17:51:48.491902 bus /gobi_6: Setting Powered False 17:51:49.556563 run create_hlr_db(pid=31009): Terminated: ok {rc=0} 17:51:49.987746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31011): Launched 17:51:50.290256 run osmo-hlr_10.42.42.2(pid=31012): Launched 17:51:50.406137 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:51.033559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31014): Launched 17:51:51.328100 run osmo-stp_10.42.42.5(pid=31015): Launched 17:51:51.439894 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:51.947519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31017): Launched 17:51:52.060337 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:52.309463 run patchelf(pid=31018): Launched 17:51:52.473481 run osmo-stp_10.42.42.5(pid=31015): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31015)] 17:51:52.598052 run osmo-stp_10.42.42.5(pid=31015): stdout: | (launched: 2022-12-10_17:51:51.274298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:52.724166 run osmo-stp_10.42.42.5(pid=31015): stderr: | 20221210175151444 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175151444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175151444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175151445 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175151445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175151445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175151445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:52.850872 run osmo-stp_10.42.42.5(pid=31015): stdout: | (launched: 2022-12-10_17:51:51.274298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:52.971459 run osmo-stp_10.42.42.5(pid=31015): stderr: | 20221210175151444 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175151444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175151444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175151445 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175151445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175151445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175151445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:53.114570 run patchelf(pid=31018): Terminating (SIGINT) 17:51:53.280899 run patchelf(pid=31018): Terminated: ok {rc=0} 17:51:53.400050 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31015): Process ended prematurely: osmo-stp_10.42.42.5(pid=31015) [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31015)] [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 17:51:53.409681 tst iperf3.py:8: Test FAILED (7.6 sec) 17:51:53.436571 run osmo-hlr_10.42.42.2(pid=31012): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31012)] 17:51:53.483635 run osmo-hlr_10.42.42.2(pid=31012): stdout: | (launched: 2022-12-10_17:51:50.235050) 17:51:53.532147 run osmo-hlr_10.42.42.2(pid=31012): stderr: | 20221210175150410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175150410 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175150410 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175150410 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175150410 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175150410 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175150422 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175150431 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175150431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175150431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:53.581153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31007): Terminating (SIGTERM) 17:51:53.620095 run iperf3-srv_10.42.42.10(pid=31008): Terminating (SIGTERM) 17:51:53.659115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31011): Terminating (SIGTERM) 17:51:53.698166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31014): Terminating (SIGTERM) 17:51:53.737124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31017): Terminating (SIGTERM) 17:51:53.776317 --- ParallelTerminationStrategy: PID 31007 died... 17:51:53.795133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31007): Terminated: ok {rc=0} 17:51:53.838540 --- ParallelTerminationStrategy: PID 31008 died... 17:51:53.856742 run iperf3-srv_10.42.42.10(pid=31008): Terminated {rc=256} 17:51:53.899980 --- ParallelTerminationStrategy: PID 31011 died... 17:51:53.918474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31011): Terminated: ok {rc=0} 17:51:53.961440 --- ParallelTerminationStrategy: PID 31014 died... 17:51:53.979744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31014): Terminated: ok {rc=0} 17:51:54.022679 --- ParallelTerminationStrategy: PID 31017 died... 17:51:54.040887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31017): Terminated: ok {rc=0} 17:51:54.124853 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:51:55.270961 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:55.282657 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:51:55.352443 tst iperf3m4.py: using LAC 29612 17:51:55.470550 tst iperf3m4.py: using RAC 32 17:51:55.585802 tst iperf3m4.py: using CellId 29612 17:51:55.709479 tst iperf3m4.py: using BVCI 29613 17:51:55.826335 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:55.837842 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:55.849085 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:55.860570 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:55.871960 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:55.883465 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:55.895033 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:55.906224 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:55.917896 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:51:56.034214 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:51:56.150210 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:51:56.263664 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:51:56.379269 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:51:56.576236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:56.872079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31019): Launched 17:51:57.128689 run iperf3-srv_10.42.42.10(pid=31020): Launched 17:51:57.239946 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:51:57.436213 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:57.731341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31021): Launched 17:51:57.988085 run iperf3-srv_10.42.42.10(pid=31022): Launched 17:51:58.098983 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:51:58.295075 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:58.590087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31023): Launched 17:51:58.849310 run iperf3-srv_10.42.42.10(pid=31024): Launched 17:51:58.960094 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:51:59.156219 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:59.452927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31025): Launched 17:51:59.710748 run iperf3-srv_10.42.42.10(pid=31026): Launched 17:51:59.821570 tst iperf3m4.py:8: start network... 17:52:00.016760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:00.475711 run create_hlr_db(pid=31027): Launched 17:52:00.598259 bus /gobi_6: Setting Powered False 17:52:01.672396 run create_hlr_db(pid=31027): Terminated: ok {rc=0} 17:52:02.169026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31029): Launched 17:52:02.495982 run osmo-hlr_10.42.42.2(pid=31030): Launched 17:52:02.616457 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:03.161488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31032): Launched 17:52:03.475418 run osmo-stp_10.42.42.5(pid=31033): Launched 17:52:03.595220 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:52:04.138196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31035): Launched 17:52:04.258616 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:52:04.524941 run patchelf(pid=31036): Launched 17:52:04.700458 run osmo-stp_10.42.42.5(pid=31033): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31033)] 17:52:04.834091 run osmo-stp_10.42.42.5(pid=31033): stdout: | (launched: 2022-12-10_17:52:03.418352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:04.969092 run osmo-stp_10.42.42.5(pid=31033): stderr: | 20221210175203604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175203605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175203605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175203605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175203606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175203606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175203606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:05.104128 run osmo-stp_10.42.42.5(pid=31033): stdout: | (launched: 2022-12-10_17:52:03.418352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:05.233527 run osmo-stp_10.42.42.5(pid=31033): stderr: | 20221210175203604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175203605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175203605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175203605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175203606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175203606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175203606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:05.386669 run patchelf(pid=31036): Terminating (SIGINT) 17:52:05.562613 run patchelf(pid=31036): Terminated: ok {rc=0} 17:52:05.689676 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31033): Process ended prematurely: osmo-stp_10.42.42.5(pid=31033) [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31033)] [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:52:05.699806 tst iperf3m4.py:8: Test FAILED (10.5 sec) 17:52:05.729091 run osmo-hlr_10.42.42.2(pid=31030): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31030)] 17:52:05.779064 run osmo-hlr_10.42.42.2(pid=31030): stdout: | (launched: 2022-12-10_17:52:02.438309) 17:52:05.830821 run osmo-hlr_10.42.42.2(pid=31030): stderr: | 20221210175202632 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175202632 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175202632 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175202632 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175202632 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175202632 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175202651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175202660 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175202660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175202660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:05.883014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31019): Terminating (SIGTERM) 17:52:05.925092 run iperf3-srv_10.42.42.10(pid=31020): Terminating (SIGTERM) 17:52:05.967150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31021): Terminating (SIGTERM) 17:52:06.009504 run iperf3-srv_10.42.42.10(pid=31022): Terminating (SIGTERM) 17:52:06.051117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31023): Terminating (SIGTERM) 17:52:06.093010 run iperf3-srv_10.42.42.10(pid=31024): Terminating (SIGTERM) 17:52:06.134701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31025): Terminating (SIGTERM) 17:52:06.176362 run iperf3-srv_10.42.42.10(pid=31026): Terminating (SIGTERM) 17:52:06.217987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31029): Terminating (SIGTERM) 17:52:06.259966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31032): Terminating (SIGTERM) 17:52:06.301692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31035): Terminating (SIGTERM) 17:52:06.343805 --- ParallelTerminationStrategy: PID 31019 died... 17:52:06.363637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31019): Terminated: ok {rc=0} 17:52:06.410470 --- ParallelTerminationStrategy: PID 31020 died... 17:52:06.429791 run iperf3-srv_10.42.42.10(pid=31020): Terminated {rc=256} 17:52:06.475768 --- ParallelTerminationStrategy: PID 31021 died... 17:52:06.495237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31021): Terminated: ok {rc=0} 17:52:06.541425 --- ParallelTerminationStrategy: PID 31022 died... 17:52:06.560875 run iperf3-srv_10.42.42.10(pid=31022): Terminated {rc=256} 17:52:06.607115 --- ParallelTerminationStrategy: PID 31023 died... 17:52:06.626620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31023): Terminated: ok {rc=0} 17:52:06.673964 --- ParallelTerminationStrategy: PID 31024 died... 17:52:06.693223 run iperf3-srv_10.42.42.10(pid=31024): Terminated {rc=256} 17:52:06.739280 --- ParallelTerminationStrategy: PID 31025 died... 17:52:06.758646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31025): Terminated: ok {rc=0} 17:52:06.804819 --- ParallelTerminationStrategy: PID 31026 died... 17:52:06.824550 run iperf3-srv_10.42.42.10(pid=31026): Terminated {rc=256} 17:52:06.870599 --- ParallelTerminationStrategy: PID 31029 died... 17:52:06.890032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31029): Terminated: ok {rc=0} 17:52:06.935930 --- ParallelTerminationStrategy: PID 31032 died... 17:52:06.955278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31032): Terminated: ok {rc=0} 17:52:07.001289 --- ParallelTerminationStrategy: PID 31035 died... 17:52:07.020634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31035): Terminated: ok {rc=0} 17:52:07.107513 bus /gobi_4: Setting Powered False 17:52:08.205965 bus /gobi_4: Setting Powered False 17:52:09.321228 bus /gobi_1: Setting Powered False 17:52:10.418800 bus /gobi_1: Setting Powered False 17:52:11.533916 bus /gobi_0: Setting Powered False 17:52:12.631214 bus /gobi_0: Setting Powered False 17:52:13.748443 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:52:14.852757 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:14.864641 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:52:14.936594 tst ping.py: using LAC 29613 17:52:15.058838 tst ping.py: using RAC 33 17:52:15.182314 tst ping.py: using CellId 29613 17:52:15.307786 tst ping.py: using BVCI 29614 17:52:15.422021 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:15.433350 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:15.444440 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:15.455741 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:15.467020 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:15.478458 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:15.489875 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:15.501328 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:15.618202 tst ping.py:19: start network... 17:52:15.827732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:16.323693 run create_hlr_db(pid=31039): Launched 17:52:16.481693 bus /gobi_6: Setting Powered False 17:52:17.544009 run create_hlr_db(pid=31039): Terminated: ok {rc=0} 17:52:17.977593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31041): Launched 17:52:18.287631 run osmo-hlr_10.42.42.2(pid=31042): Launched 17:52:18.405085 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:18.941894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31044): Launched 17:52:19.252363 run osmo-stp_10.42.42.5(pid=31045): Launched 17:52:19.370872 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:52:19.906108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31047): Launched 17:52:20.025293 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:52:20.287416 run patchelf(pid=31048): Launched 17:52:20.460839 run osmo-stp_10.42.42.5(pid=31045): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31045)] 17:52:20.593530 run osmo-stp_10.42.42.5(pid=31045): stdout: | (launched: 2022-12-10_17:52:19.195440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:20.727546 run osmo-stp_10.42.42.5(pid=31045): stderr: | 20221210175219386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175219387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175219387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175219387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175219388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175219388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175219388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:20.861564 run osmo-stp_10.42.42.5(pid=31045): stdout: | (launched: 2022-12-10_17:52:19.195440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:20.989446 run osmo-stp_10.42.42.5(pid=31045): stderr: | 20221210175219386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175219387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175219387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175219387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175219388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175219388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175219388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:21.140850 run patchelf(pid=31048): Terminating (SIGINT) 17:52:21.314683 run patchelf(pid=31048): Terminated: ok {rc=0} 17:52:21.440353 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31045): Process ended prematurely: osmo-stp_10.42.42.5(pid=31045) [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31045)] [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 17:52:21.450065 tst ping.py:22: Test FAILED (6.6 sec) 17:52:21.478352 run osmo-hlr_10.42.42.2(pid=31042): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31042)] 17:52:21.529070 run osmo-hlr_10.42.42.2(pid=31042): stdout: | (launched: 2022-12-10_17:52:18.230478) 17:52:21.581201 run osmo-hlr_10.42.42.2(pid=31042): stderr: | 20221210175218425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175218426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175218426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175218426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175218426 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175218426 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175218439 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175218449 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175218449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175218449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:21.633831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31041): Terminating (SIGTERM) 17:52:21.676146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31044): Terminating (SIGTERM) 17:52:21.718187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31047): Terminating (SIGTERM) 17:52:21.760526 --- ParallelTerminationStrategy: PID 31041 died... 17:52:21.780507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31041): Terminated: ok {rc=0} 17:52:21.826937 --- ParallelTerminationStrategy: PID 31044 died... 17:52:21.846439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31044): Terminated: ok {rc=0} 17:52:21.892716 --- ParallelTerminationStrategy: PID 31047 died... 17:52:21.912293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31047): Terminated: ok {rc=0} 17:52:21.999658 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:52:23.086910 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:23.098523 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:52:23.171490 tst ping_idle_ping.py: using LAC 29614 17:52:23.286394 tst ping_idle_ping.py: using RAC 34 17:52:23.408628 tst ping_idle_ping.py: using CellId 29614 17:52:23.529855 tst ping_idle_ping.py: using BVCI 29615 17:52:23.642326 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:23.653616 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:23.664724 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:23.676498 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:23.687925 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:23.699255 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:23.710969 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:23.722397 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:23.839371 tst ping_idle_ping.py:24: start network... 17:52:24.047631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:24.527325 run create_hlr_db(pid=31049): Launched 17:52:24.645213 bus /gobi_6: Setting Powered False 17:52:25.708041 run create_hlr_db(pid=31049): Terminated: ok {rc=0} 17:52:26.142561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31051): Launched 17:52:26.452925 run osmo-hlr_10.42.42.2(pid=31052): Launched 17:52:26.573415 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:27.112366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31054): Launched 17:52:27.426015 run osmo-stp_10.42.42.5(pid=31055): Launched 17:52:27.545489 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:52:28.082325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31057): Launched 17:52:28.201421 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:52:28.463661 run patchelf(pid=31058): Launched 17:52:28.637209 run osmo-stp_10.42.42.5(pid=31055): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31055)] 17:52:28.770426 run osmo-stp_10.42.42.5(pid=31055): stdout: | (launched: 2022-12-10_17:52:27.368861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:28.904404 run osmo-stp_10.42.42.5(pid=31055): stderr: | 20221210175227560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175227560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175227560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175227561 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175227561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175227561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175227561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:29.038192 run osmo-stp_10.42.42.5(pid=31055): stdout: | (launched: 2022-12-10_17:52:27.368861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:29.166303 run osmo-stp_10.42.42.5(pid=31055): stderr: | 20221210175227560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175227560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175227560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175227561 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175227561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175227561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175227561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:29.318144 run patchelf(pid=31058): Terminating (SIGINT) 17:52:29.493606 run patchelf(pid=31058): Terminated: ok {rc=0} 17:52:29.620367 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31055): Process ended prematurely: osmo-stp_10.42.42.5(pid=31055) [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31055)] [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:52:29.630029 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:52:29.658475 run osmo-hlr_10.42.42.2(pid=31052): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31052)] 17:52:29.708750 run osmo-hlr_10.42.42.2(pid=31052): stdout: | (launched: 2022-12-10_17:52:26.396312) 17:52:29.760556 run osmo-hlr_10.42.42.2(pid=31052): stderr: | 20221210175226591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175226591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175226591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175226591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175226591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175226591 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175226604 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175226613 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175226613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175226613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:29.812673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31051): Terminating (SIGTERM) 17:52:29.854455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31054): Terminating (SIGTERM) 17:52:29.896195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31057): Terminating (SIGTERM) 17:52:29.938541 --- ParallelTerminationStrategy: PID 31051 died... 17:52:29.958331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31051): Terminated: ok {rc=0} 17:52:30.005463 --- ParallelTerminationStrategy: PID 31054 died... 17:52:30.024870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31054): Terminated: ok {rc=0} 17:52:30.071165 --- ParallelTerminationStrategy: PID 31057 died... 17:52:30.090567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31057): Terminated: ok {rc=0} 17:52:30.178208 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:52:31.487532 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:52:31.494094 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:52:31.531687 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:52:31.572661 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:52:31.660326 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:52:31.705034 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:52:31.755438 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:52:32.327343 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:52:32.376434 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:32.387540 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:52:32.456820 tst cs_paging_gprs_active.py: using LAC 29615 17:52:32.573415 tst cs_paging_gprs_active.py: using RAC 35 17:52:32.689284 tst cs_paging_gprs_active.py: using CellId 29615 17:52:32.805520 tst cs_paging_gprs_active.py: using BVCI 29616 17:52:32.915789 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:32.926884 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:32.937855 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:32.949590 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:32.961253 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:32.972863 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:32.984391 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:32.995859 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:33.007526 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:52:33.125449 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:52:33.249200 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:52:33.463125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:33.782435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31062): Launched 17:52:34.059734 run iperf3-srv_10.42.42.10(pid=31063): Launched 17:52:34.180208 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:52:34.394056 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:34.701757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31064): Launched 17:52:34.960912 run iperf3-srv_10.42.42.10(pid=31065): Launched 17:52:35.073513 tst cs_paging_gprs_active.py:38: start network... 17:52:35.272529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:35.736476 run create_hlr_db(pid=31066): Launched 17:52:35.860001 bus /gobi_6: Setting Powered False 17:52:36.922752 run create_hlr_db(pid=31066): Terminated: ok {rc=0} 17:52:37.348214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31071): Launched 17:52:37.646544 run osmo-hlr_10.42.42.2(pid=31072): Launched 17:52:37.761996 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:38.271678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31074): Launched 17:52:38.568784 run osmo-stp_10.42.42.5(pid=31075): Launched 17:52:38.681846 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:52:39.191886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31077): Launched 17:52:39.306350 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:52:39.558441 run patchelf(pid=31078): Launched 17:52:39.724636 run osmo-stp_10.42.42.5(pid=31075): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31075)] 17:52:39.851205 run osmo-stp_10.42.42.5(pid=31075): stdout: | (launched: 2022-12-10_17:52:38.513681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:39.978338 run osmo-stp_10.42.42.5(pid=31075): stderr: | 20221210175238682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175238682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175238682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175238682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175238683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175238683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175238683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:40.105364 run osmo-stp_10.42.42.5(pid=31075): stdout: | (launched: 2022-12-10_17:52:38.513681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:40.227332 run osmo-stp_10.42.42.5(pid=31075): stderr: | 20221210175238682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175238682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175238682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175238682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175238683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175238683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175238683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:40.371417 run patchelf(pid=31078): Terminating (SIGINT) 17:52:40.537860 run patchelf(pid=31078): Terminated: ok {rc=0} 17:52:40.657479 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31075): Process ended prematurely: osmo-stp_10.42.42.5(pid=31075) [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31075)] [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:52:40.667072 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 17:52:40.694204 run osmo-hlr_10.42.42.2(pid=31072): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31072)] 17:52:40.741273 run osmo-hlr_10.42.42.2(pid=31072): stdout: | (launched: 2022-12-10_17:52:37.591571) 17:52:40.790101 run osmo-hlr_10.42.42.2(pid=31072): stderr: | 20221210175237767 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175237767 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175237767 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175237768 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175237768 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175237768 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175237780 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175237791 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175237791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175237791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:40.839423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31062): Terminating (SIGTERM) 17:52:40.878767 run iperf3-srv_10.42.42.10(pid=31063): Terminating (SIGTERM) 17:52:40.917939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31064): Terminating (SIGTERM) 17:52:40.957097 run iperf3-srv_10.42.42.10(pid=31065): Terminating (SIGTERM) 17:52:40.996111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31071): Terminating (SIGTERM) 17:52:41.035457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31074): Terminating (SIGTERM) 17:52:41.074881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31077): Terminating (SIGTERM) 17:52:41.114470 --- ParallelTerminationStrategy: PID 31062 died... 17:52:41.132878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31062): Terminated: ok {rc=0} 17:52:41.176494 --- ParallelTerminationStrategy: PID 31063 died... 17:52:41.194838 run iperf3-srv_10.42.42.10(pid=31063): Terminated {rc=256} 17:52:41.238461 --- ParallelTerminationStrategy: PID 31064 died... 17:52:41.256889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31064): Terminated: ok {rc=0} 17:52:41.300728 --- ParallelTerminationStrategy: PID 31065 died... 17:52:41.319157 run iperf3-srv_10.42.42.10(pid=31065): Terminated {rc=256} 17:52:41.362613 --- ParallelTerminationStrategy: PID 31071 died... 17:52:41.381071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31071): Terminated: ok {rc=0} 17:52:41.424779 --- ParallelTerminationStrategy: PID 31074 died... 17:52:41.443503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31074): Terminated: ok {rc=0} 17:52:41.487154 --- ParallelTerminationStrategy: PID 31077 died... 17:52:41.505721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31077): Terminated: ok {rc=0} 17:52:41.591635 bus /gobi_0: Setting Powered False 17:52:42.691737 bus /gobi_0: Setting Powered False 17:52:43.805920 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:52:44.949185 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:44.960661 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:52:45.030848 tst iperf3.py: using LAC 29616 17:52:45.148588 tst iperf3.py: using RAC 36 17:52:45.274185 tst iperf3.py: using CellId 29616 17:52:45.398749 tst iperf3.py: using BVCI 29617 17:52:45.514255 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:45.525848 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:45.537247 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:45.548659 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:45.559939 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:45.571389 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:45.582807 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:45.594060 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:45.605530 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:52:45.723748 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:52:45.967054 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:46.301763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31079): Launched 17:52:46.579490 run iperf3-srv_10.42.42.10(pid=31080): Launched 17:52:46.711790 tst iperf3.py:8: start network... 17:52:46.916026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:47.380742 run create_hlr_db(pid=31081): Launched 17:52:47.503493 bus /gobi_6: Setting Powered False 17:52:48.562926 run create_hlr_db(pid=31081): Terminated: ok {rc=0} 17:52:48.975535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31083): Launched 17:52:49.271872 run osmo-hlr_10.42.42.2(pid=31084): Launched 17:52:49.384100 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:49.909710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31086): Launched 17:52:50.206199 run osmo-stp_10.42.42.5(pid=31087): Launched 17:52:50.318708 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:52:50.827638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31089): Launched 17:52:50.941192 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:52:51.192016 run patchelf(pid=31090): Launched 17:52:51.357964 run osmo-stp_10.42.42.5(pid=31087): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31087)] 17:52:51.483399 run osmo-stp_10.42.42.5(pid=31087): stdout: | (launched: 2022-12-10_17:52:50.151236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:51.610470 run osmo-stp_10.42.42.5(pid=31087): stderr: | 20221210175250319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175250319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175250319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175250320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175250320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175250320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175250320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:51.738586 run osmo-stp_10.42.42.5(pid=31087): stdout: | (launched: 2022-12-10_17:52:50.151236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:51.860160 run osmo-stp_10.42.42.5(pid=31087): stderr: | 20221210175250319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175250319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175250319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175250320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175250320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175250320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175250320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:52.004185 run patchelf(pid=31090): Terminating (SIGINT) 17:52:52.171419 run patchelf(pid=31090): Terminated: ok {rc=0} 17:52:52.291586 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31087): Process ended prematurely: osmo-stp_10.42.42.5(pid=31087) [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31087)] [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 17:52:52.301193 tst iperf3.py:8: Test FAILED (7.4 sec) 17:52:52.328058 run osmo-hlr_10.42.42.2(pid=31084): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31084)] 17:52:52.375227 run osmo-hlr_10.42.42.2(pid=31084): stdout: | (launched: 2022-12-10_17:52:49.217333) 17:52:52.424214 run osmo-hlr_10.42.42.2(pid=31084): stderr: | 20221210175249394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175249394 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175249394 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175249394 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175249394 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175249394 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175249407 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175249415 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175249415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175249415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:52.473609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31079): Terminating (SIGTERM) 17:52:52.512877 run iperf3-srv_10.42.42.10(pid=31080): Terminating (SIGTERM) 17:52:52.552166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31083): Terminating (SIGTERM) 17:52:52.591535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31086): Terminating (SIGTERM) 17:52:52.630737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31089): Terminating (SIGTERM) 17:52:52.669899 --- ParallelTerminationStrategy: PID 31079 died... 17:52:52.688679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31079): Terminated: ok {rc=0} 17:52:52.732840 --- ParallelTerminationStrategy: PID 31080 died... 17:52:52.751683 run iperf3-srv_10.42.42.10(pid=31080): Terminated {rc=256} 17:52:52.795100 --- ParallelTerminationStrategy: PID 31083 died... 17:52:52.813707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31083): Terminated: ok {rc=0} 17:52:52.857068 --- ParallelTerminationStrategy: PID 31086 died... 17:52:52.875526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31086): Terminated: ok {rc=0} 17:52:52.918826 --- ParallelTerminationStrategy: PID 31089 died... 17:52:52.937390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31089): Terminated: ok {rc=0} 17:52:53.019770 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:52:54.168379 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:54.180613 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:52:54.254585 tst iperf3m4.py: using LAC 29617 17:52:54.380134 tst iperf3m4.py: using RAC 37 17:52:54.504170 tst iperf3m4.py: using CellId 29617 17:52:54.628692 tst iperf3m4.py: using BVCI 29618 17:52:54.744837 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:54.756177 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:54.767352 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:54.778918 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:54.790249 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:54.801969 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:54.813527 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:54.824818 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:54.836600 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:52:54.955131 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:52:55.075888 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:52:55.194262 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:52:55.311629 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:52:55.510447 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:55.809891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31091): Launched 17:52:56.068892 run iperf3-srv_10.42.42.10(pid=31092): Launched 17:52:56.180577 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:52:56.379636 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:56.678214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31093): Launched 17:52:56.936847 run iperf3-srv_10.42.42.10(pid=31094): Launched 17:52:57.048317 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:52:57.247914 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:57.545615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31095): Launched 17:52:57.805332 run iperf3-srv_10.42.42.10(pid=31096): Launched 17:52:57.917076 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:52:58.115306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:58.413576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31097): Launched 17:52:58.672427 run iperf3-srv_10.42.42.10(pid=31098): Launched 17:52:58.783771 tst iperf3m4.py:8: start network... 17:52:58.981098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:59.442609 run create_hlr_db(pid=31099): Launched 17:52:59.565628 bus /gobi_6: Setting Powered False 17:53:00.625097 run create_hlr_db(pid=31099): Terminated: ok {rc=0} 17:53:01.075735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31101): Launched 17:53:01.394160 run osmo-hlr_10.42.42.2(pid=31102): Launched 17:53:01.592242 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:02.233936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31104): Launched 17:53:02.542133 run osmo-stp_10.42.42.5(pid=31105): Launched 17:53:02.653865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:53:03.165224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31107): Launched 17:53:03.278605 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:53:03.528813 run patchelf(pid=31108): Launched 17:53:03.694020 run osmo-stp_10.42.42.5(pid=31105): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31105)] 17:53:03.820275 run osmo-stp_10.42.42.5(pid=31105): stdout: | (launched: 2022-12-10_17:53:02.487658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:03.947394 run osmo-stp_10.42.42.5(pid=31105): stderr: | 20221210175302654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175302654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175302654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175302655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175302655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175302655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175302655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:04.074290 run osmo-stp_10.42.42.5(pid=31105): stdout: | (launched: 2022-12-10_17:53:02.487658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:04.195986 run osmo-stp_10.42.42.5(pid=31105): stderr: | 20221210175302654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175302654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175302654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175302655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175302655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175302655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175302655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:04.339691 run patchelf(pid=31108): Terminating (SIGINT) 17:53:04.506458 run patchelf(pid=31108): Terminated: ok {rc=0} 17:53:04.626169 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31105): Process ended prematurely: osmo-stp_10.42.42.5(pid=31105) [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31105)] [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:53:04.635517 tst iperf3m4.py:8: Test FAILED (10.5 sec) 17:53:04.662614 run osmo-hlr_10.42.42.2(pid=31102): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31102)] 17:53:04.709521 run osmo-hlr_10.42.42.2(pid=31102): stdout: | (launched: 2022-12-10_17:53:01.334886) 17:53:04.758343 run osmo-hlr_10.42.42.2(pid=31102): stderr: | 20221210175301627 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175301627 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175301627 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175301627 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175301627 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175301627 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175301645 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175301661 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175301661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175301662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:04.807495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31091): Terminating (SIGTERM) 17:53:04.846629 run iperf3-srv_10.42.42.10(pid=31092): Terminating (SIGTERM) 17:53:04.885657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31093): Terminating (SIGTERM) 17:53:04.924761 run iperf3-srv_10.42.42.10(pid=31094): Terminating (SIGTERM) 17:53:04.963751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31095): Terminating (SIGTERM) 17:53:05.002792 run iperf3-srv_10.42.42.10(pid=31096): Terminating (SIGTERM) 17:53:05.041725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31097): Terminating (SIGTERM) 17:53:05.080903 run iperf3-srv_10.42.42.10(pid=31098): Terminating (SIGTERM) 17:53:05.120000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31101): Terminating (SIGTERM) 17:53:05.159232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31104): Terminating (SIGTERM) 17:53:05.198364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31107): Terminating (SIGTERM) 17:53:05.238000 --- ParallelTerminationStrategy: PID 31091 died... 17:53:05.256920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31091): Terminated: ok {rc=0} 17:53:05.300623 --- ParallelTerminationStrategy: PID 31092 died... 17:53:05.319110 run iperf3-srv_10.42.42.10(pid=31092): Terminated {rc=256} 17:53:05.362388 --- ParallelTerminationStrategy: PID 31093 died... 17:53:05.380794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31093): Terminated: ok {rc=0} 17:53:05.423971 --- ParallelTerminationStrategy: PID 31094 died... 17:53:05.442254 run iperf3-srv_10.42.42.10(pid=31094): Terminated {rc=256} 17:53:05.485500 --- ParallelTerminationStrategy: PID 31095 died... 17:53:05.503855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31095): Terminated: ok {rc=0} 17:53:05.547006 --- ParallelTerminationStrategy: PID 31096 died... 17:53:05.565407 run iperf3-srv_10.42.42.10(pid=31096): Terminated {rc=256} 17:53:05.608420 --- ParallelTerminationStrategy: PID 31097 died... 17:53:05.626879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31097): Terminated: ok {rc=0} 17:53:05.669932 --- ParallelTerminationStrategy: PID 31098 died... 17:53:05.688295 run iperf3-srv_10.42.42.10(pid=31098): Terminated {rc=256} 17:53:05.731330 --- ParallelTerminationStrategy: PID 31101 died... 17:53:05.749767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31101): Terminated: ok {rc=0} 17:53:05.793572 --- ParallelTerminationStrategy: PID 31104 died... 17:53:05.811984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31104): Terminated: ok {rc=0} 17:53:05.855222 --- ParallelTerminationStrategy: PID 31107 died... 17:53:05.873766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31107): Terminated: ok {rc=0} 17:53:05.956162 bus /gobi_4: Setting Powered False 17:53:07.053792 bus /gobi_4: Setting Powered False 17:53:08.169997 bus /gobi_1: Setting Powered False 17:53:09.267428 bus /gobi_1: Setting Powered False 17:53:10.381725 bus /gobi_0: Setting Powered False 17:53:11.479379 bus /gobi_0: Setting Powered False 17:53:12.595755 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:53:13.695345 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:13.706895 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:53:13.776750 tst ping.py: using LAC 29618 17:53:13.891503 tst ping.py: using RAC 38 17:53:14.006813 tst ping.py: using CellId 29618 17:53:14.120562 tst ping.py: using BVCI 29619 17:53:14.224773 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:14.235658 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:14.246313 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:14.256939 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:14.267631 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:14.278323 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:14.289005 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:14.299536 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:14.413348 tst ping.py:19: start network... 17:53:14.607473 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:15.058544 run create_hlr_db(pid=31109): Launched 17:53:15.177450 bus /gobi_6: Setting Powered False 17:53:16.235317 run create_hlr_db(pid=31109): Terminated: ok {rc=0} 17:53:16.658449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31111): Launched 17:53:17.036746 run osmo-hlr_10.42.42.2(pid=31140): Launched 17:53:17.298703 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:18.099069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31183): Launched 17:53:18.467783 run osmo-stp_10.42.42.5(pid=31224): Launched 17:53:18.731494 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:53:19.500703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31355): Launched 17:53:19.660942 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:53:19.940265 run patchelf(pid=31387): Launched 17:53:20.125123 run osmo-stp_10.42.42.5(pid=31224): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31224)] 17:53:20.250693 run osmo-stp_10.42.42.5(pid=31224): stdout: | (launched: 2022-12-10_17:53:18.401175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:20.379008 run osmo-stp_10.42.42.5(pid=31224): stderr: | 20221210175318738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175318738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175318738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175318739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175318739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175318739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175318739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:20.507647 run osmo-stp_10.42.42.5(pid=31224): stdout: | (launched: 2022-12-10_17:53:18.401175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:20.631636 run osmo-stp_10.42.42.5(pid=31224): stderr: | 20221210175318738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175318738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175318738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175318739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175318739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175318739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175318739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:20.778204 run patchelf(pid=31387): Terminating (SIGINT) 17:53:20.943864 run patchelf(pid=31387): Terminated: ok {rc=0} 17:53:21.064665 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31224): Process ended prematurely: osmo-stp_10.42.42.5(pid=31224) [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31224)] [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 17:53:21.074640 tst ping.py:22: Test FAILED (7.4 sec) 17:53:21.102582 run osmo-hlr_10.42.42.2(pid=31140): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31140)] 17:53:21.151623 run osmo-hlr_10.42.42.2(pid=31140): stdout: | (launched: 2022-12-10_17:53:16.972793) 17:53:21.202941 run osmo-hlr_10.42.42.2(pid=31140): stderr: | 20221210175317274 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175317274 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175317274 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175317274 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175317274 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175317274 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175317290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175317309 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175317310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175317310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:21.254008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31111): Terminating (SIGTERM) 17:53:21.295467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31183): Terminating (SIGTERM) 17:53:21.338350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31355): Terminating (SIGTERM) 17:53:21.381506 --- ParallelTerminationStrategy: PID 31111 died... 17:53:21.401476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31111): Terminated: ok {rc=0} 17:53:21.448510 --- ParallelTerminationStrategy: PID 31183 died... 17:53:21.468030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31183): Terminated: ok {rc=0} 17:53:21.512829 --- ParallelTerminationStrategy: PID 31355 died... 17:53:21.532493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31355): Terminated: ok {rc=0} 17:53:21.619498 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:53:22.708891 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:22.721459 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:53:22.793217 tst ping_idle_ping.py: using LAC 29619 17:53:22.909582 tst ping_idle_ping.py: using RAC 39 17:53:23.027974 tst ping_idle_ping.py: using CellId 29619 17:53:23.145290 tst ping_idle_ping.py: using BVCI 29620 17:53:23.255600 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:23.267515 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:23.279303 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:23.291610 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:23.303709 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:23.315888 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:23.328791 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:23.340493 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:23.457519 tst ping_idle_ping.py:24: start network... 17:53:23.657093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:24.119914 run create_hlr_db(pid=31391): Launched 17:53:24.277199 bus /gobi_6: Setting Powered False 17:53:25.337175 run create_hlr_db(pid=31391): Terminated: ok {rc=0} 17:53:25.759785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31393): Launched 17:53:26.074814 run osmo-hlr_10.42.42.2(pid=31394): Launched 17:53:26.304696 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:27.007465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31396): Launched 17:53:27.325764 run osmo-stp_10.42.42.5(pid=31397): Launched 17:53:27.565096 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:53:28.234471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31399): Launched 17:53:28.362550 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:53:28.618241 run patchelf(pid=31400): Launched 17:53:28.801715 run osmo-stp_10.42.42.5(pid=31397): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31397)] 17:53:28.930661 run osmo-stp_10.42.42.5(pid=31397): stdout: | (launched: 2022-12-10_17:53:27.267636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:29.063047 run osmo-stp_10.42.42.5(pid=31397): stderr: | 20221210175327596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175327596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175327601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175327601 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175327602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175327602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175327602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:29.195274 run osmo-stp_10.42.42.5(pid=31397): stdout: | (launched: 2022-12-10_17:53:27.267636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:29.319454 run osmo-stp_10.42.42.5(pid=31397): stderr: | 20221210175327596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175327596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175327601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175327601 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175327602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175327602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175327602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:29.467336 run patchelf(pid=31400): Terminating (SIGINT) 17:53:29.639049 run patchelf(pid=31400): Terminated: ok {rc=0} 17:53:29.762831 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31397): Process ended prematurely: osmo-stp_10.42.42.5(pid=31397) [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31397)] [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:53:29.773836 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 17:53:29.803311 run osmo-hlr_10.42.42.2(pid=31394): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31394)] 17:53:29.853513 run osmo-hlr_10.42.42.2(pid=31394): stdout: | (launched: 2022-12-10_17:53:26.019989) 17:53:29.905183 run osmo-hlr_10.42.42.2(pid=31394): stderr: | 20221210175326358 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175326358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175326358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175326358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175326358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175326358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175326375 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175326388 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175326397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175326397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:29.957305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31393): Terminating (SIGTERM) 17:53:30.002062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31396): Terminating (SIGTERM) 17:53:30.046146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31399): Terminating (SIGTERM) 17:53:30.091173 --- ParallelTerminationStrategy: PID 31393 died... 17:53:30.111107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31393): Terminated: ok {rc=0} 17:53:30.158945 --- ParallelTerminationStrategy: PID 31396 died... 17:53:30.179721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31396): Terminated: ok {rc=0} 17:53:30.226481 --- ParallelTerminationStrategy: PID 31399 died... 17:53:30.246201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31399): Terminated: ok {rc=0} 17:53:30.333191 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 17:53:31.700180 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:53:31.712488 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 17:53:31.760624 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 17:53:31.805590 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 17:53:31.908089 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 17:53:31.965631 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 17:53:32.020540 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 17:53:32.604658 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 17:53:32.673731 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:32.689394 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:53:32.752117 tst cs_paging_gprs_active.py: using LAC 29620 17:53:32.895287 tst cs_paging_gprs_active.py: using RAC 40 17:53:33.037518 tst cs_paging_gprs_active.py: using CellId 29620 17:53:33.167040 tst cs_paging_gprs_active.py: using BVCI 29621 17:53:33.287021 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:33.300052 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:33.312626 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:33.326996 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:33.341031 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:33.354940 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:33.368825 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:33.382313 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:33.397073 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:53:33.521428 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:53:33.645703 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:53:33.870921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:34.200283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31404): Launched 17:53:34.498129 run iperf3-srv_10.42.42.10(pid=31405): Launched 17:53:34.636917 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:53:34.858910 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:35.187413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31406): Launched 17:53:35.486236 run iperf3-srv_10.42.42.10(pid=31407): Launched 17:53:35.624612 tst cs_paging_gprs_active.py:38: start network... 17:53:35.846802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:36.363194 run create_hlr_db(pid=31408): Launched 17:53:36.528076 bus /gobi_6: Setting Powered False 17:53:37.594579 run create_hlr_db(pid=31408): Terminated: ok {rc=0} 17:53:38.058187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31410): Launched 17:53:38.406983 run osmo-hlr_10.42.42.2(pid=31411): Launched 17:53:38.656029 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:39.327547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31413): Launched 17:53:39.672562 run osmo-stp_10.42.42.5(pid=31414): Launched 17:53:39.930625 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:53:40.542309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31416): Launched 17:53:40.657983 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:53:40.913734 run patchelf(pid=31417): Launched 17:53:41.081366 run osmo-stp_10.42.42.5(pid=31414): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31414)] 17:53:41.209958 run osmo-stp_10.42.42.5(pid=31414): stdout: | (launched: 2022-12-10_17:53:39.607747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:41.339433 run osmo-stp_10.42.42.5(pid=31414): stderr: | 20221210175339903 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175339903 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175339904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175339904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175339904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175339913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175339913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:41.468435 run osmo-stp_10.42.42.5(pid=31414): stdout: | (launched: 2022-12-10_17:53:39.607747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:41.592647 run osmo-stp_10.42.42.5(pid=31414): stderr: | 20221210175339903 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175339903 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175339904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175339904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175339904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175339913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175339913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:41.739742 run patchelf(pid=31417): Terminating (SIGINT) 17:53:41.908391 run patchelf(pid=31417): Terminated: ok {rc=0} 17:53:42.029845 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31414): Process ended prematurely: osmo-stp_10.42.42.5(pid=31414) [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31414)] [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 17:53:42.039160 tst cs_paging_gprs_active.py:38: Test FAILED (9.4 sec) 17:53:42.066606 run osmo-hlr_10.42.42.2(pid=31411): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31411)] 17:53:42.114530 run osmo-hlr_10.42.42.2(pid=31411): stdout: | (launched: 2022-12-10_17:53:38.341111) 17:53:42.163686 run osmo-hlr_10.42.42.2(pid=31411): stderr: | 20221210175338648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175338648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175338648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175338648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175338648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175338648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175338668 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175338681 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175338682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175338682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:42.213629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31404): Terminating (SIGTERM) 17:53:42.253614 run iperf3-srv_10.42.42.10(pid=31405): Terminating (SIGTERM) 17:53:42.293493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31406): Terminating (SIGTERM) 17:53:42.333471 run iperf3-srv_10.42.42.10(pid=31407): Terminating (SIGTERM) 17:53:42.373387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31410): Terminating (SIGTERM) 17:53:42.413451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31413): Terminating (SIGTERM) 17:53:42.453411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31416): Terminating (SIGTERM) 17:53:42.493691 --- ParallelTerminationStrategy: PID 31404 died... 17:53:42.512850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31404): Terminated: ok {rc=0} 17:53:42.557109 --- ParallelTerminationStrategy: PID 31405 died... 17:53:42.575679 run iperf3-srv_10.42.42.10(pid=31405): Terminated {rc=256} 17:53:42.619375 --- ParallelTerminationStrategy: PID 31406 died... 17:53:42.637999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31406): Terminated: ok {rc=0} 17:53:42.681710 --- ParallelTerminationStrategy: PID 31407 died... 17:53:42.700625 run iperf3-srv_10.42.42.10(pid=31407): Terminated {rc=256} 17:53:42.744461 --- ParallelTerminationStrategy: PID 31410 died... 17:53:42.763196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31410): Terminated: ok {rc=0} 17:53:42.807568 --- ParallelTerminationStrategy: PID 31413 died... 17:53:42.826224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31413): Terminated: ok {rc=0} 17:53:42.870041 --- ParallelTerminationStrategy: PID 31416 died... 17:53:42.888647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31416): Terminated: ok {rc=0} 17:53:42.971948 bus /gobi_0: Setting Powered False 17:53:44.067198 bus /gobi_0: Setting Powered False 17:53:45.183261 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 17:53:46.329436 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:46.342391 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:53:46.398964 tst iperf3.py: using LAC 29621 17:53:46.530222 tst iperf3.py: using RAC 41 17:53:46.684810 tst iperf3.py: using CellId 29621 17:53:46.813805 tst iperf3.py: using BVCI 29622 17:53:46.974854 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:46.987511 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:46.999488 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:47.011981 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:47.024156 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:47.036266 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:47.048840 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:47.061275 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:47.073452 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:53:47.190175 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:53:47.394427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:47.698070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31418): Launched 17:53:47.963862 run iperf3-srv_10.42.42.10(pid=31419): Launched 17:53:48.078519 tst iperf3.py:8: start network... 17:53:48.281625 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:48.750415 run create_hlr_db(pid=31420): Launched 17:53:48.873770 bus /gobi_6: Setting Powered False 17:53:49.933987 run create_hlr_db(pid=31420): Terminated: ok {rc=0} 17:53:50.375758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31422): Launched 17:53:50.698104 run osmo-hlr_10.42.42.2(pid=31423): Launched 17:53:50.821721 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:51.379381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31425): Launched 17:53:51.701392 run osmo-stp_10.42.42.5(pid=31426): Launched 17:53:51.826936 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:53:52.382513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31428): Launched 17:53:52.507479 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:53:52.780399 run patchelf(pid=31429): Launched 17:53:52.959646 run osmo-stp_10.42.42.5(pid=31426): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31426)] 17:53:53.096427 run osmo-stp_10.42.42.5(pid=31426): stdout: | (launched: 2022-12-10_17:53:51.642752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:53.234940 run osmo-stp_10.42.42.5(pid=31426): stderr: | 20221210175351835 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175351835 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175351836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175351836 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175351836 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175351837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175351837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:53.373560 run osmo-stp_10.42.42.5(pid=31426): stdout: | (launched: 2022-12-10_17:53:51.642752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:53.505951 run osmo-stp_10.42.42.5(pid=31426): stderr: | 20221210175351835 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175351835 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175351836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175351836 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175351836 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175351837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175351837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:53.662977 run patchelf(pid=31429): Terminating (SIGINT) 17:53:53.843964 run patchelf(pid=31429): Terminated: ok {rc=0} 17:53:53.974252 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31426): Process ended prematurely: osmo-stp_10.42.42.5(pid=31426) [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31426)] [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 17:53:53.984416 tst iperf3.py:8: Test FAILED (7.7 sec) 17:53:54.013935 run osmo-hlr_10.42.42.2(pid=31423): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31423)] 17:53:54.064774 run osmo-hlr_10.42.42.2(pid=31423): stdout: | (launched: 2022-12-10_17:53:50.638939) 17:53:54.117104 run osmo-hlr_10.42.42.2(pid=31423): stderr: | 20221210175350840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175350840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175350840 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175350840 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175350840 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175350840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175350851 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175350859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175350859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175350860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:54.170014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31418): Terminating (SIGTERM) 17:53:54.212372 run iperf3-srv_10.42.42.10(pid=31419): Terminating (SIGTERM) 17:53:54.254678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31422): Terminating (SIGTERM) 17:53:54.297237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31425): Terminating (SIGTERM) 17:53:54.339643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31428): Terminating (SIGTERM) 17:53:54.381926 --- ParallelTerminationStrategy: PID 31418 died... 17:53:54.402317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31418): Terminated: ok {rc=0} 17:53:54.449323 --- ParallelTerminationStrategy: PID 31419 died... 17:53:54.468936 run iperf3-srv_10.42.42.10(pid=31419): Terminated {rc=256} 17:53:54.515458 --- ParallelTerminationStrategy: PID 31422 died... 17:53:54.535088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31422): Terminated: ok {rc=0} 17:53:54.581483 --- ParallelTerminationStrategy: PID 31425 died... 17:53:54.600928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31425): Terminated: ok {rc=0} 17:53:54.647530 --- ParallelTerminationStrategy: PID 31428 died... 17:53:54.667221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31428): Terminated: ok {rc=0} 17:53:54.756541 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 17:53:55.907537 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:55.920101 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:53:55.973321 tst iperf3m4.py: using LAC 29622 17:53:56.099260 tst iperf3m4.py: using RAC 42 17:53:56.226068 tst iperf3m4.py: using CellId 29622 17:53:56.345620 tst iperf3m4.py: using BVCI 29623 17:53:56.456588 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:56.468181 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:56.479559 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:56.491597 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:56.503391 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:56.515262 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:56.527203 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:56.538914 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:56.550753 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:53:56.669486 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:53:56.792228 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:53:56.911002 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:53:57.027371 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:53:57.230004 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:57.533124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31430): Launched 17:53:57.797024 run iperf3-srv_10.42.42.10(pid=31431): Launched 17:53:57.911354 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:53:58.112850 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:58.416225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31432): Launched 17:53:58.680704 run iperf3-srv_10.42.42.10(pid=31433): Launched 17:53:58.794449 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:53:58.995371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:59.298040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31434): Launched 17:53:59.562796 run iperf3-srv_10.42.42.10(pid=31435): Launched 17:53:59.678256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:53:59.879012 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:54:00.181608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31436): Launched 17:54:00.445540 run iperf3-srv_10.42.42.10(pid=31437): Launched 17:54:00.561573 tst iperf3m4.py:8: start network... 17:54:00.763243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:01.240262 run create_hlr_db(pid=31440): Launched 17:54:01.397754 bus /gobi_6: Setting Powered False 17:54:02.457906 run create_hlr_db(pid=31440): Terminated: ok {rc=0} 17:54:02.897120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31442): Launched 17:54:03.218385 run osmo-hlr_10.42.42.2(pid=31443): Launched 17:54:03.342345 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:03.900642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31445): Launched 17:54:04.222015 run osmo-stp_10.42.42.5(pid=31446): Launched 17:54:04.344708 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:54:04.900515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31448): Launched 17:54:05.023606 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:54:05.295533 run patchelf(pid=31449): Launched 17:54:05.476798 run osmo-stp_10.42.42.5(pid=31446): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31446)] 17:54:05.613249 run osmo-stp_10.42.42.5(pid=31446): stdout: | (launched: 2022-12-10_17:54:04.162891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:05.751375 run osmo-stp_10.42.42.5(pid=31446): stderr: | 20221210175404352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175404352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175404352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175404353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175404353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175404353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175404353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:05.889887 run osmo-stp_10.42.42.5(pid=31446): stdout: | (launched: 2022-12-10_17:54:04.162891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:06.022202 run osmo-stp_10.42.42.5(pid=31446): stderr: | 20221210175404352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175404352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175404352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175404353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175404353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175404353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175404353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:06.178576 run patchelf(pid=31449): Terminating (SIGINT) 17:54:06.359210 run patchelf(pid=31449): Terminated: ok {rc=0} 17:54:06.488638 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31446): Process ended prematurely: osmo-stp_10.42.42.5(pid=31446) [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31446)] [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 17:54:06.498956 tst iperf3m4.py:8: Test FAILED (10.6 sec) 17:54:06.528592 run osmo-hlr_10.42.42.2(pid=31443): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31443)] 17:54:06.578968 run osmo-hlr_10.42.42.2(pid=31443): stdout: | (launched: 2022-12-10_17:54:03.159924) 17:54:06.631031 run osmo-hlr_10.42.42.2(pid=31443): stderr: | 20221210175403355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175403355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175403355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175403355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175403355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175403355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175403371 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175403381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175403381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175403381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:06.683601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31430): Terminating (SIGTERM) 17:54:06.726062 run iperf3-srv_10.42.42.10(pid=31431): Terminating (SIGTERM) 17:54:06.769477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31432): Terminating (SIGTERM) 17:54:06.812014 run iperf3-srv_10.42.42.10(pid=31433): Terminating (SIGTERM) 17:54:06.852233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31434): Terminating (SIGTERM) 17:54:06.892286 run iperf3-srv_10.42.42.10(pid=31435): Terminating (SIGTERM) 17:54:06.931979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31436): Terminating (SIGTERM) 17:54:06.972060 run iperf3-srv_10.42.42.10(pid=31437): Terminating (SIGTERM) 17:54:07.012025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31442): Terminating (SIGTERM) 17:54:07.052239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31445): Terminating (SIGTERM) 17:54:07.091813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31448): Terminating (SIGTERM) 17:54:07.131412 --- ParallelTerminationStrategy: PID 31430 died... 17:54:07.150591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31430): Terminated: ok {rc=0} 17:54:07.194402 --- ParallelTerminationStrategy: PID 31431 died... 17:54:07.212931 run iperf3-srv_10.42.42.10(pid=31431): Terminated {rc=256} 17:54:07.256446 --- ParallelTerminationStrategy: PID 31432 died... 17:54:07.275016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31432): Terminated: ok {rc=0} 17:54:07.318586 --- ParallelTerminationStrategy: PID 31433 died... 17:54:07.337167 run iperf3-srv_10.42.42.10(pid=31433): Terminated {rc=256} 17:54:07.380777 --- ParallelTerminationStrategy: PID 31434 died... 17:54:07.399480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31434): Terminated: ok {rc=0} 17:54:07.443194 --- ParallelTerminationStrategy: PID 31435 died... 17:54:07.461869 run iperf3-srv_10.42.42.10(pid=31435): Terminated {rc=256} 17:54:07.505504 --- ParallelTerminationStrategy: PID 31436 died... 17:54:07.524235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31436): Terminated: ok {rc=0} 17:54:07.568057 --- ParallelTerminationStrategy: PID 31437 died... 17:54:07.586778 run iperf3-srv_10.42.42.10(pid=31437): Terminated {rc=256} 17:54:07.631040 --- ParallelTerminationStrategy: PID 31442 died... 17:54:07.649843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31442): Terminated: ok {rc=0} 17:54:07.694019 --- ParallelTerminationStrategy: PID 31445 died... 17:54:07.712565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31445): Terminated: ok {rc=0} 17:54:07.756568 --- ParallelTerminationStrategy: PID 31448 died... 17:54:07.775362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31448): Terminated: ok {rc=0} 17:54:07.859569 bus /gobi_4: Setting Powered False 17:54:08.957858 bus /gobi_4: Setting Powered False 17:54:10.073766 bus /gobi_1: Setting Powered False 17:54:11.172441 bus /gobi_1: Setting Powered False 17:54:12.289051 bus /gobi_0: Setting Powered False 17:54:13.388436 bus /gobi_0: Setting Powered False 17:54:14.509135 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 17:54:15.611984 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:15.623871 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:54:15.676303 tst ping.py: using LAC 29623 17:54:15.793049 tst ping.py: using RAC 43 17:54:15.918610 tst ping.py: using CellId 29623 17:54:16.046325 tst ping.py: using BVCI 29624 17:54:16.203828 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:16.215413 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:16.226872 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:16.238724 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:16.250389 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:16.262491 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:16.274617 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:16.286124 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:16.399183 tst ping.py:19: start network... 17:54:16.638896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:17.143711 run create_hlr_db(pid=31450): Launched 17:54:17.298003 bus /gobi_6: Setting Powered False 17:54:18.361204 run create_hlr_db(pid=31450): Terminated: ok {rc=0} 17:54:18.802197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31452): Launched 17:54:19.116629 run osmo-hlr_10.42.42.2(pid=31453): Launched 17:54:19.237955 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:19.788649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31455): Launched 17:54:20.104159 run osmo-stp_10.42.42.5(pid=31456): Launched 17:54:20.224152 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:54:20.768814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31458): Launched 17:54:20.889877 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:54:21.156548 run patchelf(pid=31459): Launched 17:54:21.333520 run osmo-stp_10.42.42.5(pid=31456): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31456)] 17:54:21.467969 run osmo-stp_10.42.42.5(pid=31456): stdout: | (launched: 2022-12-10_17:54:20.046465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:21.603887 run osmo-stp_10.42.42.5(pid=31456): stderr: | 20221210175420237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175420238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175420238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175420238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175420240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175420241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175420241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:21.740181 run osmo-stp_10.42.42.5(pid=31456): stdout: | (launched: 2022-12-10_17:54:20.046465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:21.870724 run osmo-stp_10.42.42.5(pid=31456): stderr: | 20221210175420237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175420238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175420238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175420238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175420240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175420241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175420241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:22.024766 run patchelf(pid=31459): Terminating (SIGINT) 17:54:22.202266 run patchelf(pid=31459): Terminated: ok {rc=0} 17:54:22.329905 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31456): Process ended prematurely: osmo-stp_10.42.42.5(pid=31456) [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31456)] [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 17:54:22.339473 tst ping.py:22: Test FAILED (6.7 sec) 17:54:22.368421 run osmo-hlr_10.42.42.2(pid=31453): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31453)] 17:54:22.419167 run osmo-hlr_10.42.42.2(pid=31453): stdout: | (launched: 2022-12-10_17:54:19.059073) 17:54:22.471394 run osmo-hlr_10.42.42.2(pid=31453): stderr: | 20221210175419258 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175419258 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175419258 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175419258 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175419258 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175419258 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175419271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175419279 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175419279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175419279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:22.524052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31452): Terminating (SIGTERM) 17:54:22.566690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31455): Terminating (SIGTERM) 17:54:22.608891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31458): Terminating (SIGTERM) 17:54:22.651419 --- ParallelTerminationStrategy: PID 31452 died... 17:54:22.671573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31452): Terminated: ok {rc=0} 17:54:22.718548 --- ParallelTerminationStrategy: PID 31455 died... 17:54:22.738465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31455): Terminated: ok {rc=0} 17:54:22.785522 --- ParallelTerminationStrategy: PID 31458 died... 17:54:22.805341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31458): Terminated: ok {rc=0} 17:54:22.894264 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 17:54:23.981750 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:23.994451 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:54:24.050432 tst ping_idle_ping.py: using LAC 29624 17:54:24.174903 tst ping_idle_ping.py: using RAC 44 17:54:24.303815 tst ping_idle_ping.py: using CellId 29624 17:54:24.426785 tst ping_idle_ping.py: using BVCI 29625 17:54:24.542346 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:24.554241 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:24.565855 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:24.578007 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:24.589811 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:24.601599 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:24.613918 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:24.625865 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:24.742068 tst ping_idle_ping.py:24: start network... 17:54:24.940597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:25.402037 run create_hlr_db(pid=31460): Launched 17:54:25.526073 bus /gobi_6: Setting Powered False 17:54:26.586000 run create_hlr_db(pid=31460): Terminated: ok {rc=0} 17:54:27.022722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31462): Launched 17:54:27.340412 run osmo-hlr_10.42.42.2(pid=31463): Launched 17:54:27.462104 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:28.009699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31465): Launched 17:54:28.327027 run osmo-stp_10.42.42.5(pid=31466): Launched 17:54:28.448435 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:54:28.995350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31468): Launched 17:54:29.114210 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:54:29.365486 run patchelf(pid=31469): Launched 17:54:29.531124 run osmo-stp_10.42.42.5(pid=31466): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31466)] 17:54:29.657991 run osmo-stp_10.42.42.5(pid=31466): stdout: | (launched: 2022-12-10_17:54:28.268580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:29.786113 run osmo-stp_10.42.42.5(pid=31466): stderr: | 20221210175428460 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175428460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175428461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175428461 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175428462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175428462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175428462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:29.914319 run osmo-stp_10.42.42.5(pid=31466): stdout: | (launched: 2022-12-10_17:54:28.268580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:30.036380 run osmo-stp_10.42.42.5(pid=31466): stderr: | 20221210175428460 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175428460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175428461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175428461 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175428462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175428462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175428462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:30.180877 run patchelf(pid=31469): Terminating (SIGINT) 17:54:30.346920 run patchelf(pid=31469): Terminated: ok {rc=0} 17:54:30.467219 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31466): Process ended prematurely: osmo-stp_10.42.42.5(pid=31466) [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31466)] [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 17:54:30.476037 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:54:30.502656 run osmo-hlr_10.42.42.2(pid=31463): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31463)] 17:54:30.550290 run osmo-hlr_10.42.42.2(pid=31463): stdout: | (launched: 2022-12-10_17:54:27.282144) 17:54:30.599479 run osmo-hlr_10.42.42.2(pid=31463): stderr: | 20221210175427482 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175427483 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175427483 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175427483 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175427483 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175427483 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175427495 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175427505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175427506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175427506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:30.649288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31462): Terminating (SIGTERM) 17:54:30.689122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31465): Terminating (SIGTERM) 17:54:30.729052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31468): Terminating (SIGTERM) 17:54:30.769205 --- ParallelTerminationStrategy: PID 31462 died... 17:54:30.788311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31462): Terminated: ok {rc=0} 17:54:30.845484 --- ParallelTerminationStrategy: PID 31465 died... 17:54:30.874842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31465): Terminated: ok {rc=0} 17:54:30.933390 --- ParallelTerminationStrategy: PID 31468 died... 17:54:30.953976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31468): Terminated: ok {rc=0} 17:54:31.053193 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:54:32.402933 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:54:32.410675 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:54:32.446737 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:54:32.483148 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:54:32.538258 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:54:32.572185 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:54:32.608331 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:54:33.168903 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2377 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:54:33.175357 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:54:33.187260 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:54:33.260880 tst switch_tch_pdch.py: using LAC 29625 17:54:33.385764 tst switch_tch_pdch.py: using RAC 45 17:54:33.504722 tst switch_tch_pdch.py: using CellId 29625 17:54:33.621298 tst switch_tch_pdch.py: using BVCI 29626 17:54:33.728557 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:54:33.740100 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:54:33.751098 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:54:33.762147 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:54:33.773070 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:54:33.783944 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:54:33.794953 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:54:33.806075 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:54:33.918750 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:54:34.038312 tst switch_tch_pdch.py:51: start network... 17:54:34.236819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:34.697395 run create_hlr_db(pid=31473): Launched 17:54:34.818885 bus /gobi_6: Setting Powered False 17:54:35.877507 run create_hlr_db(pid=31473): Terminated: ok {rc=0} 17:54:36.290723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31475): Launched 17:54:36.587266 run osmo-hlr_10.42.42.2(pid=31476): Launched 17:54:36.699547 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:37.220867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31478): Launched 17:54:37.516587 run osmo-stp_10.42.42.5(pid=31479): Launched 17:54:37.629244 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:54:38.139451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31481): Launched 17:54:38.252295 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:54:38.501395 run patchelf(pid=31482): Launched 17:54:38.667069 run osmo-stp_10.42.42.5(pid=31479): ERR: Terminated: ERROR {rc=1} [trial-2377↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31479)] 17:54:38.793164 run osmo-stp_10.42.42.5(pid=31479): stdout: | (launched: 2022-12-10_17:54:37.462039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:38.920435 run osmo-stp_10.42.42.5(pid=31479): stderr: | 20221210175437632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175437632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175437632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175437633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175437633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175437633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175437633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:39.048068 run osmo-stp_10.42.42.5(pid=31479): stdout: | (launched: 2022-12-10_17:54:37.462039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:39.169706 run osmo-stp_10.42.42.5(pid=31479): stderr: | 20221210175437632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175437632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175437632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175437633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175437633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175437633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175437633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:39.313786 run patchelf(pid=31482): Terminating (SIGINT) 17:54:39.479505 run patchelf(pid=31482): Terminated: ok {rc=0} 17:54:39.600536 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31479): Process ended prematurely: osmo-stp_10.42.42.5(pid=31479) [trial-2377↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31479)] [trial-2377↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:54:39.609569 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 17:54:39.635959 run osmo-hlr_10.42.42.2(pid=31476): ERR: Terminated: ERROR {rc=237} [trial-2377↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31476)] 17:54:39.683617 run osmo-hlr_10.42.42.2(pid=31476): stdout: | (launched: 2022-12-10_17:54:36.533088) 17:54:39.732875 run osmo-hlr_10.42.42.2(pid=31476): stderr: | 20221210175436710 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175436710 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175436710 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175436710 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175436710 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175436710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175436723 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175436731 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175436731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175436731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:39.782834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31475): Terminating (SIGTERM) 17:54:39.822684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31478): Terminating (SIGTERM) 17:54:39.862470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31481): Terminating (SIGTERM) 17:54:39.902495 --- ParallelTerminationStrategy: PID 31475 died... 17:54:39.921541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31475): Terminated: ok {rc=0} 17:54:39.965327 --- ParallelTerminationStrategy: PID 31478 died... 17:54:39.983796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31478): Terminated: ok {rc=0} 17:54:40.027588 --- ParallelTerminationStrategy: PID 31481 died... 17:54:40.046109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31481): Terminated: ok {rc=0} 17:54:40.131910 bus /gobi_0: Setting Powered False 17:54:41.232589 bus /gobi_0: Setting Powered False 17:54:42.347699 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:54:43.600227 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:54:43.606095 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:54:43.638335 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:54:43.672495 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:54:43.726296 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:54:43.759460 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:54:43.793159 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:54:44.347166 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2377 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:54:44.354061 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:54:44.366368 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:54:44.440258 tst switch_tch_pdch.py: using LAC 29626 17:54:44.563102 tst switch_tch_pdch.py: using RAC 46 17:54:44.688888 tst switch_tch_pdch.py: using CellId 29626 17:54:44.812749 tst switch_tch_pdch.py: using BVCI 29627 17:54:44.928263 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:54:44.939633 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:54:44.950927 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:54:44.962607 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:54:44.974511 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:54:44.986512 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:54:44.998465 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:54:45.010217 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:54:45.124793 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:54:45.244157 tst switch_tch_pdch.py:51: start network... 17:54:45.456143 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:45.921195 run create_hlr_db(pid=31487): Launched 17:54:46.097197 bus /gobi_6: Setting Powered False 17:54:47.159039 run create_hlr_db(pid=31487): Terminated: ok {rc=0} 17:54:47.560472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31489): Launched 17:54:47.857500 run osmo-hlr_10.42.42.2(pid=31490): Launched 17:54:47.969529 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:48.456816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31492): Launched 17:54:48.755449 run osmo-stp_10.42.42.5(pid=31493): Launched 17:54:48.867506 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:54:49.350925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31495): Launched 17:54:49.463745 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:54:49.713462 run patchelf(pid=31496): Launched 17:54:49.878812 run osmo-stp_10.42.42.5(pid=31493): ERR: Terminated: ERROR {rc=1} [trial-2377↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31493)] 17:54:50.004183 run osmo-stp_10.42.42.5(pid=31493): stdout: | (launched: 2022-12-10_17:54:48.701076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:50.131128 run osmo-stp_10.42.42.5(pid=31493): stderr: | 20221210175448873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175448873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175448873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175448874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175448874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175448874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175448874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:50.258116 run osmo-stp_10.42.42.5(pid=31493): stdout: | (launched: 2022-12-10_17:54:48.701076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:50.379430 run osmo-stp_10.42.42.5(pid=31493): stderr: | 20221210175448873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175448873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175448873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175448874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175448874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175448874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175448874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:50.522989 run patchelf(pid=31496): Terminating (SIGINT) 17:54:50.689504 run patchelf(pid=31496): Terminated: ok {rc=0} 17:54:50.808758 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31493): Process ended prematurely: osmo-stp_10.42.42.5(pid=31493) [trial-2377↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31493)] [trial-2377↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:54:50.817660 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 17:54:50.844130 run osmo-hlr_10.42.42.2(pid=31490): ERR: Terminated: ERROR {rc=237} [trial-2377↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31490)] 17:54:50.891640 run osmo-hlr_10.42.42.2(pid=31490): stdout: | (launched: 2022-12-10_17:54:47.802952) 17:54:50.940937 run osmo-hlr_10.42.42.2(pid=31490): stderr: | 20221210175447979 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175447979 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175447979 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175447979 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175447979 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175447979 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175447991 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175448002 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175448002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175448002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:50.990884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31489): Terminating (SIGTERM) 17:54:51.030467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31492): Terminating (SIGTERM) 17:54:51.070262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31495): Terminating (SIGTERM) 17:54:51.110363 --- ParallelTerminationStrategy: PID 31489 died... 17:54:51.129568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31489): Terminated: ok {rc=0} 17:54:51.173553 --- ParallelTerminationStrategy: PID 31492 died... 17:54:51.192042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31492): Terminated: ok {rc=0} 17:54:51.236562 --- ParallelTerminationStrategy: PID 31495 died... 17:54:51.255304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31495): Terminated: ok {rc=0} 17:54:51.340840 bus /gobi_0: Setting Powered False 17:54:52.440847 bus /gobi_0: Setting Powered False 17:54:53.556089 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 nitb_sms:trx-lms --------------------------------------------------------------------- 17:54:54.803588 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:54:54.807349 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 17:54:54.840138 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 17:54:54.846824 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 17:54:54.899564 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 17:54:54.932052 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 17:54:54.938666 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 17:54:55.475046 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 17:54:55.479896 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 17:54:55.490610 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 17:54:55.538429 tst mo_mt_sms.py: using LAC 29627 17:54:55.659162 tst mo_mt_sms.py: using RAC 47 17:54:55.773942 tst mo_mt_sms.py: using CellId 29627 17:54:55.887778 tst mo_mt_sms.py: using BVCI 29628 17:54:55.994233 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 17:54:56.110683 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 17:54:56.222999 tst mo_mt_sms.py:9: start nitb and bts... 17:54:56.421379 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:54:57.026556 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31500): Launched 17:54:57.323544 run osmo-nitb_10.42.42.2(pid=31501): Launched 17:54:57.487430 run osmo-nitb_10.42.42.2(pid=31501): ERR: Terminated: ERROR {rc=2} [trial-2377↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31501)] 17:54:57.620655 run osmo-nitb_10.42.42.2(pid=31501): stdout: | (launched: 2022-12-10_17:54:57.269155) 17:54:57.755068 run osmo-nitb_10.42.42.2(pid=31501): stderr: | (launched: 2022-12-10_17:54:57.313315) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:54:57.889648 run osmo-nitb_10.42.42.2(pid=31501): stdout: | (launched: 2022-12-10_17:54:57.269155) 17:54:58.018574 run osmo-nitb_10.42.42.2(pid=31501): stderr: | (launched: 2022-12-10_17:54:57.313315) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f2803594268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31501): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31501) [trial-2377↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31501)] 17:54:58.434955 tst osmo-nitb_10.42.42.2(pid=31501): stdout: | (launched: 2022-12-10_17:54:57.269155) 17:54:58.554254 tst osmo-nitb_10.42.42.2(pid=31501): stderr: | (launched: 2022-12-10_17:54:57.313315) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:54:58.695228 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=31501): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31501) [trial-2377↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31501)] [trial-2377↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 17:54:58.703857 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 17:54:58.710713 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31500): Terminating (SIGTERM) 17:54:58.919803 --- ParallelTerminationStrategy: PID 31500 died... 17:54:58.940448 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31500): Terminated: ok {rc=0} 17:54:59.024906 bus /sierra_3: Setting Powered False 17:55:00.122126 bus /sierra_3: Setting Powered False 17:55:01.237365 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 sms:trx-lms --------------------------------------------------------------------- 17:55:02.438248 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:02.443019 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 17:55:02.477209 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 17:55:02.504674 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 17:55:02.558442 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 17:55:02.593547 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 17:55:02.620674 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 17:55:03.165588 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 17:55:03.170674 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:03.181770 tst sms:trx-lms: Using 1 x bts (candidates: 1) 17:55:03.231222 tst mo_mt_sms.py: using LAC 29628 17:55:03.355098 tst mo_mt_sms.py: using RAC 48 17:55:03.481209 tst mo_mt_sms.py: using CellId 29628 17:55:03.608721 tst mo_mt_sms.py: using BVCI 29629 17:55:03.723413 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:03.734376 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:03.745222 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:03.756657 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:03.767816 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:03.779340 tst sms:trx-lms: Using 1 x modem (candidates: 2) 17:55:03.892296 tst sms:trx-lms: Using 1 x modem (candidates: 2) 17:55:04.011796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:04.499491 run create_hlr_db(pid=31508): Launched 17:55:04.619891 bus /sierra_2: Setting Powered False 17:55:05.683115 run create_hlr_db(pid=31508): Terminated: ok {rc=0} 17:55:06.107352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31510): Launched 17:55:06.403605 run osmo-hlr_10.42.42.2(pid=31511): Launched 17:55:06.516476 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:07.027627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31513): Launched 17:55:07.323373 run osmo-stp_10.42.42.5(pid=31514): Launched 17:55:07.435763 run osmo-msc_10.42.42.6: Starting osmo-msc 17:55:07.972231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31516): Launched 17:55:08.269097 run osmo-msc_10.42.42.6(pid=31517): Launched 17:55:08.434679 run osmo-stp_10.42.42.5(pid=31514): ERR: Terminated: ERROR {rc=1} [trial-2377↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31514)] 17:55:08.560299 run osmo-stp_10.42.42.5(pid=31514): stdout: | (launched: 2022-12-10_17:55:07.269208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:08.685980 run osmo-stp_10.42.42.5(pid=31514): stderr: | 20221210175507439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175507440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175507440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175507440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175507441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175507441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175507441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:08.810945 run osmo-stp_10.42.42.5(pid=31514): stdout: | (launched: 2022-12-10_17:55:07.269208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:08.929117 run osmo-stp_10.42.42.5(pid=31514): stderr: | 20221210175507439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175507440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175507440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175507440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175507441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175507441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175507441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:09.070303 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=31514): Process ended prematurely: osmo-stp_10.42.42.5(pid=31514) [trial-2377↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31514)] [trial-2377↪sms:trx-lms↪mo_mt_sms.py:16] 17:55:09.078823 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 17:55:09.105190 run osmo-hlr_10.42.42.2(pid=31511): ERR: Terminated: ERROR {rc=237} [trial-2377↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31511)] 17:55:09.153132 run osmo-hlr_10.42.42.2(pid=31511): stdout: | (launched: 2022-12-10_17:55:06.349260) 17:55:09.202778 run osmo-hlr_10.42.42.2(pid=31511): stderr: | 20221210175506525 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175506525 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175506525 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175506525 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175506525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175506525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175506537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175506546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175506546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175506546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:09.272031 run osmo-msc_10.42.42.6(pid=31517): ERR: Terminated: ERROR {rc=2} [trial-2377↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31517)] 17:55:09.319970 run osmo-msc_10.42.42.6(pid=31517): stdout: | (launched: 2022-12-10_17:55:08.214165) 17:55:09.369404 run osmo-msc_10.42.42.6(pid=31517): stderr: | 20221210175508486 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175508486 DLGLOBAL DEBUG validating counter group 0x7faeef916c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175508486 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175508486 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175508487 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175508487 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175508488 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175508489 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175508489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175508489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:55:09.419364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31510): Terminating (SIGTERM) 17:55:09.459279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31513): Terminating (SIGTERM) 17:55:09.499131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31516): Terminating (SIGTERM) 17:55:09.539295 --- ParallelTerminationStrategy: PID 31510 died... 17:55:09.558400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31510): Terminated: ok {rc=0} 17:55:09.602650 --- ParallelTerminationStrategy: PID 31513 died... 17:55:09.621176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31513): Terminated: ok {rc=0} 17:55:09.665179 --- ParallelTerminationStrategy: PID 31516 died... 17:55:09.683819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31516): Terminated: ok {rc=0} 17:55:09.770425 bus /sierra_3: Setting Powered False 17:55:10.870901 bus /sierra_3: Setting Powered False 17:55:11.985910 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 nitb_ussd:trx-lms --------------------------------------------------------------------- 17:55:13.214347 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:13.218141 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 17:55:13.251598 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 17:55:13.258561 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 17:55:13.294959 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 17:55:13.329422 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 17:55:13.336498 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 17:55:13.852776 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2377 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 17:55:13.859226 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 17:55:13.871645 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 17:55:13.929091 tst assert_extension.py: using LAC 29629 17:55:14.051919 tst assert_extension.py: using RAC 49 17:55:14.174832 tst assert_extension.py: using CellId 29629 17:55:14.297385 tst assert_extension.py: using BVCI 29630 17:55:14.411978 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 17:55:14.524558 tst assert_extension.py:10: start nitb and bts... 17:55:14.722312 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:55:15.329446 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31523): Launched 17:55:15.626544 run osmo-nitb_10.42.42.2(pid=31524): Launched 17:55:15.790176 run osmo-nitb_10.42.42.2(pid=31524): ERR: Terminated: ERROR {rc=2} [trial-2377↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31524)] 17:55:15.944159 run osmo-nitb_10.42.42.2(pid=31524): stdout: | (launched: 2022-12-10_17:55:15.571641) 17:55:16.094943 run osmo-nitb_10.42.42.2(pid=31524): stderr: | (launched: 2022-12-10_17:55:15.615547) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:55:16.244500 run osmo-nitb_10.42.42.2(pid=31524): stdout: | (launched: 2022-12-10_17:55:15.571641) 17:55:16.387405 run osmo-nitb_10.42.42.2(pid=31524): stderr: | (launched: 2022-12-10_17:55:15.615547) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f2803594268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31524): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31524) [trial-2377↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31524)] 17:55:16.737568 tst osmo-nitb_10.42.42.2(pid=31524): stdout: | (launched: 2022-12-10_17:55:15.571641) 17:55:16.869146 tst osmo-nitb_10.42.42.2(pid=31524): stderr: | (launched: 2022-12-10_17:55:15.615547) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:55:17.024295 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=31524): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31524) [trial-2377↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31524)] [trial-2377↪nitb_ussd:trx-lms↪assert_extension.py:12] 17:55:17.034688 tst assert_extension.py:12: Test FAILED (3.2 sec) 17:55:17.042989 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31523): Terminating (SIGTERM) 17:55:17.259220 --- ParallelTerminationStrategy: PID 31523 died... 17:55:17.281437 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31523): Terminated: ok {rc=0} 17:55:17.369963 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 ussd:trx-lms --------------------------------------------------------------------- 17:55:18.553150 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:18.558042 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 17:55:18.593343 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 17:55:18.620902 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 17:55:18.657384 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 17:55:18.691552 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 17:55:18.718914 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 17:55:19.247033 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2377 ussd:trx-lms assert_extension.py ---------------------------------------------- 17:55:19.252492 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:19.263603 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 17:55:19.314479 tst assert_extension.py: using LAC 29630 17:55:19.440203 tst assert_extension.py: using RAC 50 17:55:19.564494 tst assert_extension.py: using CellId 29630 17:55:19.688385 tst assert_extension.py: using BVCI 29631 17:55:19.796640 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:19.807350 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:19.818098 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:19.828406 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:19.838924 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:19.849735 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 17:55:19.965336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:20.453292 run create_hlr_db(pid=31528): Launched 17:55:20.575745 bus /sierra_2: Setting Powered False 17:55:21.638291 run create_hlr_db(pid=31528): Terminated: ok {rc=0} 17:55:22.080500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31530): Launched 17:55:22.397525 run osmo-hlr_10.42.42.2(pid=31531): Launched 17:55:22.519257 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:23.068339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31533): Launched 17:55:23.365464 run osmo-stp_10.42.42.5(pid=31534): Launched 17:55:23.478729 run osmo-msc_10.42.42.6: Starting osmo-msc 17:55:24.015612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31536): Launched 17:55:24.312052 run osmo-msc_10.42.42.6(pid=31537): Launched 17:55:24.478683 run osmo-stp_10.42.42.5(pid=31534): ERR: Terminated: ERROR {rc=1} [trial-2377↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31534)] 17:55:24.605070 run osmo-stp_10.42.42.5(pid=31534): stdout: | (launched: 2022-12-10_17:55:23.310443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:24.731350 run osmo-stp_10.42.42.5(pid=31534): stderr: | 20221210175523481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175523482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175523482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175523482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175523483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175523483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175523483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:24.855202 run osmo-stp_10.42.42.5(pid=31534): stdout: | (launched: 2022-12-10_17:55:23.310443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:24.974004 run osmo-stp_10.42.42.5(pid=31534): stderr: | 20221210175523481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175523482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175523482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175523482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175523483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175523483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175523483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:25.114876 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=31534): Process ended prematurely: osmo-stp_10.42.42.5(pid=31534) [trial-2377↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31534)] [trial-2377↪ussd:trx-lms↪assert_extension.py:17] 17:55:25.123097 tst assert_extension.py:17: Test FAILED (5.9 sec) 17:55:25.148985 run osmo-hlr_10.42.42.2(pid=31531): ERR: Terminated: ERROR {rc=237} [trial-2377↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31531)] 17:55:25.196474 run osmo-hlr_10.42.42.2(pid=31531): stdout: | (launched: 2022-12-10_17:55:22.339136) 17:55:25.245805 run osmo-hlr_10.42.42.2(pid=31531): stderr: | 20221210175522535 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175522535 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175522535 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175522535 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175522535 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175522535 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175522547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175522555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175522555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175522555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:25.314563 run osmo-msc_10.42.42.6(pid=31537): ERR: Terminated: ERROR {rc=2} [trial-2377↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31537)] 17:55:25.362165 run osmo-msc_10.42.42.6(pid=31537): stdout: | (launched: 2022-12-10_17:55:24.257473) 17:55:25.411139 run osmo-msc_10.42.42.6(pid=31537): stderr: | 20221210175524529 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175524529 DLGLOBAL DEBUG validating counter group 0x7f5bc76c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175524529 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175524529 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175524529 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175524530 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175524531 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175524532 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175524532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175524532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:55:25.460590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31530): Terminating (SIGTERM) 17:55:25.500081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31533): Terminating (SIGTERM) 17:55:25.539489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31536): Terminating (SIGTERM) 17:55:25.579319 --- ParallelTerminationStrategy: PID 31530 died... 17:55:25.598408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31530): Terminated: ok {rc=0} 17:55:25.642712 --- ParallelTerminationStrategy: PID 31533 died... 17:55:25.661383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31533): Terminated: ok {rc=0} 17:55:25.705254 --- ParallelTerminationStrategy: PID 31536 died... 17:55:25.723825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31536): Terminated: ok {rc=0} 17:55:25.808314 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:55:27.025523 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:27.032725 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:55:27.068050 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:55:27.095308 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:55:27.148511 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:55:27.182767 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:55:27.210629 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:55:27.759035 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:55:27.807854 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:27.819176 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:55:27.887997 tst mo_mt_call.py: using LAC 29631 17:55:28.005922 tst mo_mt_call.py: using RAC 51 17:55:28.127323 tst mo_mt_call.py: using CellId 29631 17:55:28.245850 tst mo_mt_call.py: using BVCI 29632 17:55:28.354612 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:28.365780 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:28.376633 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:28.387613 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:28.398563 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:28.409438 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:55:28.528013 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:55:28.646205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:29.146719 run create_hlr_db(pid=31542): Launched 17:55:29.270707 bus /sierra_2: Setting Powered False 17:55:30.334229 run create_hlr_db(pid=31542): Terminated: ok {rc=0} 17:55:30.783130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31544): Launched 17:55:31.130483 run osmo-hlr_10.42.42.2(pid=31545): Launched 17:55:31.292220 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:31.969302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31547): Launched 17:55:32.336439 run osmo-stp_10.42.42.5(pid=31548): Launched 17:55:32.544576 run osmo-msc_10.42.42.6: Starting osmo-msc 17:55:33.103313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31550): Launched 17:55:33.403513 run osmo-msc_10.42.42.6(pid=31551): Launched 17:55:33.571837 run osmo-stp_10.42.42.5(pid=31548): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31548)] 17:55:33.698432 run osmo-stp_10.42.42.5(pid=31548): stdout: | (launched: 2022-12-10_17:55:32.279984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:33.824846 run osmo-stp_10.42.42.5(pid=31548): stderr: | 20221210175532518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175532518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175532518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175532519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175532519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175532519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175532519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:33.950204 run osmo-stp_10.42.42.5(pid=31548): stdout: | (launched: 2022-12-10_17:55:32.279984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:34.069418 run osmo-stp_10.42.42.5(pid=31548): stderr: | 20221210175532518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175532518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175532518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175532519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175532519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175532519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175532519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:34.212244 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31548): Process ended prematurely: osmo-stp_10.42.42.5(pid=31548) [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31548)] [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:55:34.221275 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 17:55:34.247704 run osmo-hlr_10.42.42.2(pid=31545): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31545)] 17:55:34.295268 run osmo-hlr_10.42.42.2(pid=31545): stdout: | (launched: 2022-12-10_17:55:31.073172) 17:55:34.344580 run osmo-hlr_10.42.42.2(pid=31545): stderr: | 20221210175531420 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175531421 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175531421 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175531421 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175531421 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175531421 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175531453 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175531469 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175531469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175531469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:34.413263 run osmo-msc_10.42.42.6(pid=31551): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31551)] 17:55:34.460778 run osmo-msc_10.42.42.6(pid=31551): stdout: | (launched: 2022-12-10_17:55:33.348308) 17:55:34.509997 run osmo-msc_10.42.42.6(pid=31551): stderr: | 20221210175533620 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175533620 DLGLOBAL DEBUG validating counter group 0x7f380a855c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175533620 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175533620 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175533620 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175533620 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175533622 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175533624 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175533624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175533624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:55:34.559447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31544): Terminating (SIGTERM) 17:55:34.598707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31547): Terminating (SIGTERM) 17:55:34.638045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31550): Terminating (SIGTERM) 17:55:34.677706 --- ParallelTerminationStrategy: PID 31544 died... 17:55:34.696549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31544): Terminated: ok {rc=0} 17:55:34.740887 --- ParallelTerminationStrategy: PID 31547 died... 17:55:34.759596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31547): Terminated: ok {rc=0} 17:55:34.804177 --- ParallelTerminationStrategy: PID 31550 died... 17:55:34.823362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31550): Terminated: ok {rc=0} 17:55:34.906810 bus /sierra_3: Setting Powered False 17:55:36.005194 bus /sierra_3: Setting Powered False 17:55:37.123019 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:55:38.271743 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:38.284148 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:55:38.356439 tst mo_mt_call_osmux.py: using LAC 29632 17:55:38.483917 tst mo_mt_call_osmux.py: using RAC 52 17:55:38.610195 tst mo_mt_call_osmux.py: using CellId 29632 17:55:38.737209 tst mo_mt_call_osmux.py: using BVCI 29633 17:55:38.854473 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:38.866326 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:38.877812 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:38.889621 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:38.901249 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:38.912810 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:55:39.032466 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:55:39.154869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:39.624800 run create_hlr_db(pid=31553): Launched 17:55:39.749901 bus /sierra_2: Setting Powered False 17:55:40.814306 run create_hlr_db(pid=31553): Terminated: ok {rc=0} 17:55:41.264735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31555): Launched 17:55:41.588631 run osmo-hlr_10.42.42.2(pid=31556): Launched 17:55:41.712722 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:42.272417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31558): Launched 17:55:42.595442 run osmo-stp_10.42.42.5(pid=31559): Launched 17:55:42.719321 run osmo-msc_10.42.42.6: Starting osmo-msc 17:55:43.305755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31561): Launched 17:55:43.628693 run osmo-msc_10.42.42.6(pid=31562): Launched 17:55:43.810631 run osmo-stp_10.42.42.5(pid=31559): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31559)] 17:55:43.947332 run osmo-stp_10.42.42.5(pid=31559): stdout: | (launched: 2022-12-10_17:55:42.536782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:44.084478 run osmo-stp_10.42.42.5(pid=31559): stderr: | 20221210175542730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175542730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175542730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175542730 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175542731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175542731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175542731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:44.220768 run osmo-stp_10.42.42.5(pid=31559): stdout: | (launched: 2022-12-10_17:55:42.536782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:44.350005 run osmo-stp_10.42.42.5(pid=31559): stderr: | 20221210175542730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175542730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175542730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175542730 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175542731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175542731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175542731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:44.504180 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31559): Process ended prematurely: osmo-stp_10.42.42.5(pid=31559) [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31559)] [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:55:44.513950 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:55:44.543107 run osmo-hlr_10.42.42.2(pid=31556): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31556)] 17:55:44.594327 run osmo-hlr_10.42.42.2(pid=31556): stdout: | (launched: 2022-12-10_17:55:41.529717) 17:55:44.647184 run osmo-hlr_10.42.42.2(pid=31556): stderr: | 20221210175541727 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175541727 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175541727 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175541727 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175541727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175541727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175541740 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175541748 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175541748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175541748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:44.720594 run osmo-msc_10.42.42.6(pid=31562): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31562)] 17:55:44.771644 run osmo-msc_10.42.42.6(pid=31562): stdout: | (launched: 2022-12-10_17:55:43.570026) 17:55:44.824281 run osmo-msc_10.42.42.6(pid=31562): stderr: | 20221210175543891 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175543891 DLGLOBAL DEBUG validating counter group 0x7fc7b9359c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175543891 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175543891 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175543891 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175543891 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175543893 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175543893 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175543894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175543894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:55:44.877162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31555): Terminating (SIGTERM) 17:55:44.919510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31558): Terminating (SIGTERM) 17:55:44.962222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31561): Terminating (SIGTERM) 17:55:45.005078 --- ParallelTerminationStrategy: PID 31555 died... 17:55:45.025216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31555): Terminated: ok {rc=0} 17:55:45.072874 --- ParallelTerminationStrategy: PID 31558 died... 17:55:45.092814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31558): Terminated: ok {rc=0} 17:55:45.139954 --- ParallelTerminationStrategy: PID 31561 died... 17:55:45.159845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31561): Terminated: ok {rc=0} 17:55:45.248832 bus /sierra_3: Setting Powered False 17:55:46.353450 bus /sierra_3: Setting Powered False 17:55:47.495121 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:55:48.744271 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:48.750969 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:55:48.784029 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:55:48.810400 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:55:48.862382 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:55:48.895914 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:55:48.922442 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:55:49.471126 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:55:49.519666 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:55:49.531055 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:55:49.600292 tst mo_mt_call.py: using LAC 29633 17:55:49.720016 tst mo_mt_call.py: using RAC 53 17:55:49.840513 tst mo_mt_call.py: using CellId 29633 17:55:49.962203 tst mo_mt_call.py: using BVCI 29634 17:55:50.072230 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:55:50.083257 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:55:50.094275 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:55:50.105059 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:55:50.115935 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:55:50.126736 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:55:50.246197 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:55:50.362814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:50.833214 run create_hlr_db(pid=31567): Launched 17:55:50.957216 bus /sierra_2: Setting Powered False 17:55:52.017245 run create_hlr_db(pid=31567): Terminated: ok {rc=0} 17:55:52.456729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31569): Launched 17:55:52.779347 run osmo-hlr_10.42.42.2(pid=31570): Launched 17:55:52.905124 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:53.464490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31572): Launched 17:55:53.786492 run osmo-stp_10.42.42.5(pid=31573): Launched 17:55:53.911072 run osmo-msc_10.42.42.6: Starting osmo-msc 17:55:54.494005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31575): Launched 17:55:54.816807 run osmo-msc_10.42.42.6(pid=31576): Launched 17:55:54.995774 run osmo-stp_10.42.42.5(pid=31573): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31573)] 17:55:55.131367 run osmo-stp_10.42.42.5(pid=31573): stdout: | (launched: 2022-12-10_17:55:53.727281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:55.267193 run osmo-stp_10.42.42.5(pid=31573): stderr: | 20221210175553919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175553919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175553920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175553920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175553922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175553923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175553923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:55.402652 run osmo-stp_10.42.42.5(pid=31573): stdout: | (launched: 2022-12-10_17:55:53.727281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:55.530615 run osmo-stp_10.42.42.5(pid=31573): stderr: | 20221210175553919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175553919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175553920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175553920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175553922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175553923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175553923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:55.683906 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31573): Process ended prematurely: osmo-stp_10.42.42.5(pid=31573) [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31573)] [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:55:55.693767 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:55:55.722058 run osmo-hlr_10.42.42.2(pid=31570): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31570)] 17:55:55.773185 run osmo-hlr_10.42.42.2(pid=31570): stdout: | (launched: 2022-12-10_17:55:52.720732) 17:55:55.825883 run osmo-hlr_10.42.42.2(pid=31570): stderr: | 20221210175552918 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175552918 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175552918 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175552918 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175552918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175552919 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175552931 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175552940 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175552940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175552940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:55.898935 run osmo-msc_10.42.42.6(pid=31576): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31576)] 17:55:55.949375 run osmo-msc_10.42.42.6(pid=31576): stdout: | (launched: 2022-12-10_17:55:54.757708) 17:55:56.001633 run osmo-msc_10.42.42.6(pid=31576): stderr: | 20221210175555081 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175555081 DLGLOBAL DEBUG validating counter group 0x7fd6cda75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175555081 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175555081 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175555082 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175555082 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175555083 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175555084 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175555084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175555084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:55:56.054511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31569): Terminating (SIGTERM) 17:55:56.097035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31572): Terminating (SIGTERM) 17:55:56.139665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31575): Terminating (SIGTERM) 17:55:56.182365 --- ParallelTerminationStrategy: PID 31569 died... 17:55:56.202431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31569): Terminated: ok {rc=0} 17:55:56.249547 --- ParallelTerminationStrategy: PID 31572 died... 17:55:56.269145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31572): Terminated: ok {rc=0} 17:55:56.315894 --- ParallelTerminationStrategy: PID 31575 died... 17:55:56.335507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31575): Terminated: ok {rc=0} 17:55:56.424708 bus /sierra_3: Setting Powered False 17:55:57.524670 bus /sierra_3: Setting Powered False 17:55:58.641685 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:55:59.792601 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:55:59.804998 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:55:59.876616 tst mo_mt_call_osmux.py: using LAC 29634 17:56:00.001649 tst mo_mt_call_osmux.py: using RAC 54 17:56:00.126507 tst mo_mt_call_osmux.py: using CellId 29634 17:56:00.252290 tst mo_mt_call_osmux.py: using BVCI 29635 17:56:00.368893 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:00.380469 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:00.391941 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:00.403580 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:00.415617 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:00.427518 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:56:00.546339 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:56:00.661787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:01.171200 run create_hlr_db(pid=31578): Launched 17:56:01.300687 bus /sierra_2: Setting Powered False 17:56:02.364772 run create_hlr_db(pid=31578): Terminated: ok {rc=0} 17:56:02.795692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31580): Launched 17:56:03.099087 run osmo-hlr_10.42.42.2(pid=31581): Launched 17:56:03.215639 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:03.752267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31583): Launched 17:56:04.055077 run osmo-stp_10.42.42.5(pid=31584): Launched 17:56:04.170961 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:04.719215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31586): Launched 17:56:05.021605 run osmo-msc_10.42.42.6(pid=31587): Launched 17:56:05.191073 run osmo-stp_10.42.42.5(pid=31584): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31584)] 17:56:05.319941 run osmo-stp_10.42.42.5(pid=31584): stdout: | (launched: 2022-12-10_17:56:03.999552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:05.447935 run osmo-stp_10.42.42.5(pid=31584): stderr: | 20221210175604171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175604171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175604171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175604172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175604172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175604172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175604172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:05.573615 run osmo-stp_10.42.42.5(pid=31584): stdout: | (launched: 2022-12-10_17:56:03.999552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:05.693646 run osmo-stp_10.42.42.5(pid=31584): stderr: | 20221210175604171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175604171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175604171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175604172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175604172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175604172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175604172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:05.837374 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31584): Process ended prematurely: osmo-stp_10.42.42.5(pid=31584) [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31584)] [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:56:05.846257 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:56:05.872749 run osmo-hlr_10.42.42.2(pid=31581): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31581)] 17:56:05.920510 run osmo-hlr_10.42.42.2(pid=31581): stdout: | (launched: 2022-12-10_17:56:03.043573) 17:56:05.970458 run osmo-hlr_10.42.42.2(pid=31581): stderr: | 20221210175603220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175603220 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175603220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175603220 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175603220 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175603220 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175603232 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175603242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175603242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175603242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:06.039936 run osmo-msc_10.42.42.6(pid=31587): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31587)] 17:56:06.088084 run osmo-msc_10.42.42.6(pid=31587): stdout: | (launched: 2022-12-10_17:56:04.965495) 17:56:06.138279 run osmo-msc_10.42.42.6(pid=31587): stderr: | 20221210175605239 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175605239 DLGLOBAL DEBUG validating counter group 0x7f12ad9b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175605239 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175605239 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175605239 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175605239 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175605242 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175605243 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175605243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175605243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:06.188153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31580): Terminating (SIGTERM) 17:56:06.228058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31583): Terminating (SIGTERM) 17:56:06.267902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31586): Terminating (SIGTERM) 17:56:06.307864 --- ParallelTerminationStrategy: PID 31580 died... 17:56:06.327344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31580): Terminated: ok {rc=0} 17:56:06.371685 --- ParallelTerminationStrategy: PID 31583 died... 17:56:06.390396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31583): Terminated: ok {rc=0} 17:56:06.434460 --- ParallelTerminationStrategy: PID 31586 died... 17:56:06.453338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31586): Terminated: ok {rc=0} 17:56:06.539666 bus /sierra_3: Setting Powered False 17:56:07.641066 bus /sierra_3: Setting Powered False 17:56:08.757574 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:56:10.014218 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:56:10.021572 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:56:10.056509 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:56:10.084096 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:56:10.138320 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:56:10.172766 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:56:10.200323 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:56:10.750609 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:56:10.802820 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:10.814584 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:56:10.885825 tst mo_mt_call.py: using LAC 29635 17:56:11.012632 tst mo_mt_call.py: using RAC 55 17:56:11.138460 tst mo_mt_call.py: using CellId 29635 17:56:11.262955 tst mo_mt_call.py: using BVCI 29636 17:56:11.379868 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:11.391472 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:11.402890 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:11.414574 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:11.426281 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:11.437896 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:56:11.555439 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:56:11.674032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:12.146296 run create_hlr_db(pid=31592): Launched 17:56:12.274106 bus /sierra_2: Setting Powered False 17:56:13.334772 run create_hlr_db(pid=31592): Terminated: ok {rc=0} 17:56:13.778087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31594): Launched 17:56:14.104583 run osmo-hlr_10.42.42.2(pid=31595): Launched 17:56:14.228628 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:14.795758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31597): Launched 17:56:15.118833 run osmo-stp_10.42.42.5(pid=31598): Launched 17:56:15.242787 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:15.827328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31600): Launched 17:56:16.193760 run osmo-msc_10.42.42.6(pid=31601): Launched 17:56:16.491009 run osmo-stp_10.42.42.5(pid=31598): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31598)] 17:56:16.763266 run osmo-stp_10.42.42.5(pid=31598): stdout: | (launched: 2022-12-10_17:56:15.060089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:17.048868 run osmo-stp_10.42.42.5(pid=31598): stderr: | 20221210175615251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175615251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175615252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175615252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175615252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175615253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175615253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:17.228647 run osmo-stp_10.42.42.5(pid=31598): stdout: | (launched: 2022-12-10_17:56:15.060089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:17.350905 run osmo-stp_10.42.42.5(pid=31598): stderr: | 20221210175615251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175615251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175615252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175615252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175615252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175615253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175615253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:17.495535 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31598): Process ended prematurely: osmo-stp_10.42.42.5(pid=31598) [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31598)] [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:56:17.504641 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 17:56:17.531446 run osmo-hlr_10.42.42.2(pid=31595): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31595)] 17:56:17.580025 run osmo-hlr_10.42.42.2(pid=31595): stdout: | (launched: 2022-12-10_17:56:14.045143) 17:56:17.629941 run osmo-hlr_10.42.42.2(pid=31595): stderr: | 20221210175614242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175614242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175614242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175614242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175614242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175614242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175614257 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175614266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175614266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175614266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:17.699721 run osmo-msc_10.42.42.6(pid=31601): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31601)] 17:56:17.747558 run osmo-msc_10.42.42.6(pid=31601): stdout: | (launched: 2022-12-10_17:56:16.129867) 17:56:17.797050 run osmo-msc_10.42.42.6(pid=31601): stderr: | 20221210175616729 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175616729 DLGLOBAL DEBUG validating counter group 0x7ff696962c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175616729 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175616729 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175616730 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175616730 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175616731 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175616732 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175616732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175616732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:17.846951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31594): Terminating (SIGTERM) 17:56:17.886794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31597): Terminating (SIGTERM) 17:56:17.926860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31600): Terminating (SIGTERM) 17:56:17.966835 --- ParallelTerminationStrategy: PID 31594 died... 17:56:17.986067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31594): Terminated: ok {rc=0} 17:56:18.030896 --- ParallelTerminationStrategy: PID 31597 died... 17:56:18.049608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31597): Terminated: ok {rc=0} 17:56:18.094262 --- ParallelTerminationStrategy: PID 31600 died... 17:56:18.113027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31600): Terminated: ok {rc=0} 17:56:18.200324 bus /sierra_3: Setting Powered False 17:56:19.301669 bus /sierra_3: Setting Powered False 17:56:20.417105 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:56:21.563265 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:21.574961 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:56:21.644144 tst mo_mt_call_osmux.py: using LAC 29636 17:56:21.764676 tst mo_mt_call_osmux.py: using RAC 56 17:56:21.885315 tst mo_mt_call_osmux.py: using CellId 29636 17:56:22.005848 tst mo_mt_call_osmux.py: using BVCI 29637 17:56:22.116744 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:22.127911 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:22.138970 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:22.149853 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:22.160698 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:22.171611 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:56:22.290351 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:56:22.410859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:22.909833 run create_hlr_db(pid=31603): Launched 17:56:23.033145 bus /sierra_2: Setting Powered False 17:56:24.096699 run create_hlr_db(pid=31603): Terminated: ok {rc=0} 17:56:24.528227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31605): Launched 17:56:24.831519 run osmo-hlr_10.42.42.2(pid=31606): Launched 17:56:24.946284 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:25.479116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31608): Launched 17:56:25.780865 run osmo-stp_10.42.42.5(pid=31609): Launched 17:56:25.894919 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:26.441643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31611): Launched 17:56:26.743208 run osmo-msc_10.42.42.6(pid=31612): Launched 17:56:26.914373 run osmo-stp_10.42.42.5(pid=31609): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31609)] 17:56:27.042489 run osmo-stp_10.42.42.5(pid=31609): stdout: | (launched: 2022-12-10_17:56:25.725093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:27.171636 run osmo-stp_10.42.42.5(pid=31609): stderr: | 20221210175625894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175625894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175625894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175625894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175625897 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175625897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175625897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:27.297337 run osmo-stp_10.42.42.5(pid=31609): stdout: | (launched: 2022-12-10_17:56:25.725093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:27.417631 run osmo-stp_10.42.42.5(pid=31609): stderr: | 20221210175625894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175625894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175625894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175625894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175625897 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175625897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175625897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:27.561147 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31609): Process ended prematurely: osmo-stp_10.42.42.5(pid=31609) [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31609)] [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:56:27.570114 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 17:56:27.596769 run osmo-hlr_10.42.42.2(pid=31606): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31606)] 17:56:27.644638 run osmo-hlr_10.42.42.2(pid=31606): stdout: | (launched: 2022-12-10_17:56:24.776016) 17:56:27.694284 run osmo-hlr_10.42.42.2(pid=31606): stderr: | 20221210175624952 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175624952 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175624952 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175624952 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175624952 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175624952 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175624965 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175624975 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175624975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175624975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:27.763273 run osmo-msc_10.42.42.6(pid=31612): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31612)] 17:56:27.811078 run osmo-msc_10.42.42.6(pid=31612): stdout: | (launched: 2022-12-10_17:56:26.687653) 17:56:27.860486 run osmo-msc_10.42.42.6(pid=31612): stderr: | 20221210175626959 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175626959 DLGLOBAL DEBUG validating counter group 0x7f838d6bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175626959 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175626960 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175626960 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175626960 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175626962 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175626962 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175626962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175626962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:27.910223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31605): Terminating (SIGTERM) 17:56:27.949502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31608): Terminating (SIGTERM) 17:56:27.988856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31611): Terminating (SIGTERM) 17:56:28.028297 --- ParallelTerminationStrategy: PID 31605 died... 17:56:28.047369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31605): Terminated: ok {rc=0} 17:56:28.091202 --- ParallelTerminationStrategy: PID 31608 died... 17:56:28.109756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31608): Terminated: ok {rc=0} 17:56:28.153377 --- ParallelTerminationStrategy: PID 31611 died... 17:56:28.171943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31611): Terminated: ok {rc=0} 17:56:28.257269 bus /sierra_3: Setting Powered False 17:56:29.358958 bus /sierra_3: Setting Powered False 17:56:30.478665 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:56:31.762492 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:56:31.771920 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:56:31.810940 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:56:31.845944 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:56:31.910019 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:56:31.953233 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:56:31.985792 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:56:32.518975 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:56:32.568633 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:32.580912 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:56:32.650939 tst mo_mt_call.py: using LAC 29637 17:56:32.772150 tst mo_mt_call.py: using RAC 57 17:56:32.890729 tst mo_mt_call.py: using CellId 29637 17:56:33.008886 tst mo_mt_call.py: using BVCI 29638 17:56:33.117560 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:33.128558 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:33.139517 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:33.150352 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:33.161241 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:33.172083 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:56:33.291634 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:56:33.411950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:33.910547 run create_hlr_db(pid=31618): Launched 17:56:34.035252 bus /sierra_2: Setting Powered False 17:56:35.099466 run create_hlr_db(pid=31618): Terminated: ok {rc=0} 17:56:35.530558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31620): Launched 17:56:35.831933 run osmo-hlr_10.42.42.2(pid=31621): Launched 17:56:35.946413 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:36.465683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31623): Launched 17:56:36.766779 run osmo-stp_10.42.42.5(pid=31624): Launched 17:56:36.881781 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:37.428384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31626): Launched 17:56:37.731728 run osmo-msc_10.42.42.6(pid=31627): Launched 17:56:37.900222 run osmo-stp_10.42.42.5(pid=31624): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31624)] 17:56:38.027469 run osmo-stp_10.42.42.5(pid=31624): stdout: | (launched: 2022-12-10_17:56:36.711472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:38.154711 run osmo-stp_10.42.42.5(pid=31624): stderr: | 20221210175636882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175636882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175636882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175636883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175636885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175636885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175636885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:38.280217 run osmo-stp_10.42.42.5(pid=31624): stdout: | (launched: 2022-12-10_17:56:36.711472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:38.399843 run osmo-stp_10.42.42.5(pid=31624): stderr: | 20221210175636882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175636882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175636882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175636883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175636885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175636885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175636885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:38.543226 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31624): Process ended prematurely: osmo-stp_10.42.42.5(pid=31624) [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31624)] [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:56:38.552186 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:56:38.578756 run osmo-hlr_10.42.42.2(pid=31621): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31621)] 17:56:38.626638 run osmo-hlr_10.42.42.2(pid=31621): stdout: | (launched: 2022-12-10_17:56:35.776467) 17:56:38.676163 run osmo-hlr_10.42.42.2(pid=31621): stderr: | 20221210175635954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175635954 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175635954 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175635954 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175635954 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175635954 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175635970 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175635980 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175635980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175635980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:38.745481 run osmo-msc_10.42.42.6(pid=31627): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31627)] 17:56:38.793458 run osmo-msc_10.42.42.6(pid=31627): stdout: | (launched: 2022-12-10_17:56:37.676271) 17:56:38.842956 run osmo-msc_10.42.42.6(pid=31627): stderr: | 20221210175637950 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175637951 DLGLOBAL DEBUG validating counter group 0x7f044f35ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175637951 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175637951 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175637951 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175637951 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175637954 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175637954 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175637954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175637955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:38.893175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31620): Terminating (SIGTERM) 17:56:38.932643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31623): Terminating (SIGTERM) 17:56:38.972128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31626): Terminating (SIGTERM) 17:56:39.011887 --- ParallelTerminationStrategy: PID 31620 died... 17:56:39.031059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31620): Terminated: ok {rc=0} 17:56:39.075081 --- ParallelTerminationStrategy: PID 31623 died... 17:56:39.093705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31623): Terminated: ok {rc=0} 17:56:39.137697 --- ParallelTerminationStrategy: PID 31626 died... 17:56:39.156397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31626): Terminated: ok {rc=0} 17:56:39.240475 bus /sierra_3: Setting Powered False 17:56:40.339353 bus /sierra_3: Setting Powered False 17:56:41.456614 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:56:42.606975 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:42.619483 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:56:42.696198 tst mo_mt_call_osmux.py: using LAC 29638 17:56:42.823846 tst mo_mt_call_osmux.py: using RAC 58 17:56:42.951058 tst mo_mt_call_osmux.py: using CellId 29638 17:56:43.077917 tst mo_mt_call_osmux.py: using BVCI 29639 17:56:43.194582 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:43.206175 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:43.217537 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:43.229081 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:43.240706 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:43.252288 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:56:43.371702 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:56:43.488445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:43.959932 run create_hlr_db(pid=31629): Launched 17:56:44.084043 bus /sierra_2: Setting Powered False 17:56:45.144088 run create_hlr_db(pid=31629): Terminated: ok {rc=0} 17:56:45.568215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31631): Launched 17:56:45.883528 run osmo-hlr_10.42.42.2(pid=31632): Launched 17:56:46.112318 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:46.762456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31634): Launched 17:56:47.082882 run osmo-stp_10.42.42.5(pid=31635): Launched 17:56:47.307038 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:47.893625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31637): Launched 17:56:48.218456 run osmo-msc_10.42.42.6(pid=31638): Launched 17:56:48.399805 run osmo-stp_10.42.42.5(pid=31635): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31635)] 17:56:48.536703 run osmo-stp_10.42.42.5(pid=31635): stdout: | (launched: 2022-12-10_17:56:47.025934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:48.674119 run osmo-stp_10.42.42.5(pid=31635): stderr: | 20221210175647242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175647242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175647242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175647242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175647243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175647243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175647243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:48.810984 run osmo-stp_10.42.42.5(pid=31635): stdout: | (launched: 2022-12-10_17:56:47.025934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:48.940130 run osmo-stp_10.42.42.5(pid=31635): stderr: | 20221210175647242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175647242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175647242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175647242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175647243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175647243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175647243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:49.094855 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31635): Process ended prematurely: osmo-stp_10.42.42.5(pid=31635) [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31635)] [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:56:49.104763 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:56:49.134027 run osmo-hlr_10.42.42.2(pid=31632): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31632)] 17:56:49.185497 run osmo-hlr_10.42.42.2(pid=31632): stdout: | (launched: 2022-12-10_17:56:45.816666) 17:56:49.238582 run osmo-hlr_10.42.42.2(pid=31632): stderr: | 20221210175646067 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175646067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175646067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175646067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175646067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175646067 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175646090 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175646112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175646112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175646112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:49.312118 run osmo-msc_10.42.42.6(pid=31638): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31638)] 17:56:49.363294 run osmo-msc_10.42.42.6(pid=31638): stdout: | (launched: 2022-12-10_17:56:48.159302) 17:56:49.416063 run osmo-msc_10.42.42.6(pid=31638): stderr: | 20221210175648479 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175648479 DLGLOBAL DEBUG validating counter group 0x7f972b2e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175648479 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175648479 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175648479 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175648479 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175648481 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175648482 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175648482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175648482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:49.469039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31631): Terminating (SIGTERM) 17:56:49.511633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31634): Terminating (SIGTERM) 17:56:49.554464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31637): Terminating (SIGTERM) 17:56:49.597668 --- ParallelTerminationStrategy: PID 31631 died... 17:56:49.618153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31631): Terminated: ok {rc=0} 17:56:49.665442 --- ParallelTerminationStrategy: PID 31634 died... 17:56:49.685390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31634): Terminated: ok {rc=0} 17:56:49.732403 --- ParallelTerminationStrategy: PID 31637 died... 17:56:49.752122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31637): Terminated: ok {rc=0} 17:56:49.842178 bus /sierra_3: Setting Powered False 17:56:50.940695 bus /sierra_3: Setting Powered False 17:56:52.057827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:56:53.314734 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:56:53.322300 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:56:53.354897 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:56:53.381344 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:56:53.431109 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:56:53.463799 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:56:53.490109 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:56:54.042988 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:56:54.091384 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:56:54.102548 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:56:54.170704 tst mo_mt_call.py: using LAC 29639 17:56:54.290043 tst mo_mt_call.py: using RAC 59 17:56:54.409422 tst mo_mt_call.py: using CellId 29639 17:56:54.529530 tst mo_mt_call.py: using BVCI 29640 17:56:54.639878 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:56:54.650930 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:56:54.661842 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:56:54.672697 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:56:54.683705 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:56:54.694593 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:56:54.812509 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:56:54.934562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:55.407504 run create_hlr_db(pid=31643): Launched 17:56:55.531508 bus /sierra_2: Setting Powered False 17:56:56.591770 run create_hlr_db(pid=31643): Terminated: ok {rc=0} 17:56:57.013696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31645): Launched 17:56:57.317295 run osmo-hlr_10.42.42.2(pid=31646): Launched 17:56:57.432104 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:57.969970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31648): Launched 17:56:58.272998 run osmo-stp_10.42.42.5(pid=31649): Launched 17:56:58.387405 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:58.932897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31651): Launched 17:56:59.234867 run osmo-msc_10.42.42.6(pid=31652): Launched 17:56:59.403602 run osmo-stp_10.42.42.5(pid=31649): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31649)] 17:56:59.531764 run osmo-stp_10.42.42.5(pid=31649): stdout: | (launched: 2022-12-10_17:56:58.217580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:59.660765 run osmo-stp_10.42.42.5(pid=31649): stderr: | 20221210175658390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175658390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175658390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175658391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175658391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175658391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175658391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:59.786627 run osmo-stp_10.42.42.5(pid=31649): stdout: | (launched: 2022-12-10_17:56:58.217580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:59.907676 run osmo-stp_10.42.42.5(pid=31649): stderr: | 20221210175658390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175658390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175658390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175658391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175658391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175658391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175658391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:00.051682 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31649): Process ended prematurely: osmo-stp_10.42.42.5(pid=31649) [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31649)] [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:57:00.060731 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:57:00.087308 run osmo-hlr_10.42.42.2(pid=31646): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31646)] 17:57:00.135042 run osmo-hlr_10.42.42.2(pid=31646): stdout: | (launched: 2022-12-10_17:56:57.261830) 17:57:00.184391 run osmo-hlr_10.42.42.2(pid=31646): stderr: | 20221210175657440 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175657440 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175657441 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175657441 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175657441 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175657441 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175657453 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175657462 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175657462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175657462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:00.253145 run osmo-msc_10.42.42.6(pid=31652): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31652)] 17:57:00.300889 run osmo-msc_10.42.42.6(pid=31652): stdout: | (launched: 2022-12-10_17:56:59.179382) 17:57:00.350137 run osmo-msc_10.42.42.6(pid=31652): stderr: | 20221210175659451 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175659451 DLGLOBAL DEBUG validating counter group 0x7f55db4d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175659451 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175659451 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175659451 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175659452 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175659455 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175659455 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175659455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175659455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:00.399711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31645): Terminating (SIGTERM) 17:57:00.438999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31648): Terminating (SIGTERM) 17:57:00.478120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31651): Terminating (SIGTERM) 17:57:00.517820 --- ParallelTerminationStrategy: PID 31645 died... 17:57:00.536659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31645): Terminated: ok {rc=0} 17:57:00.580573 --- ParallelTerminationStrategy: PID 31648 died... 17:57:00.599287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31648): Terminated: ok {rc=0} 17:57:00.642999 --- ParallelTerminationStrategy: PID 31651 died... 17:57:00.661703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31651): Terminated: ok {rc=0} 17:57:00.745513 bus /sierra_3: Setting Powered False 17:57:01.842156 bus /sierra_3: Setting Powered False 17:57:02.956430 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:57:04.106434 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:04.118739 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:57:04.190891 tst mo_mt_call_osmux.py: using LAC 29640 17:57:04.316088 tst mo_mt_call_osmux.py: using RAC 60 17:57:04.442280 tst mo_mt_call_osmux.py: using CellId 29640 17:57:04.560885 tst mo_mt_call_osmux.py: using BVCI 29641 17:57:04.670524 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:04.681830 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:04.692800 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:04.703786 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:04.714692 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:04.725770 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:57:04.844509 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:57:04.962672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:05.460496 run create_hlr_db(pid=31654): Launched 17:57:05.583830 bus /sierra_2: Setting Powered False 17:57:06.646810 run create_hlr_db(pid=31654): Terminated: ok {rc=0} 17:57:07.076537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31656): Launched 17:57:07.379288 run osmo-hlr_10.42.42.2(pid=31657): Launched 17:57:07.495468 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:08.018447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31659): Launched 17:57:08.320248 run osmo-stp_10.42.42.5(pid=31660): Launched 17:57:08.435141 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:08.981782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31662): Launched 17:57:09.283305 run osmo-msc_10.42.42.6(pid=31663): Launched 17:57:09.451625 run osmo-stp_10.42.42.5(pid=31660): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31660)] 17:57:09.578696 run osmo-stp_10.42.42.5(pid=31660): stdout: | (launched: 2022-12-10_17:57:08.264420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:09.706288 run osmo-stp_10.42.42.5(pid=31660): stderr: | 20221210175708436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175708436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175708436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175708437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175708437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175708437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175708437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:09.832235 run osmo-stp_10.42.42.5(pid=31660): stdout: | (launched: 2022-12-10_17:57:08.264420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:09.952114 run osmo-stp_10.42.42.5(pid=31660): stderr: | 20221210175708436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175708436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175708436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175708437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175708437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175708437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175708437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:10.095372 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31660): Process ended prematurely: osmo-stp_10.42.42.5(pid=31660) [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31660)] [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:57:10.104295 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 17:57:10.130808 run osmo-hlr_10.42.42.2(pid=31657): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31657)] 17:57:10.178429 run osmo-hlr_10.42.42.2(pid=31657): stdout: | (launched: 2022-12-10_17:57:07.323582) 17:57:10.227765 run osmo-hlr_10.42.42.2(pid=31657): stderr: | 20221210175707499 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175707499 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175707499 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175707499 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175707500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175707500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175707514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175707525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175707525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175707525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:10.296525 run osmo-msc_10.42.42.6(pid=31663): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31663)] 17:57:10.344293 run osmo-msc_10.42.42.6(pid=31663): stdout: | (launched: 2022-12-10_17:57:09.227968) 17:57:10.393525 run osmo-msc_10.42.42.6(pid=31663): stderr: | 20221210175709502 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175709502 DLGLOBAL DEBUG validating counter group 0x7ff9cc9c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175709502 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175709502 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175709502 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175709503 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175709504 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175709505 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175709505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175709505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:10.443147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31656): Terminating (SIGTERM) 17:57:10.483150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31659): Terminating (SIGTERM) 17:57:10.522584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31662): Terminating (SIGTERM) 17:57:10.562257 --- ParallelTerminationStrategy: PID 31656 died... 17:57:10.581428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31656): Terminated: ok {rc=0} 17:57:10.625310 --- ParallelTerminationStrategy: PID 31659 died... 17:57:10.643840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31659): Terminated: ok {rc=0} 17:57:10.687490 --- ParallelTerminationStrategy: PID 31662 died... 17:57:10.705973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31662): Terminated: ok {rc=0} 17:57:10.788788 bus /sierra_3: Setting Powered False 17:57:11.886830 bus /sierra_3: Setting Powered False 17:57:13.005913 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:57:14.255283 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:57:14.261614 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:57:14.294472 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:57:14.320937 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:57:14.377495 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:57:14.410210 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:57:14.436520 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:57:14.987714 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:57:15.040366 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:15.052176 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:57:15.122565 tst mo_mt_call.py: using LAC 29641 17:57:15.249670 tst mo_mt_call.py: using RAC 61 17:57:15.373932 tst mo_mt_call.py: using CellId 29641 17:57:15.500786 tst mo_mt_call.py: using BVCI 29642 17:57:15.610976 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:15.622276 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:15.633430 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:15.644377 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:15.655513 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:15.666607 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:57:15.782105 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:57:15.916108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:16.490564 run create_hlr_db(pid=31669): Launched 17:57:16.668008 bus /sierra_2: Setting Powered False 17:57:17.732497 run create_hlr_db(pid=31669): Terminated: ok {rc=0} 17:57:18.182354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31671): Launched 17:57:18.504782 run osmo-hlr_10.42.42.2(pid=31672): Launched 17:57:18.628141 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:19.182089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31674): Launched 17:57:19.504050 run osmo-stp_10.42.42.5(pid=31675): Launched 17:57:19.627700 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:20.210582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31677): Launched 17:57:20.532097 run osmo-msc_10.42.42.6(pid=31678): Launched 17:57:20.711540 run osmo-stp_10.42.42.5(pid=31675): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31675)] 17:57:20.852700 run osmo-stp_10.42.42.5(pid=31675): stdout: | (launched: 2022-12-10_17:57:19.444834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:20.989136 run osmo-stp_10.42.42.5(pid=31675): stderr: | 20221210175719636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175719636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175719636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175719637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175719639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175719639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175719639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:21.125479 run osmo-stp_10.42.42.5(pid=31675): stdout: | (launched: 2022-12-10_17:57:19.444834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:21.253421 run osmo-stp_10.42.42.5(pid=31675): stderr: | 20221210175719636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175719636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175719636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175719637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175719639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175719639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175719639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:21.406866 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31675): Process ended prematurely: osmo-stp_10.42.42.5(pid=31675) [trial-2377↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31675)] [trial-2377↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:57:21.416375 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:57:21.444769 run osmo-hlr_10.42.42.2(pid=31672): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31672)] 17:57:21.495796 run osmo-hlr_10.42.42.2(pid=31672): stdout: | (launched: 2022-12-10_17:57:18.446296) 17:57:21.548133 run osmo-hlr_10.42.42.2(pid=31672): stderr: | 20221210175718645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175718645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175718645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175718645 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175718645 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175718645 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175718658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175718666 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175718666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175718666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:21.621357 run osmo-msc_10.42.42.6(pid=31678): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31678)] 17:57:21.672065 run osmo-msc_10.42.42.6(pid=31678): stdout: | (launched: 2022-12-10_17:57:20.473625) 17:57:21.724127 run osmo-msc_10.42.42.6(pid=31678): stderr: | 20221210175720811 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175720811 DLGLOBAL DEBUG validating counter group 0x7f16a096ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175720811 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175720811 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175720811 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175720812 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175720813 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175720814 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175720814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175720814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:21.776701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31671): Terminating (SIGTERM) 17:57:21.819119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31674): Terminating (SIGTERM) 17:57:21.861549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31677): Terminating (SIGTERM) 17:57:21.903897 --- ParallelTerminationStrategy: PID 31671 died... 17:57:21.923920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31671): Terminated: ok {rc=0} 17:57:21.970645 --- ParallelTerminationStrategy: PID 31674 died... 17:57:21.990198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31674): Terminated: ok {rc=0} 17:57:22.036786 --- ParallelTerminationStrategy: PID 31677 died... 17:57:22.056681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31677): Terminated: ok {rc=0} 17:57:22.144333 bus /sierra_3: Setting Powered False 17:57:23.243293 bus /sierra_3: Setting Powered False 17:57:24.359962 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:57:25.506601 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:25.518398 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:57:25.593038 tst mo_mt_call_osmux.py: using LAC 29642 17:57:25.710210 tst mo_mt_call_osmux.py: using RAC 62 17:57:25.826842 tst mo_mt_call_osmux.py: using CellId 29642 17:57:25.943935 tst mo_mt_call_osmux.py: using BVCI 29643 17:57:26.055008 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:26.066284 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:26.077305 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:26.088278 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:26.099440 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:26.110352 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:57:26.225551 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:57:26.341763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:26.811726 run create_hlr_db(pid=31683): Launched 17:57:26.935525 bus /sierra_2: Setting Powered False 17:57:27.995447 run create_hlr_db(pid=31683): Terminated: ok {rc=0} 17:57:28.436606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31685): Launched 17:57:28.761315 run osmo-hlr_10.42.42.2(pid=31686): Launched 17:57:28.887336 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:29.444841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31688): Launched 17:57:29.766125 run osmo-stp_10.42.42.5(pid=31689): Launched 17:57:29.890911 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:30.479883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31691): Launched 17:57:30.803815 run osmo-msc_10.42.42.6(pid=31692): Launched 17:57:31.036056 run osmo-stp_10.42.42.5(pid=31689): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31689)] 17:57:31.302616 run osmo-stp_10.42.42.5(pid=31689): stdout: | (launched: 2022-12-10_17:57:29.707338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:31.623998 run osmo-stp_10.42.42.5(pid=31689): stderr: | 20221210175729900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175729900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175729901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175729901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175729902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175729902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175729902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:31.773398 run osmo-stp_10.42.42.5(pid=31689): stdout: | (launched: 2022-12-10_17:57:29.707338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:31.900527 run osmo-stp_10.42.42.5(pid=31689): stderr: | 20221210175729900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175729900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175729901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175729901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175729902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175729902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175729902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:32.051956 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31689): Process ended prematurely: osmo-stp_10.42.42.5(pid=31689) [trial-2377↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31689)] [trial-2377↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:57:32.061590 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 17:57:32.089950 run osmo-hlr_10.42.42.2(pid=31686): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31686)] 17:57:32.139538 run osmo-hlr_10.42.42.2(pid=31686): stdout: | (launched: 2022-12-10_17:57:28.702353) 17:57:32.191747 run osmo-hlr_10.42.42.2(pid=31686): stderr: | 20221210175728901 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175728901 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175728901 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175728901 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175728901 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175728901 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175728913 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175728922 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175728922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175728922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:32.264022 run osmo-msc_10.42.42.6(pid=31692): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31692)] 17:57:32.312841 run osmo-msc_10.42.42.6(pid=31692): stdout: | (launched: 2022-12-10_17:57:30.744775) 17:57:32.362806 run osmo-msc_10.42.42.6(pid=31692): stderr: | 20221210175731310 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175731310 DLGLOBAL DEBUG validating counter group 0x7f856fcc1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175731310 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175731310 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175731310 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175731310 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175731312 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175731312 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175731313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175731313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:32.412871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31685): Terminating (SIGTERM) 17:57:32.453024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31688): Terminating (SIGTERM) 17:57:32.493541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31691): Terminating (SIGTERM) 17:57:32.534046 --- ParallelTerminationStrategy: PID 31685 died... 17:57:32.553450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31685): Terminated: ok {rc=0} 17:57:32.598080 --- ParallelTerminationStrategy: PID 31688 died... 17:57:32.616842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31688): Terminated: ok {rc=0} 17:57:32.661387 --- ParallelTerminationStrategy: PID 31691 died... 17:57:32.680213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31691): Terminated: ok {rc=0} 17:57:32.766913 bus /sierra_3: Setting Powered False 17:57:33.867057 bus /sierra_3: Setting Powered False 17:57:34.984718 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:57:36.241291 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:57:36.247589 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:57:36.280514 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:57:36.307015 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:57:36.358578 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:57:36.390857 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:57:36.416891 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:57:36.966804 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:57:37.014882 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:37.026123 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:57:37.095677 tst mo_mt_call.py: using LAC 29643 17:57:37.214092 tst mo_mt_call.py: using RAC 63 17:57:37.333161 tst mo_mt_call.py: using CellId 29643 17:57:37.451792 tst mo_mt_call.py: using BVCI 29644 17:57:37.563180 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:37.574249 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:37.585002 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:37.595660 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:37.606399 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:37.617247 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:57:37.731539 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:57:37.849700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:38.348933 run create_hlr_db(pid=31699): Launched 17:57:38.473494 bus /sierra_2: Setting Powered False 17:57:39.536917 run create_hlr_db(pid=31699): Terminated: ok {rc=0} 17:57:39.969470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31701): Launched 17:57:40.271406 run osmo-hlr_10.42.42.2(pid=31702): Launched 17:57:40.386711 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:40.928157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31704): Launched 17:57:41.230137 run osmo-stp_10.42.42.5(pid=31705): Launched 17:57:41.345674 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:41.893122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31707): Launched 17:57:42.196398 run osmo-msc_10.42.42.6(pid=31708): Launched 17:57:42.365746 run osmo-stp_10.42.42.5(pid=31705): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31705)] 17:57:42.493440 run osmo-stp_10.42.42.5(pid=31705): stdout: | (launched: 2022-12-10_17:57:41.174742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:42.621186 run osmo-stp_10.42.42.5(pid=31705): stderr: | 20221210175741346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175741346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175741346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175741347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175741347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175741347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175741347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:42.747227 run osmo-stp_10.42.42.5(pid=31705): stdout: | (launched: 2022-12-10_17:57:41.174742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:42.867897 run osmo-stp_10.42.42.5(pid=31705): stderr: | 20221210175741346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175741346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175741346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175741347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175741347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175741347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175741347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:43.011808 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31705): Process ended prematurely: osmo-stp_10.42.42.5(pid=31705) [trial-2377↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31705)] [trial-2377↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:57:43.020897 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:57:43.047279 run osmo-hlr_10.42.42.2(pid=31702): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31702)] 17:57:43.095199 run osmo-hlr_10.42.42.2(pid=31702): stdout: | (launched: 2022-12-10_17:57:40.216164) 17:57:43.145401 run osmo-hlr_10.42.42.2(pid=31702): stderr: | 20221210175740394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175740394 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175740394 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175740394 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175740394 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175740394 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175740407 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175740418 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175740418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175740418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:43.214798 run osmo-msc_10.42.42.6(pid=31708): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31708)] 17:57:43.262954 run osmo-msc_10.42.42.6(pid=31708): stdout: | (launched: 2022-12-10_17:57:42.140655) 17:57:43.312558 run osmo-msc_10.42.42.6(pid=31708): stderr: | 20221210175742416 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175742416 DLGLOBAL DEBUG validating counter group 0x7f955b6c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175742416 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175742416 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175742416 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175742417 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175742419 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175742420 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175742420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175742420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:43.362599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31701): Terminating (SIGTERM) 17:57:43.402580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31704): Terminating (SIGTERM) 17:57:43.442598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31707): Terminating (SIGTERM) 17:57:43.482730 --- ParallelTerminationStrategy: PID 31701 died... 17:57:43.502020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31701): Terminated: ok {rc=0} 17:57:43.546220 --- ParallelTerminationStrategy: PID 31704 died... 17:57:43.564884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31704): Terminated: ok {rc=0} 17:57:43.608675 --- ParallelTerminationStrategy: PID 31707 died... 17:57:43.627408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31707): Terminated: ok {rc=0} 17:57:43.714004 bus /sierra_3: Setting Powered False 17:57:44.814078 bus /sierra_3: Setting Powered False 17:57:45.939853 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:57:47.081237 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:47.093419 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:57:47.168134 tst mo_mt_call_osmux.py: using LAC 29644 17:57:47.320595 tst mo_mt_call_osmux.py: using RAC 64 17:57:47.445473 tst mo_mt_call_osmux.py: using CellId 29644 17:57:47.572310 tst mo_mt_call_osmux.py: using BVCI 29645 17:57:47.689339 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:47.700712 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:47.712369 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:47.723971 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:47.736133 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:47.747774 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:57:47.865364 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:57:47.986287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:48.485807 run create_hlr_db(pid=31710): Launched 17:57:48.609051 bus /sierra_2: Setting Powered False 17:57:49.672880 run create_hlr_db(pid=31710): Terminated: ok {rc=0} 17:57:50.105257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31712): Launched 17:57:50.408770 run osmo-hlr_10.42.42.2(pid=31713): Launched 17:57:50.524574 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:51.044802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31715): Launched 17:57:51.347365 run osmo-stp_10.42.42.5(pid=31716): Launched 17:57:51.462034 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:52.007977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31718): Launched 17:57:52.311236 run osmo-msc_10.42.42.6(pid=31719): Launched 17:57:52.480537 run osmo-stp_10.42.42.5(pid=31716): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31716)] 17:57:52.609181 run osmo-stp_10.42.42.5(pid=31716): stdout: | (launched: 2022-12-10_17:57:51.291748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:52.736628 run osmo-stp_10.42.42.5(pid=31716): stderr: | 20221210175751463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175751463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175751463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175751464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175751464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175751464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175751464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:52.862750 run osmo-stp_10.42.42.5(pid=31716): stdout: | (launched: 2022-12-10_17:57:51.291748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:52.983265 run osmo-stp_10.42.42.5(pid=31716): stderr: | 20221210175751463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175751463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175751463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175751464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175751464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175751464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175751464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:53.127450 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31716): Process ended prematurely: osmo-stp_10.42.42.5(pid=31716) [trial-2377↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31716)] [trial-2377↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:57:53.136477 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:57:53.163534 run osmo-hlr_10.42.42.2(pid=31713): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31713)] 17:57:53.211698 run osmo-hlr_10.42.42.2(pid=31713): stdout: | (launched: 2022-12-10_17:57:50.353376) 17:57:53.261527 run osmo-hlr_10.42.42.2(pid=31713): stderr: | 20221210175750530 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175750530 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175750530 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175750530 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175750530 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175750531 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175750543 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175750553 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175750553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175750553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:53.331097 run osmo-msc_10.42.42.6(pid=31719): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31719)] 17:57:53.379062 run osmo-msc_10.42.42.6(pid=31719): stdout: | (launched: 2022-12-10_17:57:52.255778) 17:57:53.428480 run osmo-msc_10.42.42.6(pid=31719): stderr: | 20221210175752527 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175752527 DLGLOBAL DEBUG validating counter group 0x7fdd234e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175752528 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175752528 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175752528 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175752528 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175752530 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175752530 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175752530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175752530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:53.478295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31712): Terminating (SIGTERM) 17:57:53.517978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31715): Terminating (SIGTERM) 17:57:53.557938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31718): Terminating (SIGTERM) 17:57:53.598138 --- ParallelTerminationStrategy: PID 31712 died... 17:57:53.617265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31712): Terminated: ok {rc=0} 17:57:53.661656 --- ParallelTerminationStrategy: PID 31715 died... 17:57:53.680326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31715): Terminated: ok {rc=0} 17:57:53.724637 --- ParallelTerminationStrategy: PID 31718 died... 17:57:53.743627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31718): Terminated: ok {rc=0} 17:57:53.831016 bus /sierra_3: Setting Powered False 17:57:54.932871 bus /sierra_3: Setting Powered False 17:57:56.050703 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 emergency:trx-lms --------------------------------------------------------------------- 17:57:57.299546 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:57:57.304006 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 17:57:57.337676 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 17:57:57.364272 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 17:57:57.449382 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 17:57:57.482511 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 17:57:57.509322 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 17:57:58.098781 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2377 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 17:57:58.104301 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:57:58.115632 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 17:57:58.166269 tst emergency_mo_mt_call.py: using LAC 29645 17:57:58.289653 tst emergency_mo_mt_call.py: using RAC 65 17:57:58.410868 tst emergency_mo_mt_call.py: using CellId 29645 17:57:58.531892 tst emergency_mo_mt_call.py: using BVCI 29646 17:57:58.646051 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:57:58.657233 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:57:58.668221 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:57:58.679504 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:57:58.690717 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:57:58.701853 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:57:58.816388 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:57:58.936703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:59.426687 run create_hlr_db(pid=31724): Launched 17:57:59.550012 bus /sierra_2: Setting Powered False 17:58:00.609553 run create_hlr_db(pid=31724): Terminated: ok {rc=0} 17:58:01.055082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31726): Launched 17:58:01.407095 run osmo-hlr_10.42.42.2(pid=31727): Launched 17:58:01.649637 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:02.353183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31729): Launched 17:58:02.669271 run osmo-stp_10.42.42.5(pid=31730): Launched 17:58:02.801997 tst emergency_mo_mt_call.py: using MSISDN 7827 17:58:02.965239 run osmo-msc_10.42.42.6: Starting osmo-msc 17:58:03.535537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31732): Launched 17:58:03.852052 run osmo-msc_10.42.42.6(pid=31733): Launched 17:58:04.029953 run osmo-stp_10.42.42.5(pid=31730): ERR: Terminated: ERROR {rc=1} [trial-2377↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31730)] 17:58:04.164287 run osmo-stp_10.42.42.5(pid=31730): stdout: | (launched: 2022-12-10_17:58:02.611395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:04.299707 run osmo-stp_10.42.42.5(pid=31730): stderr: | 20221210175802802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175802802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175802802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175802803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175802803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175802803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175802803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:04.434413 run osmo-stp_10.42.42.5(pid=31730): stdout: | (launched: 2022-12-10_17:58:02.611395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:04.560726 run osmo-stp_10.42.42.5(pid=31730): stderr: | 20221210175802802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175802802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175802802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175802803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175802803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175802803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175802803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:04.712040 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=31730): Process ended prematurely: osmo-stp_10.42.42.5(pid=31730) [trial-2377↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31730)] [trial-2377↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 17:58:04.721101 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 17:58:04.749986 run osmo-hlr_10.42.42.2(pid=31727): ERR: Terminated: ERROR {rc=237} [trial-2377↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31727)] 17:58:04.801163 run osmo-hlr_10.42.42.2(pid=31727): stdout: | (launched: 2022-12-10_17:58:01.349516) 17:58:04.854279 run osmo-hlr_10.42.42.2(pid=31727): stderr: | 20221210175801656 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175801656 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175801656 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175801656 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175801656 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175801656 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175801674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175801682 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175801682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175801682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:04.927415 run osmo-msc_10.42.42.6(pid=31733): ERR: Terminated: ERROR {rc=2} [trial-2377↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31733)] 17:58:04.978055 run osmo-msc_10.42.42.6(pid=31733): stdout: | (launched: 2022-12-10_17:58:03.794310) 17:58:05.030213 run osmo-msc_10.42.42.6(pid=31733): stderr: | 20221210175804111 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175804111 DLGLOBAL DEBUG validating counter group 0x7f063a62cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175804112 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175804112 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175804112 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175804112 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175804114 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175804114 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175804114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175804115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:58:05.082614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31726): Terminating (SIGTERM) 17:58:05.124561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31729): Terminating (SIGTERM) 17:58:05.166696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31732): Terminating (SIGTERM) 17:58:05.209207 --- ParallelTerminationStrategy: PID 31726 died... 17:58:05.229243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31726): Terminated: ok {rc=0} 17:58:05.276024 --- ParallelTerminationStrategy: PID 31729 died... 17:58:05.295648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31729): Terminated: ok {rc=0} 17:58:05.342286 --- ParallelTerminationStrategy: PID 31732 died... 17:58:05.361864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31732): Terminated: ok {rc=0} 17:58:05.451220 bus /sierra_3: Setting Powered False 17:58:06.550556 bus /sierra_3: Setting Powered False 17:58:07.666341 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 17:58:08.753547 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:08.765698 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 17:58:08.819217 tst emergency_preemptive_call.py: using LAC 29646 17:58:08.948166 tst emergency_preemptive_call.py: using RAC 66 17:58:09.070067 tst emergency_preemptive_call.py: using CellId 29646 17:58:09.191480 tst emergency_preemptive_call.py: using BVCI 29647 17:58:09.305963 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:09.316882 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:09.327903 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:09.339073 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:09.350429 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:09.361632 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:58:09.480069 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:58:09.594603 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:58:09.707642 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:58:09.824091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:10.286341 run create_hlr_db(pid=31735): Launched 17:58:10.410898 bus /sierra_2: Setting Powered False 17:58:11.469983 run create_hlr_db(pid=31735): Terminated: ok {rc=0} 17:58:11.903883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31737): Launched 17:58:12.221311 run osmo-hlr_10.42.42.2(pid=31738): Launched 17:58:12.342601 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:12.891306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31740): Launched 17:58:13.207710 run osmo-stp_10.42.42.5(pid=31741): Launched 17:58:13.336903 tst emergency_preemptive_call.py: using MSISDN 7828 17:58:13.501152 run osmo-msc_10.42.42.6: Starting osmo-msc 17:58:14.070451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31743): Launched 17:58:14.388497 run osmo-msc_10.42.42.6(pid=31744): Launched 17:58:14.565716 run osmo-stp_10.42.42.5(pid=31741): ERR: Terminated: ERROR {rc=1} [trial-2377↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31741)] 17:58:14.699844 run osmo-stp_10.42.42.5(pid=31741): stdout: | (launched: 2022-12-10_17:58:13.149997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:14.834677 run osmo-stp_10.42.42.5(pid=31741): stderr: | 20221210175813342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175813342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175813342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175813343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175813344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175813344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175813344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:14.969555 run osmo-stp_10.42.42.5(pid=31741): stdout: | (launched: 2022-12-10_17:58:13.149997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:15.094909 run osmo-stp_10.42.42.5(pid=31741): stderr: | 20221210175813342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175813342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175813342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175813343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175813344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175813344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175813344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:15.245216 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=31741): Process ended prematurely: osmo-stp_10.42.42.5(pid=31741) [trial-2377↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31741)] [trial-2377↪emergency:trx-lms↪emergency_preemptive_call.py:32] 17:58:15.254175 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 17:58:15.281912 run osmo-hlr_10.42.42.2(pid=31738): ERR: Terminated: ERROR {rc=237} [trial-2377↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31738)] 17:58:15.332801 run osmo-hlr_10.42.42.2(pid=31738): stdout: | (launched: 2022-12-10_17:58:12.162786) 17:58:15.385135 run osmo-hlr_10.42.42.2(pid=31738): stderr: | 20221210175812359 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175812359 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175812359 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175812359 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175812359 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175812359 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175812375 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175812385 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175812385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175812385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:15.457767 run osmo-msc_10.42.42.6(pid=31744): ERR: Terminated: ERROR {rc=2} [trial-2377↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31744)] 17:58:15.508491 run osmo-msc_10.42.42.6(pid=31744): stdout: | (launched: 2022-12-10_17:58:14.330542) 17:58:15.560886 run osmo-msc_10.42.42.6(pid=31744): stderr: | 20221210175814673 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210175814674 DLGLOBAL DEBUG validating counter group 0x7fb4f2b0ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210175814674 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210175814674 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210175814674 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210175814674 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210175814676 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210175814676 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210175814676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210175814677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:58:15.613659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31737): Terminating (SIGTERM) 17:58:15.655828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31740): Terminating (SIGTERM) 17:58:15.698116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31743): Terminating (SIGTERM) 17:58:15.740510 --- ParallelTerminationStrategy: PID 31737 died... 17:58:15.760590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31737): Terminated: ok {rc=0} 17:58:15.807368 --- ParallelTerminationStrategy: PID 31740 died... 17:58:15.827349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31740): Terminated: ok {rc=0} 17:58:15.875860 --- ParallelTerminationStrategy: PID 31743 died... 17:58:15.900584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31743): Terminated: ok {rc=0} 17:58:15.993458 bus /sierra_9: Setting Powered False 17:58:17.118937 bus /sierra_9: Setting Powered False 17:58:18.246408 bus /sierra_8: Setting Powered False 17:58:19.346638 bus /sierra_8: Setting Powered False 17:58:20.463615 bus /sierra_3: Setting Powered False 17:58:21.559265 bus /sierra_3: Setting Powered False 17:58:22.674701 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-lms --------------------------------------------------------------------- 17:58:23.952073 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:58:23.956367 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 17:58:23.989609 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 17:58:24.027967 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 17:58:24.114732 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 17:58:24.147358 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 17:58:24.185206 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 17:58:24.774542 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 17:58:24.824878 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:24.835646 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 17:58:24.888361 tst cs_paging_gprs_active.py: using LAC 29647 17:58:25.008452 tst cs_paging_gprs_active.py: using RAC 67 17:58:25.125940 tst cs_paging_gprs_active.py: using CellId 29647 17:58:25.242469 tst cs_paging_gprs_active.py: using BVCI 29648 17:58:25.353514 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:25.364133 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:25.374520 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:25.385025 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:25.396000 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:25.406737 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:25.417579 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:25.428117 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:25.439032 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:58:25.557171 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:58:25.678026 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:58:25.879991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:26.183220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31749): Launched 17:58:26.447586 run iperf3-srv_10.42.42.10(pid=31750): Launched 17:58:26.562469 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:58:26.763378 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:27.066634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31751): Launched 17:58:27.332200 run iperf3-srv_10.42.42.10(pid=31752): Launched 17:58:27.446243 tst cs_paging_gprs_active.py:38: start network... 17:58:27.648168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:28.117198 run create_hlr_db(pid=31753): Launched 17:58:28.241126 bus /sierra_2: Setting Powered False 17:58:29.302018 run create_hlr_db(pid=31753): Terminated: ok {rc=0} 17:58:29.722257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31755): Launched 17:58:30.026056 run osmo-hlr_10.42.42.2(pid=31756): Launched 17:58:30.141590 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:30.679676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31758): Launched 17:58:31.007991 run osmo-stp_10.42.42.5(pid=31759): Launched 17:58:31.254205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:58:31.993158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31761): Launched 17:58:32.131313 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:58:32.412860 run patchelf(pid=31762): Launched 17:58:32.595467 run osmo-stp_10.42.42.5(pid=31759): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31759)] 17:58:32.732756 run osmo-stp_10.42.42.5(pid=31759): stdout: | (launched: 2022-12-10_17:58:30.947627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:32.871281 run osmo-stp_10.42.42.5(pid=31759): stderr: | 20221210175831324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175831324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175831327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175831328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175831328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175831328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175831328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:33.011372 run osmo-stp_10.42.42.5(pid=31759): stdout: | (launched: 2022-12-10_17:58:30.947627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:33.144159 run osmo-stp_10.42.42.5(pid=31759): stderr: | 20221210175831324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175831324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175831327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175831328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175831328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175831328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175831328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:33.301201 run patchelf(pid=31762): Terminating (SIGINT) 17:58:33.481092 run patchelf(pid=31762): Terminated: ok {rc=0} 17:58:33.610835 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31759): Process ended prematurely: osmo-stp_10.42.42.5(pid=31759) [trial-2377↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31759)] [trial-2377↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 17:58:33.621050 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 17:58:33.650173 run osmo-hlr_10.42.42.2(pid=31756): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31756)] 17:58:33.700611 run osmo-hlr_10.42.42.2(pid=31756): stdout: | (launched: 2022-12-10_17:58:29.969979) 17:58:33.752628 run osmo-hlr_10.42.42.2(pid=31756): stderr: | 20221210175830146 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175830146 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175830146 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175830146 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175830146 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175830146 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175830158 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175830167 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175830167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175830167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:33.805302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31749): Terminating (SIGTERM) 17:58:33.847522 run iperf3-srv_10.42.42.10(pid=31750): Terminating (SIGTERM) 17:58:33.889946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31751): Terminating (SIGTERM) 17:58:33.932104 run iperf3-srv_10.42.42.10(pid=31752): Terminating (SIGTERM) 17:58:33.974041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31755): Terminating (SIGTERM) 17:58:34.016050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31758): Terminating (SIGTERM) 17:58:34.058386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31761): Terminating (SIGTERM) 17:58:34.100752 --- ParallelTerminationStrategy: PID 31749 died... 17:58:34.120483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31749): Terminated: ok {rc=0} 17:58:34.167103 --- ParallelTerminationStrategy: PID 31750 died... 17:58:34.186617 run iperf3-srv_10.42.42.10(pid=31750): Terminated {rc=256} 17:58:34.233081 --- ParallelTerminationStrategy: PID 31751 died... 17:58:34.252658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31751): Terminated: ok {rc=0} 17:58:34.299039 --- ParallelTerminationStrategy: PID 31752 died... 17:58:34.318530 run iperf3-srv_10.42.42.10(pid=31752): Terminated {rc=256} 17:58:34.365050 --- ParallelTerminationStrategy: PID 31755 died... 17:58:34.384603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31755): Terminated: ok {rc=0} 17:58:34.431159 --- ParallelTerminationStrategy: PID 31758 died... 17:58:34.450636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31758): Terminated: ok {rc=0} 17:58:34.497521 --- ParallelTerminationStrategy: PID 31761 died... 17:58:34.517032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31761): Terminated: ok {rc=0} 17:58:34.604913 bus /gobi_0: Setting Powered False 17:58:35.704298 bus /gobi_0: Setting Powered False 17:58:36.822234 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms iperf3.py ---------------------------------------------- 17:58:37.967995 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:37.979185 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 17:58:38.030612 tst iperf3.py: using LAC 29648 17:58:38.151354 tst iperf3.py: using RAC 68 17:58:38.272659 tst iperf3.py: using CellId 29648 17:58:38.391363 tst iperf3.py: using BVCI 29649 17:58:38.501892 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:38.512548 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:38.523045 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:38.533412 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:38.543628 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:38.553974 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:38.564347 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:38.574665 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:38.585244 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:58:38.702234 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:58:38.921173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:39.245290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31763): Launched 17:58:39.527144 run iperf3-srv_10.42.42.10(pid=31764): Launched 17:58:39.650694 tst iperf3.py:8: start network... 17:58:39.868666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:40.370790 run create_hlr_db(pid=31765): Launched 17:58:40.496774 bus /gobi_6: Setting Powered False 17:58:41.560650 run create_hlr_db(pid=31765): Terminated: ok {rc=0} 17:58:41.993875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31767): Launched 17:58:42.298280 run osmo-hlr_10.42.42.2(pid=31768): Launched 17:58:42.416527 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:42.957546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31770): Launched 17:58:43.261497 run osmo-stp_10.42.42.5(pid=31771): Launched 17:58:43.376492 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:58:43.897749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31773): Launched 17:58:44.013667 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:58:44.269770 run patchelf(pid=31774): Launched 17:58:44.438834 run osmo-stp_10.42.42.5(pid=31771): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31771)] 17:58:44.568152 run osmo-stp_10.42.42.5(pid=31771): stdout: | (launched: 2022-12-10_17:58:43.205447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:44.698313 run osmo-stp_10.42.42.5(pid=31771): stderr: | 20221210175843375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175843375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175843375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175843375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175843376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175843376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175843376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:44.828398 run osmo-stp_10.42.42.5(pid=31771): stdout: | (launched: 2022-12-10_17:58:43.205447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:44.952935 run osmo-stp_10.42.42.5(pid=31771): stderr: | 20221210175843375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175843375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175843375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175843375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175843376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175843376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175843376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:45.100654 run patchelf(pid=31774): Terminating (SIGINT) 17:58:45.270977 run patchelf(pid=31774): Terminated: ok {rc=0} 17:58:45.394190 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31771): Process ended prematurely: osmo-stp_10.42.42.5(pid=31771) [trial-2377↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31771)] [trial-2377↪gprs:trx-lms↪iperf3.py:8] 17:58:45.403597 tst iperf3.py:8: Test FAILED (7.5 sec) 17:58:45.430926 run osmo-hlr_10.42.42.2(pid=31768): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31768)] 17:58:45.478589 run osmo-hlr_10.42.42.2(pid=31768): stdout: | (launched: 2022-12-10_17:58:42.242313) 17:58:45.528038 run osmo-hlr_10.42.42.2(pid=31768): stderr: | 20221210175842420 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175842420 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175842420 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175842420 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175842420 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175842420 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175842432 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175842443 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175842443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175842443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:45.577997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31763): Terminating (SIGTERM) 17:58:45.617829 run iperf3-srv_10.42.42.10(pid=31764): Terminating (SIGTERM) 17:58:45.657356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31767): Terminating (SIGTERM) 17:58:45.697262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31770): Terminating (SIGTERM) 17:58:45.736680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31773): Terminating (SIGTERM) 17:58:45.776377 --- ParallelTerminationStrategy: PID 31763 died... 17:58:45.795594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31763): Terminated: ok {rc=0} 17:58:45.844369 --- ParallelTerminationStrategy: PID 31764 died... 17:58:45.864128 run iperf3-srv_10.42.42.10(pid=31764): Terminated {rc=256} 17:58:45.929057 --- ParallelTerminationStrategy: PID 31767 died... 17:58:45.948301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31767): Terminated: ok {rc=0} 17:58:45.995931 --- ParallelTerminationStrategy: PID 31770 died... 17:58:46.021878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31770): Terminated: ok {rc=0} 17:58:46.078635 --- ParallelTerminationStrategy: PID 31773 died... 17:58:46.101900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31773): Terminated: ok {rc=0} 17:58:46.207091 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms iperf3m4.py ---------------------------------------------- 17:58:47.359519 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:47.370876 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 17:58:47.421187 tst iperf3m4.py: using LAC 29649 17:58:47.541408 tst iperf3m4.py: using RAC 69 17:58:47.659816 tst iperf3m4.py: using CellId 29649 17:58:47.778221 tst iperf3m4.py: using BVCI 29650 17:58:47.887656 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:47.898316 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:47.908711 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:47.919137 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:47.929489 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:47.939791 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:47.950238 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:47.960469 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:47.970956 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:58:48.089639 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:58:48.213480 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:58:48.334445 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:58:48.452415 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:58:48.655460 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:48.957309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31775): Launched 17:58:49.219485 run iperf3-srv_10.42.42.10(pid=31776): Launched 17:58:49.332211 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:58:49.532931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:49.835219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31777): Launched 17:58:50.098155 run iperf3-srv_10.42.42.10(pid=31778): Launched 17:58:50.213306 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:58:50.414234 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:50.717321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31779): Launched 17:58:50.980009 run iperf3-srv_10.42.42.10(pid=31780): Launched 17:58:51.093335 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:58:51.293852 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:51.595221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31781): Launched 17:58:51.857663 run iperf3-srv_10.42.42.10(pid=31782): Launched 17:58:51.970966 tst iperf3m4.py:8: start network... 17:58:52.172124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:52.640205 run create_hlr_db(pid=31783): Launched 17:58:52.763213 bus /gobi_6: Setting Powered False 17:58:53.823433 run create_hlr_db(pid=31783): Terminated: ok {rc=0} 17:58:54.265071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31785): Launched 17:58:54.588845 run osmo-hlr_10.42.42.2(pid=31786): Launched 17:58:54.712340 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:55.270133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31788): Launched 17:58:55.594070 run osmo-stp_10.42.42.5(pid=31789): Launched 17:58:55.716813 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:58:56.272476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31791): Launched 17:58:56.396127 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:58:56.668750 run patchelf(pid=31792): Launched 17:58:56.848852 run osmo-stp_10.42.42.5(pid=31789): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31789)] 17:58:56.986853 run osmo-stp_10.42.42.5(pid=31789): stdout: | (launched: 2022-12-10_17:58:55.535174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:57.126026 run osmo-stp_10.42.42.5(pid=31789): stderr: | 20221210175855723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175855723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175855723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175855723 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175855724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175855724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175855724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:57.264767 run osmo-stp_10.42.42.5(pid=31789): stdout: | (launched: 2022-12-10_17:58:55.535174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:57.397880 run osmo-stp_10.42.42.5(pid=31789): stderr: | 20221210175855723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175855723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175855723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175855723 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175855724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175855724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175855724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:57.555729 run patchelf(pid=31792): Terminating (SIGINT) 17:58:57.736721 run patchelf(pid=31792): Terminated: ok {rc=0} 17:58:57.867238 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31789): Process ended prematurely: osmo-stp_10.42.42.5(pid=31789) [trial-2377↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31789)] [trial-2377↪gprs:trx-lms↪iperf3m4.py:8] 17:58:57.877804 tst iperf3m4.py:8: Test FAILED (10.6 sec) 17:58:57.907239 run osmo-hlr_10.42.42.2(pid=31786): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31786)] 17:58:57.959270 run osmo-hlr_10.42.42.2(pid=31786): stdout: | (launched: 2022-12-10_17:58:54.529744) 17:58:58.012197 run osmo-hlr_10.42.42.2(pid=31786): stderr: | 20221210175854725 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175854725 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175854725 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175854725 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175854725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175854725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175854738 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175854746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175854746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175854746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:58.065453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31775): Terminating (SIGTERM) 17:58:58.108083 run iperf3-srv_10.42.42.10(pid=31776): Terminating (SIGTERM) 17:58:58.150815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31777): Terminating (SIGTERM) 17:58:58.193473 run iperf3-srv_10.42.42.10(pid=31778): Terminating (SIGTERM) 17:58:58.235979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31779): Terminating (SIGTERM) 17:58:58.278617 run iperf3-srv_10.42.42.10(pid=31780): Terminating (SIGTERM) 17:58:58.322562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31781): Terminating (SIGTERM) 17:58:58.365266 run iperf3-srv_10.42.42.10(pid=31782): Terminating (SIGTERM) 17:58:58.407914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31785): Terminating (SIGTERM) 17:58:58.450493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31788): Terminating (SIGTERM) 17:58:58.492894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31791): Terminating (SIGTERM) 17:58:58.535679 --- ParallelTerminationStrategy: PID 31775 died... 17:58:58.555441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31775): Terminated: ok {rc=0} 17:58:58.602927 --- ParallelTerminationStrategy: PID 31776 died... 17:58:58.622825 run iperf3-srv_10.42.42.10(pid=31776): Terminated {rc=256} 17:58:58.669738 --- ParallelTerminationStrategy: PID 31777 died... 17:58:58.689466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31777): Terminated: ok {rc=0} 17:58:58.736008 --- ParallelTerminationStrategy: PID 31778 died... 17:58:58.755362 run iperf3-srv_10.42.42.10(pid=31778): Terminated {rc=256} 17:58:58.802038 --- ParallelTerminationStrategy: PID 31779 died... 17:58:58.821654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31779): Terminated: ok {rc=0} 17:58:58.868456 --- ParallelTerminationStrategy: PID 31780 died... 17:58:58.888355 run iperf3-srv_10.42.42.10(pid=31780): Terminated {rc=256} 17:58:58.935356 --- ParallelTerminationStrategy: PID 31781 died... 17:58:58.955014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31781): Terminated: ok {rc=0} 17:58:59.001924 --- ParallelTerminationStrategy: PID 31782 died... 17:58:59.021565 run iperf3-srv_10.42.42.10(pid=31782): Terminated {rc=256} 17:58:59.068275 --- ParallelTerminationStrategy: PID 31785 died... 17:58:59.088096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31785): Terminated: ok {rc=0} 17:58:59.134747 --- ParallelTerminationStrategy: PID 31788 died... 17:58:59.154550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31788): Terminated: ok {rc=0} 17:58:59.201739 --- ParallelTerminationStrategy: PID 31791 died... 17:58:59.221471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31791): Terminated: ok {rc=0} 17:58:59.309277 bus /gobi_4: Setting Powered False 17:59:00.408236 bus /gobi_4: Setting Powered False 17:59:01.535283 bus /gobi_1: Setting Powered False 17:59:02.648718 bus /gobi_1: Setting Powered False 17:59:03.766801 bus /gobi_0: Setting Powered False 17:59:04.866404 bus /gobi_0: Setting Powered False 17:59:05.983130 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms ping.py ---------------------------------------------- 17:59:07.086152 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:07.098042 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 17:59:07.149786 tst ping.py: using LAC 29650 17:59:07.277250 tst ping.py: using RAC 70 17:59:07.398610 tst ping.py: using CellId 29650 17:59:07.519975 tst ping.py: using BVCI 29651 17:59:07.634382 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:07.645403 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:07.656302 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:07.667466 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:07.678564 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:07.689626 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:07.700682 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:07.711961 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:07.829911 tst ping.py:19: start network... 17:59:08.042093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:08.530932 run create_hlr_db(pid=31793): Launched 17:59:08.651573 bus /gobi_6: Setting Powered False 17:59:09.714386 run create_hlr_db(pid=31793): Terminated: ok {rc=0} 17:59:10.140311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31795): Launched 17:59:10.439784 run osmo-hlr_10.42.42.2(pid=31796): Launched 17:59:10.552923 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:11.085419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31798): Launched 17:59:11.383235 run osmo-stp_10.42.42.5(pid=31799): Launched 17:59:11.495481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:12.007826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31801): Launched 17:59:12.121954 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:12.372747 run patchelf(pid=31802): Launched 17:59:12.539765 run osmo-stp_10.42.42.5(pid=31799): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31799)] 17:59:12.666435 run osmo-stp_10.42.42.5(pid=31799): stdout: | (launched: 2022-12-10_17:59:11.328472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:12.795136 run osmo-stp_10.42.42.5(pid=31799): stderr: | 20221210175911498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175911498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175911498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175911499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175911499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175911499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175911499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:12.922991 run osmo-stp_10.42.42.5(pid=31799): stdout: | (launched: 2022-12-10_17:59:11.328472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:13.045752 run osmo-stp_10.42.42.5(pid=31799): stderr: | 20221210175911498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175911498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175911498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175911499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175911499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175911499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175911499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:13.190360 run patchelf(pid=31802): Terminating (SIGINT) 17:59:13.357393 run patchelf(pid=31802): Terminated: ok {rc=0} 17:59:13.477781 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31799): Process ended prematurely: osmo-stp_10.42.42.5(pid=31799) [trial-2377↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31799)] [trial-2377↪gprs:trx-lms↪ping.py:22] 17:59:13.486831 tst ping.py:22: Test FAILED (6.4 sec) 17:59:13.513961 run osmo-hlr_10.42.42.2(pid=31796): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31796)] 17:59:13.562084 run osmo-hlr_10.42.42.2(pid=31796): stdout: | (launched: 2022-12-10_17:59:10.385297) 17:59:13.611913 run osmo-hlr_10.42.42.2(pid=31796): stderr: | 20221210175910562 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175910562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175910562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175910562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175910562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175910562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175910574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175910584 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175910584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175910585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:13.662088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31795): Terminating (SIGTERM) 17:59:13.702172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31798): Terminating (SIGTERM) 17:59:13.742433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31801): Terminating (SIGTERM) 17:59:13.782701 --- ParallelTerminationStrategy: PID 31795 died... 17:59:13.802158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31795): Terminated: ok {rc=0} 17:59:13.846647 --- ParallelTerminationStrategy: PID 31798 died... 17:59:13.865337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31798): Terminated: ok {rc=0} 17:59:13.909146 --- ParallelTerminationStrategy: PID 31801 died... 17:59:13.927757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31801): Terminated: ok {rc=0} 17:59:14.011469 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 17:59:15.094925 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:15.106230 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 17:59:15.156049 tst ping_idle_ping.py: using LAC 29651 17:59:15.274736 tst ping_idle_ping.py: using RAC 71 17:59:15.392479 tst ping_idle_ping.py: using CellId 29651 17:59:15.509977 tst ping_idle_ping.py: using BVCI 29652 17:59:15.619545 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:15.630302 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:15.640846 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:15.651466 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:15.661840 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:15.672261 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:15.682896 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:15.693487 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:15.806720 tst ping_idle_ping.py:24: start network... 17:59:16.053071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:16.563188 run create_hlr_db(pid=31803): Launched 17:59:16.736262 bus /gobi_6: Setting Powered False 17:59:17.800305 run create_hlr_db(pid=31803): Terminated: ok {rc=0} 17:59:18.235996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31805): Launched 17:59:18.535850 run osmo-hlr_10.42.42.2(pid=31806): Launched 17:59:18.649995 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:19.162328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31808): Launched 17:59:19.460421 run osmo-stp_10.42.42.5(pid=31809): Launched 17:59:19.574111 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:20.086344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31811): Launched 17:59:20.200186 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:20.451264 run patchelf(pid=31812): Launched 17:59:20.617796 run osmo-stp_10.42.42.5(pid=31809): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31809)] 17:59:20.744264 run osmo-stp_10.42.42.5(pid=31809): stdout: | (launched: 2022-12-10_17:59:19.405233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:20.872803 run osmo-stp_10.42.42.5(pid=31809): stderr: | 20221210175919575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175919576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175919576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175919576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175919577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175919577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175919577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:21.001302 run osmo-stp_10.42.42.5(pid=31809): stdout: | (launched: 2022-12-10_17:59:19.405233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:21.123703 run osmo-stp_10.42.42.5(pid=31809): stderr: | 20221210175919575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175919576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175919576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175919576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175919577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175919577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175919577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:21.269395 run patchelf(pid=31812): Terminating (SIGINT) 17:59:21.436095 run patchelf(pid=31812): Terminated: ok {rc=0} 17:59:21.556153 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31809): Process ended prematurely: osmo-stp_10.42.42.5(pid=31809) [trial-2377↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31809)] [trial-2377↪gprs:trx-lms↪ping_idle_ping.py:27] 17:59:21.565427 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:59:21.592839 run osmo-hlr_10.42.42.2(pid=31806): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31806)] 17:59:21.640869 run osmo-hlr_10.42.42.2(pid=31806): stdout: | (launched: 2022-12-10_17:59:18.481024) 17:59:21.690406 run osmo-hlr_10.42.42.2(pid=31806): stderr: | 20221210175918657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175918657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175918657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175918657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175918657 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175918657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175918669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175918677 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175918678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175918678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:21.740446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31805): Terminating (SIGTERM) 17:59:21.780320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31808): Terminating (SIGTERM) 17:59:21.820242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31811): Terminating (SIGTERM) 17:59:21.860538 --- ParallelTerminationStrategy: PID 31805 died... 17:59:21.879789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31805): Terminated: ok {rc=0} 17:59:21.924261 --- ParallelTerminationStrategy: PID 31808 died... 17:59:21.943041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31808): Terminated: ok {rc=0} 17:59:21.987017 --- ParallelTerminationStrategy: PID 31811 died... 17:59:22.005827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31811): Terminated: ok {rc=0} 17:59:22.092164 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 17:59:23.391554 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:59:23.397302 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:59:23.430970 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:59:23.469471 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:59:23.555711 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:59:23.588851 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:59:23.627096 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:59:24.218977 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:59:24.268389 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:24.279461 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:59:24.330299 tst cs_paging_gprs_active.py: using LAC 29652 17:59:24.450297 tst cs_paging_gprs_active.py: using RAC 72 17:59:24.571601 tst cs_paging_gprs_active.py: using CellId 29652 17:59:24.691120 tst cs_paging_gprs_active.py: using BVCI 29653 17:59:24.802953 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:24.814106 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:24.824920 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:24.835948 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:24.846838 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:24.857717 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:24.868737 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:24.879548 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:24.890674 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:59:25.010871 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:59:25.130475 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:59:25.349974 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:25.676172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31816): Launched 17:59:25.960111 run iperf3-srv_10.42.42.10(pid=31817): Launched 17:59:26.083166 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:59:26.302257 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:26.630008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31818): Launched 17:59:26.913630 run iperf3-srv_10.42.42.10(pid=31819): Launched 17:59:27.036377 tst cs_paging_gprs_active.py:38: start network... 17:59:27.254985 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:27.757713 run create_hlr_db(pid=31820): Launched 17:59:27.882332 bus /gobi_6: Setting Powered False 17:59:28.946423 run create_hlr_db(pid=31820): Terminated: ok {rc=0} 17:59:29.395886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31822): Launched 17:59:29.719682 run osmo-hlr_10.42.42.2(pid=31823): Launched 17:59:29.846018 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:30.404546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31825): Launched 17:59:30.728291 run osmo-stp_10.42.42.5(pid=31826): Launched 17:59:30.858968 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:31.564403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31828): Launched 17:59:31.700284 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:31.985820 run patchelf(pid=31829): Launched 17:59:32.171189 run osmo-stp_10.42.42.5(pid=31826): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31826)] 17:59:32.302918 run osmo-stp_10.42.42.5(pid=31826): stdout: | (launched: 2022-12-10_17:59:30.669126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:32.434378 run osmo-stp_10.42.42.5(pid=31826): stderr: | 20221210175930925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175930925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175930926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175930926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175930927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175930927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175930927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:32.565455 run osmo-stp_10.42.42.5(pid=31826): stdout: | (launched: 2022-12-10_17:59:30.669126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:32.691086 run osmo-stp_10.42.42.5(pid=31826): stderr: | 20221210175930925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175930925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175930926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175930926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175930927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175930927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175930927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:32.839889 run patchelf(pid=31829): Terminating (SIGINT) 17:59:33.012766 run patchelf(pid=31829): Terminated: ok {rc=0} 17:59:33.135946 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31826): Process ended prematurely: osmo-stp_10.42.42.5(pid=31826) [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31826)] [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:59:33.145775 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:59:33.173552 run osmo-hlr_10.42.42.2(pid=31823): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31823)] 17:59:33.221706 run osmo-hlr_10.42.42.2(pid=31823): stdout: | (launched: 2022-12-10_17:59:29.660319) 17:59:33.271698 run osmo-hlr_10.42.42.2(pid=31823): stderr: | 20221210175929857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175929858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175929858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175929858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175929858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175929858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175929871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175929879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175929879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175929879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:33.322136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31816): Terminating (SIGTERM) 17:59:33.362690 run iperf3-srv_10.42.42.10(pid=31817): Terminating (SIGTERM) 17:59:33.403032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31818): Terminating (SIGTERM) 17:59:33.443551 run iperf3-srv_10.42.42.10(pid=31819): Terminating (SIGTERM) 17:59:33.483824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31822): Terminating (SIGTERM) 17:59:33.524164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31825): Terminating (SIGTERM) 17:59:33.564430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31828): Terminating (SIGTERM) 17:59:33.605153 --- ParallelTerminationStrategy: PID 31816 died... 17:59:33.624605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31816): Terminated: ok {rc=0} 17:59:33.669877 --- ParallelTerminationStrategy: PID 31817 died... 17:59:33.688722 run iperf3-srv_10.42.42.10(pid=31817): Terminated {rc=256} 17:59:33.733854 --- ParallelTerminationStrategy: PID 31818 died... 17:59:33.753018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31818): Terminated: ok {rc=0} 17:59:33.797701 --- ParallelTerminationStrategy: PID 31819 died... 17:59:33.816713 run iperf3-srv_10.42.42.10(pid=31819): Terminated {rc=256} 17:59:33.861525 --- ParallelTerminationStrategy: PID 31822 died... 17:59:33.880505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31822): Terminated: ok {rc=0} 17:59:33.925469 --- ParallelTerminationStrategy: PID 31825 died... 17:59:33.944563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31825): Terminated: ok {rc=0} 17:59:33.989306 --- ParallelTerminationStrategy: PID 31828 died... 17:59:34.008304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31828): Terminated: ok {rc=0} 17:59:34.095641 bus /gobi_0: Setting Powered False 17:59:35.194939 bus /gobi_0: Setting Powered False 17:59:36.308021 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:59:37.457681 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:37.469876 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:59:37.521701 tst iperf3.py: using LAC 29653 17:59:37.649630 tst iperf3.py: using RAC 73 17:59:37.776285 tst iperf3.py: using CellId 29653 17:59:37.902135 tst iperf3.py: using BVCI 29654 17:59:38.020240 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:38.031656 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:38.042867 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:38.054444 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:38.065855 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:38.077640 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:38.089138 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:38.100420 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:38.111932 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:59:38.231364 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:59:38.450102 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:38.775989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31830): Launched 17:59:39.060164 run iperf3-srv_10.42.42.10(pid=31831): Launched 17:59:39.182120 tst iperf3.py:8: start network... 17:59:39.400415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:39.901743 run create_hlr_db(pid=31832): Launched 17:59:40.027506 bus /gobi_6: Setting Powered False 17:59:41.091338 run create_hlr_db(pid=31832): Terminated: ok {rc=0} 17:59:41.543787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31834): Launched 17:59:41.867952 run osmo-hlr_10.42.42.2(pid=31835): Launched 17:59:41.993272 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:42.552425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31837): Launched 17:59:42.876021 run osmo-stp_10.42.42.5(pid=31838): Launched 17:59:42.999626 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:43.556155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31840): Launched 17:59:43.679531 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:43.952210 run patchelf(pid=31841): Launched 17:59:44.132701 run osmo-stp_10.42.42.5(pid=31838): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31838)] 17:59:44.270043 run osmo-stp_10.42.42.5(pid=31838): stdout: | (launched: 2022-12-10_17:59:42.817372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:44.409226 run osmo-stp_10.42.42.5(pid=31838): stderr: | 20221210175943008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175943008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175943008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175943009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175943009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175943009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175943010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:44.548415 run osmo-stp_10.42.42.5(pid=31838): stdout: | (launched: 2022-12-10_17:59:42.817372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:44.682269 run osmo-stp_10.42.42.5(pid=31838): stderr: | 20221210175943008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175943008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175943008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175943009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175943009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175943009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175943010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:44.839728 run patchelf(pid=31841): Terminating (SIGINT) 17:59:45.022061 run patchelf(pid=31841): Terminated: ok {rc=0} 17:59:45.152869 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31838): Process ended prematurely: osmo-stp_10.42.42.5(pid=31838) [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31838)] [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 17:59:45.163134 tst iperf3.py:8: Test FAILED (7.7 sec) 17:59:45.192688 run osmo-hlr_10.42.42.2(pid=31835): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31835)] 17:59:45.243163 run osmo-hlr_10.42.42.2(pid=31835): stdout: | (launched: 2022-12-10_17:59:41.808665) 17:59:45.295253 run osmo-hlr_10.42.42.2(pid=31835): stderr: | 20221210175942006 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175942006 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175942006 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175942007 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175942007 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175942007 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175942019 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175942027 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175942028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175942028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:45.348054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31830): Terminating (SIGTERM) 17:59:45.390251 run iperf3-srv_10.42.42.10(pid=31831): Terminating (SIGTERM) 17:59:45.432267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31834): Terminating (SIGTERM) 17:59:45.474536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31837): Terminating (SIGTERM) 17:59:45.516861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31840): Terminating (SIGTERM) 17:59:45.559215 --- ParallelTerminationStrategy: PID 31830 died... 17:59:45.579417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31830): Terminated: ok {rc=0} 17:59:45.626689 --- ParallelTerminationStrategy: PID 31831 died... 17:59:45.646475 run iperf3-srv_10.42.42.10(pid=31831): Terminated {rc=256} 17:59:45.693396 --- ParallelTerminationStrategy: PID 31834 died... 17:59:45.713202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31834): Terminated: ok {rc=0} 17:59:45.760132 --- ParallelTerminationStrategy: PID 31837 died... 17:59:45.779825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31837): Terminated: ok {rc=0} 17:59:45.827950 --- ParallelTerminationStrategy: PID 31840 died... 17:59:45.859975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31840): Terminated: ok {rc=0} 17:59:45.956341 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:59:47.130107 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:47.142881 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:59:47.196617 tst iperf3m4.py: using LAC 29654 17:59:47.329207 tst iperf3m4.py: using RAC 74 17:59:47.456879 tst iperf3m4.py: using CellId 29654 17:59:47.588086 tst iperf3m4.py: using BVCI 29655 17:59:47.707466 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:47.718888 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:47.730063 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:47.741315 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:47.752448 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:47.763764 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:47.775240 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:47.786471 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:47.797906 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:59:47.915506 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:59:48.034828 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:59:48.155366 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:59:48.275272 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:59:48.493613 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:48.817967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31842): Launched 17:59:49.102467 run iperf3-srv_10.42.42.10(pid=31843): Launched 17:59:49.224356 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:59:49.442087 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:49.766094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31844): Launched 17:59:50.050142 run iperf3-srv_10.42.42.10(pid=31845): Launched 17:59:50.171423 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:59:50.388770 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:50.713513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31846): Launched 17:59:50.995108 run iperf3-srv_10.42.42.10(pid=31847): Launched 17:59:51.118201 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:59:51.335418 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:51.659566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31848): Launched 17:59:51.941632 run iperf3-srv_10.42.42.10(pid=31849): Launched 17:59:52.063033 tst iperf3m4.py:8: start network... 17:59:52.280152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:52.781095 run create_hlr_db(pid=31850): Launched 17:59:52.904654 bus /gobi_6: Setting Powered False 17:59:53.969161 run create_hlr_db(pid=31850): Terminated: ok {rc=0} 17:59:54.418851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31852): Launched 17:59:54.744791 run osmo-hlr_10.42.42.2(pid=31853): Launched 17:59:54.867970 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:55.430623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31855): Launched 17:59:55.756890 run osmo-stp_10.42.42.5(pid=31856): Launched 17:59:55.882186 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:56.439519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31858): Launched 17:59:56.564547 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:56.837629 run patchelf(pid=31859): Launched 17:59:57.018941 run osmo-stp_10.42.42.5(pid=31856): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31856)] 17:59:57.156572 run osmo-stp_10.42.42.5(pid=31856): stdout: | (launched: 2022-12-10_17:59:55.697476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:57.295732 run osmo-stp_10.42.42.5(pid=31856): stderr: | 20221210175955885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175955886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175955886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175955886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175955887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175955887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175955887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:57.435161 run osmo-stp_10.42.42.5(pid=31856): stdout: | (launched: 2022-12-10_17:59:55.697476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:57.568181 run osmo-stp_10.42.42.5(pid=31856): stderr: | 20221210175955885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210175955886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210175955886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210175955886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210175955887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210175955887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210175955887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:57.726209 run patchelf(pid=31859): Terminating (SIGINT) 17:59:57.908007 run patchelf(pid=31859): Terminated: ok {rc=0} 17:59:58.038759 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31856): Process ended prematurely: osmo-stp_10.42.42.5(pid=31856) [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31856)] [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 17:59:58.048920 tst iperf3m4.py:8: Test FAILED (11.0 sec) 17:59:58.078872 run osmo-hlr_10.42.42.2(pid=31853): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31853)] 17:59:58.130121 run osmo-hlr_10.42.42.2(pid=31853): stdout: | (launched: 2022-12-10_17:59:54.684743) 17:59:58.182905 run osmo-hlr_10.42.42.2(pid=31853): stderr: | 20221210175954879 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210175954879 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210175954879 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210175954879 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210175954879 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210175954879 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210175954892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210175954900 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210175954901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210175954901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:58.235955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31842): Terminating (SIGTERM) 17:59:58.278647 run iperf3-srv_10.42.42.10(pid=31843): Terminating (SIGTERM) 17:59:58.321220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31844): Terminating (SIGTERM) 17:59:58.363980 run iperf3-srv_10.42.42.10(pid=31845): Terminating (SIGTERM) 17:59:58.406642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31846): Terminating (SIGTERM) 17:59:58.449307 run iperf3-srv_10.42.42.10(pid=31847): Terminating (SIGTERM) 17:59:58.491799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31848): Terminating (SIGTERM) 17:59:58.534605 run iperf3-srv_10.42.42.10(pid=31849): Terminating (SIGTERM) 17:59:58.577069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31852): Terminating (SIGTERM) 17:59:58.619749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31855): Terminating (SIGTERM) 17:59:58.662381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31858): Terminating (SIGTERM) 17:59:58.705197 --- ParallelTerminationStrategy: PID 31842 died... 17:59:58.725481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31842): Terminated: ok {rc=0} 17:59:58.773230 --- ParallelTerminationStrategy: PID 31843 died... 17:59:58.792826 run iperf3-srv_10.42.42.10(pid=31843): Terminated {rc=256} 17:59:58.840029 --- ParallelTerminationStrategy: PID 31844 died... 17:59:58.859720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31844): Terminated: ok {rc=0} 17:59:58.907110 --- ParallelTerminationStrategy: PID 31845 died... 17:59:58.926729 run iperf3-srv_10.42.42.10(pid=31845): Terminated {rc=256} 17:59:58.973825 --- ParallelTerminationStrategy: PID 31846 died... 17:59:58.993607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31846): Terminated: ok {rc=0} 17:59:59.040741 --- ParallelTerminationStrategy: PID 31847 died... 17:59:59.060689 run iperf3-srv_10.42.42.10(pid=31847): Terminated {rc=256} 17:59:59.107706 --- ParallelTerminationStrategy: PID 31848 died... 17:59:59.127432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31848): Terminated: ok {rc=0} 17:59:59.174427 --- ParallelTerminationStrategy: PID 31849 died... 17:59:59.194337 run iperf3-srv_10.42.42.10(pid=31849): Terminated {rc=256} 17:59:59.241287 --- ParallelTerminationStrategy: PID 31852 died... 17:59:59.261217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31852): Terminated: ok {rc=0} 17:59:59.308309 --- ParallelTerminationStrategy: PID 31855 died... 17:59:59.328113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31855): Terminated: ok {rc=0} 17:59:59.375227 --- ParallelTerminationStrategy: PID 31858 died... 17:59:59.395070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31858): Terminated: ok {rc=0} 17:59:59.484759 bus /gobi_4: Setting Powered False 18:00:00.582229 bus /gobi_4: Setting Powered False 18:00:01.705161 bus /gobi_1: Setting Powered False 18:00:02.834742 bus /gobi_1: Setting Powered False 18:00:03.953611 bus /gobi_0: Setting Powered False 18:00:05.054658 bus /gobi_0: Setting Powered False 18:00:06.172563 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 18:00:07.275530 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:07.287104 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:00:07.337431 tst ping.py: using LAC 29655 18:00:07.455660 tst ping.py: using RAC 75 18:00:07.573737 tst ping.py: using CellId 29655 18:00:07.689712 tst ping.py: using BVCI 29656 18:00:07.797164 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:07.807956 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:07.818701 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:07.829363 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:07.839922 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:07.850458 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:07.863269 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:07.875839 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:07.999491 tst ping.py:19: start network... 18:00:08.212857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:08.702016 run create_hlr_db(pid=31902): Launched 18:00:08.824382 bus /gobi_6: Setting Powered False 18:00:09.887597 run create_hlr_db(pid=31902): Terminated: ok {rc=0} 18:00:10.329354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31904): Launched 18:00:10.645306 run osmo-hlr_10.42.42.2(pid=31905): Launched 18:00:10.767437 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:11.317513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31907): Launched 18:00:11.633135 run osmo-stp_10.42.42.5(pid=31908): Launched 18:00:11.753966 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:00:12.300649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31910): Launched 18:00:12.422759 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:00:12.690815 run patchelf(pid=31911): Launched 18:00:12.869347 run osmo-stp_10.42.42.5(pid=31908): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31908)] 18:00:13.006625 run osmo-stp_10.42.42.5(pid=31908): stdout: | (launched: 2022-12-10_18:00:11.575160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:13.143216 run osmo-stp_10.42.42.5(pid=31908): stderr: | 20221210180011765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180011765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180011765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180011766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180011766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180011766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180011766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:13.280316 run osmo-stp_10.42.42.5(pid=31908): stdout: | (launched: 2022-12-10_18:00:11.575160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:13.410884 run osmo-stp_10.42.42.5(pid=31908): stderr: | 20221210180011765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180011765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180011765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180011766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180011766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180011766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180011766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:13.565306 run patchelf(pid=31911): Terminating (SIGINT) 18:00:13.742833 run patchelf(pid=31911): Terminated: ok {rc=0} 18:00:13.870765 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31908): Process ended prematurely: osmo-stp_10.42.42.5(pid=31908) [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31908)] [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 18:00:13.880343 tst ping.py:22: Test FAILED (6.6 sec) 18:00:13.909946 run osmo-hlr_10.42.42.2(pid=31905): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31905)] 18:00:13.961368 run osmo-hlr_10.42.42.2(pid=31905): stdout: | (launched: 2022-12-10_18:00:10.587395) 18:00:14.014227 run osmo-hlr_10.42.42.2(pid=31905): stderr: | 20221210180010783 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180010783 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180010783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180010783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180010783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180010783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180010795 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180010804 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180010805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180010805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:14.067217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31904): Terminating (SIGTERM) 18:00:14.109827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31907): Terminating (SIGTERM) 18:00:14.152401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31910): Terminating (SIGTERM) 18:00:14.195612 --- ParallelTerminationStrategy: PID 31904 died... 18:00:14.215902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31904): Terminated: ok {rc=0} 18:00:14.263309 --- ParallelTerminationStrategy: PID 31907 died... 18:00:14.282980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31907): Terminated: ok {rc=0} 18:00:14.330232 --- ParallelTerminationStrategy: PID 31910 died... 18:00:14.350235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31910): Terminated: ok {rc=0} 18:00:14.439387 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:00:15.529732 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:15.542628 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:00:15.597418 tst ping_idle_ping.py: using LAC 29656 18:00:15.722669 tst ping_idle_ping.py: using RAC 76 18:00:15.859626 tst ping_idle_ping.py: using CellId 29656 18:00:16.019375 tst ping_idle_ping.py: using BVCI 29657 18:00:16.131447 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:16.143450 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:16.155175 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:16.167687 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:16.180084 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:16.192300 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:16.207139 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:16.219860 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:16.336754 tst ping_idle_ping.py:24: start network... 18:00:16.544540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:17.023813 run create_hlr_db(pid=31913): Launched 18:00:17.183184 bus /gobi_6: Setting Powered False 18:00:18.243334 run create_hlr_db(pid=31913): Terminated: ok {rc=0} 18:00:18.678212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31915): Launched 18:00:18.997739 run osmo-hlr_10.42.42.2(pid=31916): Launched 18:00:19.118867 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:19.667725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31918): Launched 18:00:19.987814 run osmo-stp_10.42.42.5(pid=31919): Launched 18:00:20.109941 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:00:20.658691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31921): Launched 18:00:20.781121 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:00:21.050140 run patchelf(pid=31922): Launched 18:00:21.229218 run osmo-stp_10.42.42.5(pid=31919): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31919)] 18:00:21.364547 run osmo-stp_10.42.42.5(pid=31919): stdout: | (launched: 2022-12-10_18:00:19.929490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:21.500766 run osmo-stp_10.42.42.5(pid=31919): stderr: | 20221210180020121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180020121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180020121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180020122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180020122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180020122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180020122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:21.637490 run osmo-stp_10.42.42.5(pid=31919): stdout: | (launched: 2022-12-10_18:00:19.929490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:21.768136 run osmo-stp_10.42.42.5(pid=31919): stderr: | 20221210180020121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180020121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180020121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180020122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180020122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180020122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180020122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:21.923493 run patchelf(pid=31922): Terminating (SIGINT) 18:00:22.101306 run patchelf(pid=31922): Terminated: ok {rc=0} 18:00:22.229706 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31919): Process ended prematurely: osmo-stp_10.42.42.5(pid=31919) [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31919)] [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 18:00:22.239217 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 18:00:22.268119 run osmo-hlr_10.42.42.2(pid=31916): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31916)] 18:00:22.318318 run osmo-hlr_10.42.42.2(pid=31916): stdout: | (launched: 2022-12-10_18:00:18.939568) 18:00:22.370391 run osmo-hlr_10.42.42.2(pid=31916): stderr: | 20221210180019137 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180019137 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180019137 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180019137 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180019137 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180019137 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180019150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180019158 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180019158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180019158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:22.422691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31915): Terminating (SIGTERM) 18:00:22.464698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31918): Terminating (SIGTERM) 18:00:22.506927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31921): Terminating (SIGTERM) 18:00:22.549784 --- ParallelTerminationStrategy: PID 31915 died... 18:00:22.570051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31915): Terminated: ok {rc=0} 18:00:22.617308 --- ParallelTerminationStrategy: PID 31918 died... 18:00:22.637209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31918): Terminated: ok {rc=0} 18:00:22.684244 --- ParallelTerminationStrategy: PID 31921 died... 18:00:22.704041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31921): Terminated: ok {rc=0} 18:00:22.793792 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:00:24.106569 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:00:24.113560 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:00:24.148607 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:00:24.188302 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:00:24.275328 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:00:24.309650 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:00:24.349532 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:00:24.942969 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:00:24.994090 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:25.005278 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:00:25.074115 tst cs_paging_gprs_active.py: using LAC 29657 18:00:25.192474 tst cs_paging_gprs_active.py: using RAC 77 18:00:25.311395 tst cs_paging_gprs_active.py: using CellId 29657 18:00:25.430614 tst cs_paging_gprs_active.py: using BVCI 29658 18:00:25.541600 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:25.552607 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:25.563411 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:25.574680 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:25.585895 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:25.597177 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:25.608469 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:25.619506 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:25.630792 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:00:25.750342 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:00:25.870325 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:00:26.090182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:26.415302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31928): Launched 18:00:26.698022 run iperf3-srv_10.42.42.10(pid=31929): Launched 18:00:26.821654 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:00:27.040319 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:27.366271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31930): Launched 18:00:27.650372 run iperf3-srv_10.42.42.10(pid=31931): Launched 18:00:27.774067 tst cs_paging_gprs_active.py:38: start network... 18:00:27.992339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:28.494359 run create_hlr_db(pid=31932): Launched 18:00:28.621023 bus /gobi_6: Setting Powered False 18:00:29.684735 run create_hlr_db(pid=31932): Terminated: ok {rc=0} 18:00:30.117219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31934): Launched 18:00:30.420726 run osmo-hlr_10.42.42.2(pid=31935): Launched 18:00:30.538761 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:31.085931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31937): Launched 18:00:31.409559 run osmo-stp_10.42.42.5(pid=31938): Launched 18:00:31.622355 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:00:32.308863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31940): Launched 18:00:32.425071 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:00:32.688711 run patchelf(pid=31941): Launched 18:00:32.859472 run osmo-stp_10.42.42.5(pid=31938): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31938)] 18:00:32.988039 run osmo-stp_10.42.42.5(pid=31938): stdout: | (launched: 2022-12-10_18:00:31.349915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:33.117847 run osmo-stp_10.42.42.5(pid=31938): stderr: | 20221210180031680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180031680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180031689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180031689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180031690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180031690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180031690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:33.247626 run osmo-stp_10.42.42.5(pid=31938): stdout: | (launched: 2022-12-10_18:00:31.349915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:33.372844 run osmo-stp_10.42.42.5(pid=31938): stderr: | 20221210180031680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180031680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180031689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180031689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180031690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180031690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180031690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:33.520785 run patchelf(pid=31941): Terminating (SIGINT) 18:00:33.691350 run patchelf(pid=31941): Terminated: ok {rc=0} 18:00:33.813910 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31938): Process ended prematurely: osmo-stp_10.42.42.5(pid=31938) [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31938)] [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:00:33.823417 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 18:00:33.850877 run osmo-hlr_10.42.42.2(pid=31935): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31935)] 18:00:33.898389 run osmo-hlr_10.42.42.2(pid=31935): stdout: | (launched: 2022-12-10_18:00:30.364559) 18:00:33.947625 run osmo-hlr_10.42.42.2(pid=31935): stderr: | 20221210180030540 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180030540 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180030540 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180030540 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180030540 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180030540 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180030552 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180030560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180030561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180030561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:33.997190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31928): Terminating (SIGTERM) 18:00:34.036714 run iperf3-srv_10.42.42.10(pid=31929): Terminating (SIGTERM) 18:00:34.076258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31930): Terminating (SIGTERM) 18:00:34.116039 run iperf3-srv_10.42.42.10(pid=31931): Terminating (SIGTERM) 18:00:34.155448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31934): Terminating (SIGTERM) 18:00:34.194940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31937): Terminating (SIGTERM) 18:00:34.234444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31940): Terminating (SIGTERM) 18:00:34.274334 --- ParallelTerminationStrategy: PID 31928 died... 18:00:34.293533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31928): Terminated: ok {rc=0} 18:00:34.338330 --- ParallelTerminationStrategy: PID 31929 died... 18:00:34.356779 run iperf3-srv_10.42.42.10(pid=31929): Terminated {rc=256} 18:00:34.400634 --- ParallelTerminationStrategy: PID 31930 died... 18:00:34.419604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31930): Terminated: ok {rc=0} 18:00:34.463412 --- ParallelTerminationStrategy: PID 31931 died... 18:00:34.482173 run iperf3-srv_10.42.42.10(pid=31931): Terminated {rc=256} 18:00:34.526161 --- ParallelTerminationStrategy: PID 31934 died... 18:00:34.544801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31934): Terminated: ok {rc=0} 18:00:34.588425 --- ParallelTerminationStrategy: PID 31937 died... 18:00:34.607125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31937): Terminated: ok {rc=0} 18:00:34.650780 --- ParallelTerminationStrategy: PID 31940 died... 18:00:34.669363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31940): Terminated: ok {rc=0} 18:00:34.752788 bus /gobi_0: Setting Powered False 18:00:35.848330 bus /gobi_0: Setting Powered False 18:00:36.963435 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:00:38.110228 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:38.121656 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:00:38.191823 tst iperf3.py: using LAC 29658 18:00:38.312598 tst iperf3.py: using RAC 78 18:00:38.432835 tst iperf3.py: using CellId 29658 18:00:38.553399 tst iperf3.py: using BVCI 29659 18:00:38.663181 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:38.674136 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:38.684864 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:38.695629 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:38.706425 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:38.717162 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:38.727915 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:38.738540 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:38.749377 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:00:38.868244 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:00:39.088162 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:39.414725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31943): Launched 18:00:39.697727 run iperf3-srv_10.42.42.10(pid=31944): Launched 18:00:39.820071 tst iperf3.py:8: start network... 18:00:40.038978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:40.541708 run create_hlr_db(pid=31945): Launched 18:00:40.667404 bus /gobi_6: Setting Powered False 18:00:41.731632 run create_hlr_db(pid=31945): Terminated: ok {rc=0} 18:00:42.165948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31947): Launched 18:00:42.472350 run osmo-hlr_10.42.42.2(pid=31948): Launched 18:00:42.590145 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:43.118414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31950): Launched 18:00:43.423340 run osmo-stp_10.42.42.5(pid=31951): Launched 18:00:43.539834 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:00:44.063959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31953): Launched 18:00:44.180359 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:00:44.436875 run patchelf(pid=31954): Launched 18:00:44.606005 run osmo-stp_10.42.42.5(pid=31951): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31951)] 18:00:44.734383 run osmo-stp_10.42.42.5(pid=31951): stdout: | (launched: 2022-12-10_18:00:43.366616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:44.864942 run osmo-stp_10.42.42.5(pid=31951): stderr: | 20221210180043537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180043537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180043537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180043538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180043538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180043538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180043538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:44.995268 run osmo-stp_10.42.42.5(pid=31951): stdout: | (launched: 2022-12-10_18:00:43.366616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:45.119957 run osmo-stp_10.42.42.5(pid=31951): stderr: | 20221210180043537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180043537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180043537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180043538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180043538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180043538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180043538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:45.267307 run patchelf(pid=31954): Terminating (SIGINT) 18:00:45.437974 run patchelf(pid=31954): Terminated: ok {rc=0} 18:00:45.560765 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31951): Process ended prematurely: osmo-stp_10.42.42.5(pid=31951) [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31951)] [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 18:00:45.570222 tst iperf3.py:8: Test FAILED (7.5 sec) 18:00:45.597559 run osmo-hlr_10.42.42.2(pid=31948): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31948)] 18:00:45.645598 run osmo-hlr_10.42.42.2(pid=31948): stdout: | (launched: 2022-12-10_18:00:42.415825) 18:00:45.695204 run osmo-hlr_10.42.42.2(pid=31948): stderr: | 20221210180042592 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180042592 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180042592 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180042592 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180042592 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180042592 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180042605 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180042613 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180042614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180042614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:45.745663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31943): Terminating (SIGTERM) 18:00:45.785330 run iperf3-srv_10.42.42.10(pid=31944): Terminating (SIGTERM) 18:00:45.826515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31947): Terminating (SIGTERM) 18:00:45.868522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31950): Terminating (SIGTERM) 18:00:45.926461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31953): Terminating (SIGTERM) 18:00:45.976250 --- ParallelTerminationStrategy: PID 31943 died... 18:00:45.995717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31943): Terminated: ok {rc=0} 18:00:46.042569 --- ParallelTerminationStrategy: PID 31944 died... 18:00:46.061914 run iperf3-srv_10.42.42.10(pid=31944): Terminated {rc=256} 18:00:46.106361 --- ParallelTerminationStrategy: PID 31947 died... 18:00:46.125585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31947): Terminated: ok {rc=0} 18:00:46.170221 --- ParallelTerminationStrategy: PID 31950 died... 18:00:46.189193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31950): Terminated: ok {rc=0} 18:00:46.233829 --- ParallelTerminationStrategy: PID 31953 died... 18:00:46.253216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31953): Terminated: ok {rc=0} 18:00:46.342323 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:00:47.502673 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:47.514837 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:00:47.588902 tst iperf3m4.py: using LAC 29659 18:00:47.717690 tst iperf3m4.py: using RAC 79 18:00:47.838277 tst iperf3m4.py: using CellId 29659 18:00:47.958570 tst iperf3m4.py: using BVCI 29660 18:00:48.070542 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:48.081572 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:48.092392 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:48.103294 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:48.113939 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:48.124477 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:48.135131 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:48.145671 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:48.156381 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:00:48.275945 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:00:48.399472 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:00:48.517464 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:00:48.637260 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:00:48.856541 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:49.182593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31955): Launched 18:00:49.466309 run iperf3-srv_10.42.42.10(pid=31956): Launched 18:00:49.589239 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:00:49.807189 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:50.134262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31957): Launched 18:00:50.417398 run iperf3-srv_10.42.42.10(pid=31958): Launched 18:00:50.539120 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:00:50.756733 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:51.082575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31959): Launched 18:00:51.365440 run iperf3-srv_10.42.42.10(pid=31960): Launched 18:00:51.487004 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:00:51.704300 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:52.030369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31961): Launched 18:00:52.313319 run iperf3-srv_10.42.42.10(pid=31962): Launched 18:00:52.434849 tst iperf3m4.py:8: start network... 18:00:52.652763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:53.156139 run create_hlr_db(pid=31963): Launched 18:00:53.279931 bus /gobi_6: Setting Powered False 18:00:54.344738 run create_hlr_db(pid=31963): Terminated: ok {rc=0} 18:00:54.780089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31965): Launched 18:00:55.083851 run osmo-hlr_10.42.42.2(pid=31966): Launched 18:00:55.198865 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:55.737094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31968): Launched 18:00:56.039540 run osmo-stp_10.42.42.5(pid=31969): Launched 18:00:56.154277 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:00:56.675521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31971): Launched 18:00:56.791165 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:00:57.046788 run patchelf(pid=31972): Launched 18:00:57.215093 run osmo-stp_10.42.42.5(pid=31969): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31969)] 18:00:57.342814 run osmo-stp_10.42.42.5(pid=31969): stdout: | (launched: 2022-12-10_18:00:55.983085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:57.471740 run osmo-stp_10.42.42.5(pid=31969): stderr: | 20221210180056149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180056149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180056150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180056150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180056151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180056151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180056151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:57.602106 run osmo-stp_10.42.42.5(pid=31969): stdout: | (launched: 2022-12-10_18:00:55.983085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:57.725600 run osmo-stp_10.42.42.5(pid=31969): stderr: | 20221210180056149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180056149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180056150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180056150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180056151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180056151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180056151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:57.871865 run patchelf(pid=31972): Terminating (SIGINT) 18:00:58.040503 run patchelf(pid=31972): Terminated: ok {rc=0} 18:00:58.161675 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31969): Process ended prematurely: osmo-stp_10.42.42.5(pid=31969) [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31969)] [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:00:58.170968 tst iperf3m4.py:8: Test FAILED (10.7 sec) 18:00:58.198469 run osmo-hlr_10.42.42.2(pid=31966): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31966)] 18:00:58.245820 run osmo-hlr_10.42.42.2(pid=31966): stdout: | (launched: 2022-12-10_18:00:55.027483) 18:00:58.294978 run osmo-hlr_10.42.42.2(pid=31966): stderr: | 20221210180055200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180055200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180055200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180055200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180055201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180055201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180055213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180055221 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180055222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180055222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:58.344722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31955): Terminating (SIGTERM) 18:00:58.384594 run iperf3-srv_10.42.42.10(pid=31956): Terminating (SIGTERM) 18:00:58.424550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31957): Terminating (SIGTERM) 18:00:58.464342 run iperf3-srv_10.42.42.10(pid=31958): Terminating (SIGTERM) 18:00:58.503935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31959): Terminating (SIGTERM) 18:00:58.543712 run iperf3-srv_10.42.42.10(pid=31960): Terminating (SIGTERM) 18:00:58.583449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31961): Terminating (SIGTERM) 18:00:58.623327 run iperf3-srv_10.42.42.10(pid=31962): Terminating (SIGTERM) 18:00:58.664340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31965): Terminating (SIGTERM) 18:00:58.704606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31968): Terminating (SIGTERM) 18:00:58.744507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31971): Terminating (SIGTERM) 18:00:58.784326 --- ParallelTerminationStrategy: PID 31955 died... 18:00:58.803596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31955): Terminated: ok {rc=0} 18:00:58.848077 --- ParallelTerminationStrategy: PID 31956 died... 18:00:58.867028 run iperf3-srv_10.42.42.10(pid=31956): Terminated {rc=256} 18:00:58.911259 --- ParallelTerminationStrategy: PID 31957 died... 18:00:58.930183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31957): Terminated: ok {rc=0} 18:00:58.974420 --- ParallelTerminationStrategy: PID 31958 died... 18:00:58.993226 run iperf3-srv_10.42.42.10(pid=31958): Terminated {rc=256} 18:00:59.037702 --- ParallelTerminationStrategy: PID 31959 died... 18:00:59.056423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31959): Terminated: ok {rc=0} 18:00:59.100421 --- ParallelTerminationStrategy: PID 31960 died... 18:00:59.119189 run iperf3-srv_10.42.42.10(pid=31960): Terminated {rc=256} 18:00:59.163731 --- ParallelTerminationStrategy: PID 31961 died... 18:00:59.182541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31961): Terminated: ok {rc=0} 18:00:59.226452 --- ParallelTerminationStrategy: PID 31962 died... 18:00:59.245321 run iperf3-srv_10.42.42.10(pid=31962): Terminated {rc=256} 18:00:59.289306 --- ParallelTerminationStrategy: PID 31965 died... 18:00:59.307910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31965): Terminated: ok {rc=0} 18:00:59.352163 --- ParallelTerminationStrategy: PID 31968 died... 18:00:59.370829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31968): Terminated: ok {rc=0} 18:00:59.414943 --- ParallelTerminationStrategy: PID 31971 died... 18:00:59.433924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31971): Terminated: ok {rc=0} 18:00:59.520228 bus /gobi_4: Setting Powered False 18:01:00.620938 bus /gobi_4: Setting Powered False 18:01:01.737663 bus /gobi_1: Setting Powered False 18:01:02.833459 bus /gobi_1: Setting Powered False 18:01:03.949302 bus /gobi_0: Setting Powered False 18:01:05.049028 bus /gobi_0: Setting Powered False 18:01:06.167742 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:01:07.272189 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:07.283855 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:01:07.353411 tst ping.py: using LAC 29660 18:01:07.469302 tst ping.py: using RAC 80 18:01:07.590178 tst ping.py: using CellId 29660 18:01:07.710896 tst ping.py: using BVCI 29661 18:01:07.818818 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:07.829798 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:07.840456 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:07.851115 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:07.861743 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:07.872421 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:07.883149 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:07.893764 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:08.006979 tst ping.py:19: start network... 18:01:08.206225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:08.668545 run create_hlr_db(pid=31973): Launched 18:01:08.790400 bus /gobi_6: Setting Powered False 18:01:09.849990 run create_hlr_db(pid=31973): Terminated: ok {rc=0} 18:01:10.285731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31975): Launched 18:01:10.589355 run osmo-hlr_10.42.42.2(pid=31976): Launched 18:01:10.702541 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:11.233530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31978): Launched 18:01:11.531671 run osmo-stp_10.42.42.5(pid=31979): Launched 18:01:11.645773 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:01:12.158500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31981): Launched 18:01:12.272347 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:01:12.524509 run patchelf(pid=31982): Launched 18:01:12.691207 run osmo-stp_10.42.42.5(pid=31979): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31979)] 18:01:12.817513 run osmo-stp_10.42.42.5(pid=31979): stdout: | (launched: 2022-12-10_18:01:11.476213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:12.945367 run osmo-stp_10.42.42.5(pid=31979): stderr: | 20221210180111648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180111648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180111649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180111649 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180111650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180111650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180111650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:13.073212 run osmo-stp_10.42.42.5(pid=31979): stdout: | (launched: 2022-12-10_18:01:11.476213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:13.195330 run osmo-stp_10.42.42.5(pid=31979): stderr: | 20221210180111648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180111648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180111649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180111649 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180111650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180111650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180111650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:13.339581 run patchelf(pid=31982): Terminating (SIGINT) 18:01:13.505788 run patchelf(pid=31982): Terminated: ok {rc=0} 18:01:13.626101 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31979): Process ended prematurely: osmo-stp_10.42.42.5(pid=31979) [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31979)] [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 18:01:13.634999 tst ping.py:22: Test FAILED (6.4 sec) 18:01:13.662843 run osmo-hlr_10.42.42.2(pid=31976): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31976)] 18:01:13.711053 run osmo-hlr_10.42.42.2(pid=31976): stdout: | (launched: 2022-12-10_18:01:10.533827) 18:01:13.761153 run osmo-hlr_10.42.42.2(pid=31976): stderr: | 20221210180110708 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180110708 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180110708 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180110709 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180110709 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180110709 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180110723 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180110734 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180110735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180110735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:13.812024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31975): Terminating (SIGTERM) 18:01:13.852645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31978): Terminating (SIGTERM) 18:01:13.893461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31981): Terminating (SIGTERM) 18:01:13.934253 --- ParallelTerminationStrategy: PID 31975 died... 18:01:13.953691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31975): Terminated: ok {rc=0} 18:01:13.998429 --- ParallelTerminationStrategy: PID 31978 died... 18:01:14.017443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31978): Terminated: ok {rc=0} 18:01:14.062034 --- ParallelTerminationStrategy: PID 31981 died... 18:01:14.080912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31981): Terminated: ok {rc=0} 18:01:14.167885 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:01:15.257491 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:15.269842 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:01:15.341209 tst ping_idle_ping.py: using LAC 29661 18:01:15.459553 tst ping_idle_ping.py: using RAC 81 18:01:15.579119 tst ping_idle_ping.py: using CellId 29661 18:01:15.699160 tst ping_idle_ping.py: using BVCI 29662 18:01:15.808936 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:15.820092 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:15.838168 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:15.861654 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:15.881277 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:15.893576 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:15.907340 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:15.922563 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:16.047839 tst ping_idle_ping.py:24: start network... 18:01:16.314174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:16.792515 run create_hlr_db(pid=31983): Launched 18:01:16.947352 bus /gobi_6: Setting Powered False 18:01:18.007558 run create_hlr_db(pid=31983): Terminated: ok {rc=0} 18:01:18.426659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31985): Launched 18:01:18.725803 run osmo-hlr_10.42.42.2(pid=31986): Launched 18:01:18.838654 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:19.353940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31988): Launched 18:01:19.652339 run osmo-stp_10.42.42.5(pid=31989): Launched 18:01:19.766898 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:01:20.282239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31991): Launched 18:01:20.396335 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:01:20.649515 run patchelf(pid=31992): Launched 18:01:20.817182 run osmo-stp_10.42.42.5(pid=31989): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31989)] 18:01:20.944193 run osmo-stp_10.42.42.5(pid=31989): stdout: | (launched: 2022-12-10_18:01:19.597224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:21.072692 run osmo-stp_10.42.42.5(pid=31989): stderr: | 20221210180119769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180119769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180119769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180119770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180119770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180119770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180119770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:21.201403 run osmo-stp_10.42.42.5(pid=31989): stdout: | (launched: 2022-12-10_18:01:19.597224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:21.324167 run osmo-stp_10.42.42.5(pid=31989): stderr: | 20221210180119769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180119769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180119769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180119770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180119770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180119770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180119770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:21.469430 run patchelf(pid=31992): Terminating (SIGINT) 18:01:21.636839 run patchelf(pid=31992): Terminated: ok {rc=0} 18:01:21.758446 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31989): Process ended prematurely: osmo-stp_10.42.42.5(pid=31989) [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31989)] [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:01:21.767251 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:01:21.794325 run osmo-hlr_10.42.42.2(pid=31986): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31986)] 18:01:21.842134 run osmo-hlr_10.42.42.2(pid=31986): stdout: | (launched: 2022-12-10_18:01:18.670166) 18:01:21.891749 run osmo-hlr_10.42.42.2(pid=31986): stderr: | 20221210180118846 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180118846 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180118846 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180118846 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180118846 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180118846 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180118862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180118872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180118872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180118872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:21.941766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31985): Terminating (SIGTERM) 18:01:21.982420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31988): Terminating (SIGTERM) 18:01:22.022836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31991): Terminating (SIGTERM) 18:01:22.063491 --- ParallelTerminationStrategy: PID 31985 died... 18:01:22.082599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31985): Terminated: ok {rc=0} 18:01:22.127564 --- ParallelTerminationStrategy: PID 31988 died... 18:01:22.146716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31988): Terminated: ok {rc=0} 18:01:22.191649 --- ParallelTerminationStrategy: PID 31991 died... 18:01:22.210656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31991): Terminated: ok {rc=0} 18:01:22.294419 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:01:23.599646 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:01:23.606667 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:01:23.642053 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 18:01:23.681892 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 18:01:23.771682 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:01:23.805864 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 18:01:23.845571 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 18:01:24.441118 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 18:01:24.493803 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:24.505207 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:01:24.577674 tst cs_paging_gprs_active.py: using LAC 29662 18:01:24.707564 tst cs_paging_gprs_active.py: using RAC 82 18:01:24.836203 tst cs_paging_gprs_active.py: using CellId 29662 18:01:24.965573 tst cs_paging_gprs_active.py: using BVCI 29663 18:01:25.085986 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:25.097586 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:25.108770 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:25.120259 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:25.131904 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:25.143314 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:25.154879 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:25.166098 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:25.177834 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:01:25.298319 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:01:25.425194 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:01:25.643194 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:25.968691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31997): Launched 18:01:26.251618 run iperf3-srv_10.42.42.10(pid=31998): Launched 18:01:26.374292 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:01:26.592543 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:26.918837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31999): Launched 18:01:27.202154 run iperf3-srv_10.42.42.10(pid=32000): Launched 18:01:27.324159 tst cs_paging_gprs_active.py:38: start network... 18:01:27.542192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:28.044899 run create_hlr_db(pid=32001): Launched 18:01:28.168291 bus /gobi_6: Setting Powered False 18:01:29.233285 run create_hlr_db(pid=32001): Terminated: ok {rc=0} 18:01:29.668526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32003): Launched 18:01:29.974323 run osmo-hlr_10.42.42.2(pid=32004): Launched 18:01:30.090739 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:30.618646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32006): Launched 18:01:30.957700 run osmo-stp_10.42.42.5(pid=32007): Launched 18:01:31.248490 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:01:31.923003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32009): Launched 18:01:32.061642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:01:32.343700 run patchelf(pid=32010): Launched 18:01:32.527363 run osmo-stp_10.42.42.5(pid=32007): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32007)] 18:01:32.665340 run osmo-stp_10.42.42.5(pid=32007): stdout: | (launched: 2022-12-10_18:01:30.878237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:32.804049 run osmo-stp_10.42.42.5(pid=32007): stderr: | 20221210180131196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180131197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180131197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180131199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180131200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180131200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180131200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:32.943234 run osmo-stp_10.42.42.5(pid=32007): stdout: | (launched: 2022-12-10_18:01:30.878237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:33.076794 run osmo-stp_10.42.42.5(pid=32007): stderr: | 20221210180131196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180131197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180131197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180131199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180131200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180131200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180131200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:33.234300 run patchelf(pid=32010): Terminating (SIGINT) 18:01:33.415703 run patchelf(pid=32010): Terminated: ok {rc=0} 18:01:33.545999 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32007): Process ended prematurely: osmo-stp_10.42.42.5(pid=32007) [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32007)] [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 18:01:33.556151 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 18:01:33.585525 run osmo-hlr_10.42.42.2(pid=32004): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32004)] 18:01:33.636104 run osmo-hlr_10.42.42.2(pid=32004): stdout: | (launched: 2022-12-10_18:01:29.917850) 18:01:33.688484 run osmo-hlr_10.42.42.2(pid=32004): stderr: | 20221210180130095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180130095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180130095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180130095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180130095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180130095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180130106 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180130115 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180130115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180130115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:33.741514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31997): Terminating (SIGTERM) 18:01:33.783737 run iperf3-srv_10.42.42.10(pid=31998): Terminating (SIGTERM) 18:01:33.825882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31999): Terminating (SIGTERM) 18:01:33.867953 run iperf3-srv_10.42.42.10(pid=32000): Terminating (SIGTERM) 18:01:33.909983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32003): Terminating (SIGTERM) 18:01:33.952301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32006): Terminating (SIGTERM) 18:01:33.994340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32009): Terminating (SIGTERM) 18:01:34.036711 --- ParallelTerminationStrategy: PID 31997 died... 18:01:34.056479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31997): Terminated: ok {rc=0} 18:01:34.103343 --- ParallelTerminationStrategy: PID 31998 died... 18:01:34.122913 run iperf3-srv_10.42.42.10(pid=31998): Terminated {rc=256} 18:01:34.169566 --- ParallelTerminationStrategy: PID 31999 died... 18:01:34.189315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31999): Terminated: ok {rc=0} 18:01:34.235869 --- ParallelTerminationStrategy: PID 32000 died... 18:01:34.255581 run iperf3-srv_10.42.42.10(pid=32000): Terminated {rc=256} 18:01:34.301993 --- ParallelTerminationStrategy: PID 32003 died... 18:01:34.321702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32003): Terminated: ok {rc=0} 18:01:34.368297 --- ParallelTerminationStrategy: PID 32006 died... 18:01:34.387850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32006): Terminated: ok {rc=0} 18:01:34.434442 --- ParallelTerminationStrategy: PID 32009 died... 18:01:34.454056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32009): Terminated: ok {rc=0} 18:01:34.541979 bus /gobi_0: Setting Powered False 18:01:35.641152 bus /gobi_0: Setting Powered False 18:01:36.758499 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 18:01:37.907873 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:37.920231 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:01:37.993364 tst iperf3.py: using LAC 29663 18:01:38.121622 tst iperf3.py: using RAC 83 18:01:38.243757 tst iperf3.py: using CellId 29663 18:01:38.365151 tst iperf3.py: using BVCI 29664 18:01:38.475475 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:38.486527 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:38.497370 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:38.508124 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:38.518796 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:38.529612 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:38.540328 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:38.551023 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:38.561917 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:01:38.678277 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:01:38.882495 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:39.188355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32011): Launched 18:01:39.454975 run iperf3-srv_10.42.42.10(pid=32012): Launched 18:01:39.569450 tst iperf3.py:8: start network... 18:01:39.774102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:40.251554 run create_hlr_db(pid=32013): Launched 18:01:40.375921 bus /gobi_6: Setting Powered False 18:01:41.437377 run create_hlr_db(pid=32013): Terminated: ok {rc=0} 18:01:41.882082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32015): Launched 18:01:42.208771 run osmo-hlr_10.42.42.2(pid=32016): Launched 18:01:42.333277 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:42.898923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32018): Launched 18:01:43.224669 run osmo-stp_10.42.42.5(pid=32019): Launched 18:01:43.349888 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:01:43.909590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32021): Launched 18:01:44.034799 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:01:44.309107 run patchelf(pid=32022): Launched 18:01:44.490309 run osmo-stp_10.42.42.5(pid=32019): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32019)] 18:01:44.628128 run osmo-stp_10.42.42.5(pid=32019): stdout: | (launched: 2022-12-10_18:01:43.164656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:44.767604 run osmo-stp_10.42.42.5(pid=32019): stderr: | 20221210180143356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180143356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180143356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180143357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180143357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180143357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180143357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:44.907147 run osmo-stp_10.42.42.5(pid=32019): stdout: | (launched: 2022-12-10_18:01:43.164656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:45.040891 run osmo-stp_10.42.42.5(pid=32019): stderr: | 20221210180143356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180143356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180143356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180143357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180143357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180143357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180143357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:45.198533 run patchelf(pid=32022): Terminating (SIGINT) 18:01:45.380581 run patchelf(pid=32022): Terminated: ok {rc=0} 18:01:45.511440 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32019): Process ended prematurely: osmo-stp_10.42.42.5(pid=32019) [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32019)] [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 18:01:45.521791 tst iperf3.py:8: Test FAILED (7.7 sec) 18:01:45.551413 run osmo-hlr_10.42.42.2(pid=32016): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32016)] 18:01:45.602252 run osmo-hlr_10.42.42.2(pid=32016): stdout: | (launched: 2022-12-10_18:01:42.148740) 18:01:45.654548 run osmo-hlr_10.42.42.2(pid=32016): stderr: | 20221210180142348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180142348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180142349 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180142349 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180142349 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180142349 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180142361 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180142369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180142369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180142370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:45.707401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32011): Terminating (SIGTERM) 18:01:45.749723 run iperf3-srv_10.42.42.10(pid=32012): Terminating (SIGTERM) 18:01:45.791941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32015): Terminating (SIGTERM) 18:01:45.842080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32018): Terminating (SIGTERM) 18:01:45.885458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32021): Terminating (SIGTERM) 18:01:45.929833 --- ParallelTerminationStrategy: PID 32011 died... 18:01:45.949817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32011): Terminated: ok {rc=0} 18:01:46.001032 --- ParallelTerminationStrategy: PID 32012 died... 18:01:46.023512 run iperf3-srv_10.42.42.10(pid=32012): Terminated {rc=256} 18:01:46.069325 --- ParallelTerminationStrategy: PID 32015 died... 18:01:46.089097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32015): Terminated: ok {rc=0} 18:01:46.134503 --- ParallelTerminationStrategy: PID 32018 died... 18:01:46.154352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32018): Terminated: ok {rc=0} 18:01:46.199903 --- ParallelTerminationStrategy: PID 32021 died... 18:01:46.220587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32021): Terminated: ok {rc=0} 18:01:46.309403 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 18:01:47.463817 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:47.475933 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:01:47.548190 tst iperf3m4.py: using LAC 29664 18:01:47.675336 tst iperf3m4.py: using RAC 84 18:01:47.801380 tst iperf3m4.py: using CellId 29664 18:01:47.930537 tst iperf3m4.py: using BVCI 29665 18:01:48.050794 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:48.062350 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:48.073667 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:48.085154 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:48.096474 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:48.107842 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:48.119544 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:48.130861 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:48.142481 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:01:48.261195 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:01:48.386542 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:01:48.502341 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:01:48.624596 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:01:48.829138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:49.135959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32023): Launched 18:01:49.403030 run iperf3-srv_10.42.42.10(pid=32024): Launched 18:01:49.517760 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:01:49.721896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:50.029111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32025): Launched 18:01:50.295522 run iperf3-srv_10.42.42.10(pid=32026): Launched 18:01:50.409974 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:01:50.613023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:50.919159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32027): Launched 18:01:51.184559 run iperf3-srv_10.42.42.10(pid=32028): Launched 18:01:51.298464 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:01:51.500025 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:51.804569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32029): Launched 18:01:52.070702 run iperf3-srv_10.42.42.10(pid=32030): Launched 18:01:52.184606 tst iperf3m4.py:8: start network... 18:01:52.386750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:52.857091 run create_hlr_db(pid=32031): Launched 18:01:52.982107 bus /gobi_6: Setting Powered False 18:01:54.043016 run create_hlr_db(pid=32031): Terminated: ok {rc=0} 18:01:54.487008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32033): Launched 18:01:54.813199 run osmo-hlr_10.42.42.2(pid=32034): Launched 18:01:54.937063 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:55.496709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32036): Launched 18:01:55.821377 run osmo-stp_10.42.42.5(pid=32037): Launched 18:01:55.944865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:01:56.503776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32039): Launched 18:01:56.627838 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:01:56.902112 run patchelf(pid=32040): Launched 18:01:57.083209 run osmo-stp_10.42.42.5(pid=32037): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32037)] 18:01:57.220258 run osmo-stp_10.42.42.5(pid=32037): stdout: | (launched: 2022-12-10_18:01:55.761370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:57.358763 run osmo-stp_10.42.42.5(pid=32037): stderr: | 20221210180155950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180155950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180155950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180155951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180155951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180155951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180155951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:57.497212 run osmo-stp_10.42.42.5(pid=32037): stdout: | (launched: 2022-12-10_18:01:55.761370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:57.629802 run osmo-stp_10.42.42.5(pid=32037): stderr: | 20221210180155950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180155950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180155950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180155951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180155951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180155951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180155951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:57.786889 run patchelf(pid=32040): Terminating (SIGINT) 18:01:57.968371 run patchelf(pid=32040): Terminated: ok {rc=0} 18:01:58.099308 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32037): Process ended prematurely: osmo-stp_10.42.42.5(pid=32037) [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32037)] [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 18:01:58.109649 tst iperf3m4.py:8: Test FAILED (10.7 sec) 18:01:58.139590 run osmo-hlr_10.42.42.2(pid=32034): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32034)] 18:01:58.190304 run osmo-hlr_10.42.42.2(pid=32034): stdout: | (launched: 2022-12-10_18:01:54.753173) 18:01:58.242646 run osmo-hlr_10.42.42.2(pid=32034): stderr: | 20221210180154947 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180154947 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180154947 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180154947 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180154947 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180154947 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180154960 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180154968 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180154968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180154968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:58.295292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32023): Terminating (SIGTERM) 18:01:58.337676 run iperf3-srv_10.42.42.10(pid=32024): Terminating (SIGTERM) 18:01:58.379900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32025): Terminating (SIGTERM) 18:01:58.422439 run iperf3-srv_10.42.42.10(pid=32026): Terminating (SIGTERM) 18:01:58.464483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32027): Terminating (SIGTERM) 18:01:58.506788 run iperf3-srv_10.42.42.10(pid=32028): Terminating (SIGTERM) 18:01:58.548797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32029): Terminating (SIGTERM) 18:01:58.591498 run iperf3-srv_10.42.42.10(pid=32030): Terminating (SIGTERM) 18:01:58.633485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32033): Terminating (SIGTERM) 18:01:58.675790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32036): Terminating (SIGTERM) 18:01:58.718031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32039): Terminating (SIGTERM) 18:01:58.760561 --- ParallelTerminationStrategy: PID 32023 died... 18:01:58.780838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32023): Terminated: ok {rc=0} 18:01:58.827929 --- ParallelTerminationStrategy: PID 32024 died... 18:01:58.847605 run iperf3-srv_10.42.42.10(pid=32024): Terminated {rc=256} 18:01:58.894380 --- ParallelTerminationStrategy: PID 32025 died... 18:01:58.914130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32025): Terminated: ok {rc=0} 18:01:58.961319 --- ParallelTerminationStrategy: PID 32026 died... 18:01:58.980743 run iperf3-srv_10.42.42.10(pid=32026): Terminated {rc=256} 18:01:59.028090 --- ParallelTerminationStrategy: PID 32027 died... 18:01:59.047832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32027): Terminated: ok {rc=0} 18:01:59.094969 --- ParallelTerminationStrategy: PID 32028 died... 18:01:59.114650 run iperf3-srv_10.42.42.10(pid=32028): Terminated {rc=256} 18:01:59.161633 --- ParallelTerminationStrategy: PID 32029 died... 18:01:59.181334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32029): Terminated: ok {rc=0} 18:01:59.228617 --- ParallelTerminationStrategy: PID 32030 died... 18:01:59.248367 run iperf3-srv_10.42.42.10(pid=32030): Terminated {rc=256} 18:01:59.295052 --- ParallelTerminationStrategy: PID 32033 died... 18:01:59.314853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32033): Terminated: ok {rc=0} 18:01:59.361876 --- ParallelTerminationStrategy: PID 32036 died... 18:01:59.381707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32036): Terminated: ok {rc=0} 18:01:59.428479 --- ParallelTerminationStrategy: PID 32039 died... 18:01:59.448277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32039): Terminated: ok {rc=0} 18:01:59.538022 bus /gobi_4: Setting Powered False 18:02:00.638274 bus /gobi_4: Setting Powered False 18:02:01.762386 bus /gobi_1: Setting Powered False 18:02:02.863204 bus /gobi_1: Setting Powered False 18:02:03.981391 bus /gobi_0: Setting Powered False 18:02:05.080822 bus /gobi_0: Setting Powered False 18:02:06.199128 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 18:02:07.302947 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:07.315201 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:02:07.388867 tst ping.py: using LAC 29665 18:02:07.514154 tst ping.py: using RAC 85 18:02:07.637521 tst ping.py: using CellId 29665 18:02:07.754853 tst ping.py: using BVCI 29666 18:02:07.862893 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:07.873941 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:07.884750 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:07.895572 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:07.906227 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:07.916897 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:07.927764 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:07.938530 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:08.054957 tst ping.py:19: start network... 18:02:08.270552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:08.763589 run create_hlr_db(pid=32041): Launched 18:02:08.886547 bus /gobi_6: Setting Powered False 18:02:09.950178 run create_hlr_db(pid=32041): Terminated: ok {rc=0} 18:02:10.395959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32043): Launched 18:02:10.716073 run osmo-hlr_10.42.42.2(pid=32044): Launched 18:02:10.838170 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:11.391095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32046): Launched 18:02:11.710114 run osmo-stp_10.42.42.5(pid=32047): Launched 18:02:11.831611 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:02:12.382859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32049): Launched 18:02:12.505447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:02:12.775180 run patchelf(pid=32050): Launched 18:02:12.954031 run osmo-stp_10.42.42.5(pid=32047): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32047)] 18:02:13.090326 run osmo-stp_10.42.42.5(pid=32047): stdout: | (launched: 2022-12-10_18:02:11.650966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:13.227754 run osmo-stp_10.42.42.5(pid=32047): stderr: | 20221210180211845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180211845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180211845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180211846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180211846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180211846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180211846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:13.365101 run osmo-stp_10.42.42.5(pid=32047): stdout: | (launched: 2022-12-10_18:02:11.650966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:13.496408 run osmo-stp_10.42.42.5(pid=32047): stderr: | 20221210180211845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180211845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180211845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180211846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180211846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180211846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180211846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:13.651534 run patchelf(pid=32050): Terminating (SIGINT) 18:02:13.830165 run patchelf(pid=32050): Terminated: ok {rc=0} 18:02:13.959061 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32047): Process ended prematurely: osmo-stp_10.42.42.5(pid=32047) [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32047)] [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 18:02:13.968886 tst ping.py:22: Test FAILED (6.7 sec) 18:02:13.998319 run osmo-hlr_10.42.42.2(pid=32044): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32044)] 18:02:14.049480 run osmo-hlr_10.42.42.2(pid=32044): stdout: | (launched: 2022-12-10_18:02:10.657148) 18:02:14.102221 run osmo-hlr_10.42.42.2(pid=32044): stderr: | 20221210180210857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180210857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180210857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180210857 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180210857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180210857 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180210869 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180210877 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180210878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180210878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:14.155477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32043): Terminating (SIGTERM) 18:02:14.198292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32046): Terminating (SIGTERM) 18:02:14.240899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32049): Terminating (SIGTERM) 18:02:14.284301 --- ParallelTerminationStrategy: PID 32043 died... 18:02:14.304655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32043): Terminated: ok {rc=0} 18:02:14.352221 --- ParallelTerminationStrategy: PID 32046 died... 18:02:14.372185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32046): Terminated: ok {rc=0} 18:02:14.419314 --- ParallelTerminationStrategy: PID 32049 died... 18:02:14.439345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32049): Terminated: ok {rc=0} 18:02:14.529766 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 18:02:15.614839 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:15.626527 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:02:15.701102 tst ping_idle_ping.py: using LAC 29666 18:02:15.816810 tst ping_idle_ping.py: using RAC 86 18:02:15.970636 tst ping_idle_ping.py: using CellId 29666 18:02:16.097382 tst ping_idle_ping.py: using BVCI 29667 18:02:16.246081 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:16.260702 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:16.275183 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:16.289085 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:16.303342 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:16.316942 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:16.331581 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:16.346174 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:16.484888 tst ping_idle_ping.py:24: start network... 18:02:16.784722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:17.336811 run create_hlr_db(pid=32051): Launched 18:02:17.469288 bus /gobi_6: Setting Powered False 18:02:18.533167 run create_hlr_db(pid=32051): Terminated: ok {rc=0} 18:02:18.964434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32053): Launched 18:02:19.265030 run osmo-hlr_10.42.42.2(pid=32054): Launched 18:02:19.379717 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:19.894766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32056): Launched 18:02:20.194527 run osmo-stp_10.42.42.5(pid=32057): Launched 18:02:20.307407 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:02:20.823675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32059): Launched 18:02:20.938069 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:02:21.190615 run patchelf(pid=32060): Launched 18:02:21.356762 run osmo-stp_10.42.42.5(pid=32057): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32057)] 18:02:21.483272 run osmo-stp_10.42.42.5(pid=32057): stdout: | (launched: 2022-12-10_18:02:20.138117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:21.611048 run osmo-stp_10.42.42.5(pid=32057): stderr: | 20221210180220310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180220310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180220310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180220311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180220311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180220311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180220311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:21.738767 run osmo-stp_10.42.42.5(pid=32057): stdout: | (launched: 2022-12-10_18:02:20.138117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:21.860927 run osmo-stp_10.42.42.5(pid=32057): stderr: | 20221210180220310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180220310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180220310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180220311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180220311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180220311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180220311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:22.006095 run patchelf(pid=32060): Terminating (SIGINT) 18:02:22.172713 run patchelf(pid=32060): Terminated: ok {rc=0} 18:02:22.293826 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32057): Process ended prematurely: osmo-stp_10.42.42.5(pid=32057) [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32057)] [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 18:02:22.302630 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 18:02:22.329645 run osmo-hlr_10.42.42.2(pid=32054): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32054)] 18:02:22.377745 run osmo-hlr_10.42.42.2(pid=32054): stdout: | (launched: 2022-12-10_18:02:19.209168) 18:02:22.427160 run osmo-hlr_10.42.42.2(pid=32054): stderr: | 20221210180219387 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180219387 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180219387 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180219387 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180219387 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180219387 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180219399 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180219408 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180219409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180219409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:22.476822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32053): Terminating (SIGTERM) 18:02:22.516819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32056): Terminating (SIGTERM) 18:02:22.556689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32059): Terminating (SIGTERM) 18:02:22.596900 --- ParallelTerminationStrategy: PID 32053 died... 18:02:22.616260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32053): Terminated: ok {rc=0} 18:02:22.661207 --- ParallelTerminationStrategy: PID 32056 died... 18:02:22.680099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32056): Terminated: ok {rc=0} 18:02:22.724379 --- ParallelTerminationStrategy: PID 32059 died... 18:02:22.743316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32059): Terminated: ok {rc=0} 18:02:22.827802 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:02:24.132232 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:02:24.141886 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:02:24.176476 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:02:24.211419 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:02:24.264498 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:02:24.297361 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:02:24.331365 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:02:24.892530 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2377 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:02:24.898840 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:02:24.911192 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:02:24.984651 tst switch_tch_pdch.py: using LAC 29667 18:02:25.109295 tst switch_tch_pdch.py: using RAC 87 18:02:25.234138 tst switch_tch_pdch.py: using CellId 29667 18:02:25.359817 tst switch_tch_pdch.py: using BVCI 29668 18:02:25.477412 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:02:25.489139 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:02:25.500447 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:02:25.512719 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:02:25.524896 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:02:25.537324 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:02:25.549506 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:02:25.562478 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:02:25.678615 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:02:25.806205 tst switch_tch_pdch.py:51: start network... 18:02:26.008196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:26.474097 run create_hlr_db(pid=32064): Launched 18:02:26.598129 bus /gobi_6: Setting Powered False 18:02:27.658498 run create_hlr_db(pid=32064): Terminated: ok {rc=0} 18:02:28.096443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32066): Launched 18:02:28.416370 run osmo-hlr_10.42.42.2(pid=32067): Launched 18:02:28.540339 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:29.095786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32069): Launched 18:02:29.414387 run osmo-stp_10.42.42.5(pid=32070): Launched 18:02:29.535921 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:02:30.086316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32072): Launched 18:02:30.208053 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:02:30.476824 run patchelf(pid=32073): Launched 18:02:30.654150 run osmo-stp_10.42.42.5(pid=32070): ERR: Terminated: ERROR {rc=1} [trial-2377↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32070)] 18:02:30.789051 run osmo-stp_10.42.42.5(pid=32070): stdout: | (launched: 2022-12-10_18:02:29.355742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:30.944225 run osmo-stp_10.42.42.5(pid=32070): stderr: | 20221210180229546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180229546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180229547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180229547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180229548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180229548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180229548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:31.078691 run osmo-stp_10.42.42.5(pid=32070): stdout: | (launched: 2022-12-10_18:02:29.355742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:31.203881 run osmo-stp_10.42.42.5(pid=32070): stderr: | 20221210180229546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180229546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180229547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180229547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180229548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180229548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180229548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:31.352103 run patchelf(pid=32073): Terminating (SIGINT) 18:02:31.525180 run patchelf(pid=32073): Terminated: ok {rc=0} 18:02:31.649404 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32070): Process ended prematurely: osmo-stp_10.42.42.5(pid=32070) [trial-2377↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32070)] [trial-2377↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:02:31.658880 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 18:02:31.687670 run osmo-hlr_10.42.42.2(pid=32067): ERR: Terminated: ERROR {rc=237} [trial-2377↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32067)] 18:02:31.737097 run osmo-hlr_10.42.42.2(pid=32067): stdout: | (launched: 2022-12-10_18:02:28.358035) 18:02:31.787476 run osmo-hlr_10.42.42.2(pid=32067): stderr: | 20221210180228555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180228555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180228555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180228555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180228555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180228555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180228568 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180228576 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180228576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180228576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:31.839513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32066): Terminating (SIGTERM) 18:02:31.881098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32069): Terminating (SIGTERM) 18:02:31.924881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32072): Terminating (SIGTERM) 18:02:31.968458 --- ParallelTerminationStrategy: PID 32066 died... 18:02:31.988125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32066): Terminated: ok {rc=0} 18:02:32.035642 --- ParallelTerminationStrategy: PID 32069 died... 18:02:32.055129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32069): Terminated: ok {rc=0} 18:02:32.099920 --- ParallelTerminationStrategy: PID 32072 died... 18:02:32.119101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32072): Terminated: ok {rc=0} 18:02:32.204761 bus /gobi_0: Setting Powered False 18:02:33.303590 bus /gobi_0: Setting Powered False 18:02:34.421801 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 18:02:35.672606 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:02:35.678391 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 18:02:35.711274 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 18:02:35.745626 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 18:02:35.799463 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 18:02:35.832611 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 18:02:35.866709 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 18:02:36.419967 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2377 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 18:02:36.425449 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:02:36.436497 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 18:02:36.506128 tst switch_tch_pdch.py: using LAC 29668 18:02:36.625848 tst switch_tch_pdch.py: using RAC 88 18:02:36.744110 tst switch_tch_pdch.py: using CellId 29668 18:02:36.862853 tst switch_tch_pdch.py: using BVCI 29669 18:02:36.970807 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:02:36.982005 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:02:36.992831 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:02:37.003905 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:02:37.014846 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:02:37.026062 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:02:37.037176 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:02:37.047980 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:02:37.165548 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:02:37.282956 tst switch_tch_pdch.py:51: start network... 18:02:37.483197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:37.920889 run create_hlr_db(pid=32081): Launched 18:02:38.043823 bus /gobi_6: Setting Powered False 18:02:39.104293 run create_hlr_db(pid=32081): Terminated: ok {rc=0} 18:02:39.512885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32083): Launched 18:02:39.831609 run osmo-hlr_10.42.42.2(pid=32084): Launched 18:02:39.952458 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:40.474442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32086): Launched 18:02:40.792506 run osmo-stp_10.42.42.5(pid=32087): Launched 18:02:40.916136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:02:41.439840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32089): Launched 18:02:41.561729 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:02:41.830224 run patchelf(pid=32090): Launched 18:02:42.008135 run osmo-stp_10.42.42.5(pid=32087): ERR: Terminated: ERROR {rc=1} [trial-2377↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32087)] 18:02:42.143193 run osmo-stp_10.42.42.5(pid=32087): stdout: | (launched: 2022-12-10_18:02:40.733600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:42.279395 run osmo-stp_10.42.42.5(pid=32087): stderr: | 20221210180240926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180240926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180240926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180240927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180240929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180240929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180240929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:42.416239 run osmo-stp_10.42.42.5(pid=32087): stdout: | (launched: 2022-12-10_18:02:40.733600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:42.546970 run osmo-stp_10.42.42.5(pid=32087): stderr: | 20221210180240926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180240926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180240926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180240927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180240929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180240929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180240929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:42.701275 run patchelf(pid=32090): Terminating (SIGINT) 18:02:42.879381 run patchelf(pid=32090): Terminated: ok {rc=0} 18:02:43.008254 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32087): Process ended prematurely: osmo-stp_10.42.42.5(pid=32087) [trial-2377↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32087)] [trial-2377↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 18:02:43.017903 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 18:02:43.046675 run osmo-hlr_10.42.42.2(pid=32084): ERR: Terminated: ERROR {rc=237} [trial-2377↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32084)] 18:02:43.097355 run osmo-hlr_10.42.42.2(pid=32084): stdout: | (launched: 2022-12-10_18:02:39.772878) 18:02:43.149709 run osmo-hlr_10.42.42.2(pid=32084): stderr: | 20221210180239972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180239972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180239972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180239972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180239972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180239972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180239985 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180239993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180239993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180239993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:43.202650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32083): Terminating (SIGTERM) 18:02:43.244564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32086): Terminating (SIGTERM) 18:02:43.286412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32089): Terminating (SIGTERM) 18:02:43.328617 --- ParallelTerminationStrategy: PID 32083 died... 18:02:43.348690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32083): Terminated: ok {rc=0} 18:02:43.395330 --- ParallelTerminationStrategy: PID 32086 died... 18:02:43.414862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32086): Terminated: ok {rc=0} 18:02:43.461494 --- ParallelTerminationStrategy: PID 32089 died... 18:02:43.481039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32089): Terminated: ok {rc=0} 18:02:43.569683 bus /gobi_0: Setting Powered False 18:02:44.668145 bus /gobi_0: Setting Powered False 18:02:45.786536 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 18:02:47.057344 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:02:47.062142 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:02:47.103077 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 18:02:47.112231 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:02:47.172174 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:02:47.212267 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 18:02:47.223314 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:02:47.749843 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 18:02:47.756042 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 18:02:47.767938 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:02:47.814331 tst mo_mt_sms.py: using LAC 29669 18:02:47.938788 tst mo_mt_sms.py: using RAC 89 18:02:48.065223 tst mo_mt_sms.py: using CellId 29669 18:02:48.188473 tst mo_mt_sms.py: using BVCI 29670 18:02:48.303250 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:02:48.417905 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:02:48.533390 tst mo_mt_sms.py:9: start nitb and bts... 18:02:48.735193 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:02:49.346137 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32094): Launched 18:02:49.645209 run osmo-nitb_10.42.42.2(pid=32095): Launched 18:02:49.811235 run osmo-nitb_10.42.42.2(pid=32095): ERR: Terminated: ERROR {rc=2} [trial-2377↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32095)] 18:02:49.945767 run osmo-nitb_10.42.42.2(pid=32095): stdout: | (launched: 2022-12-10_18:02:49.589599) 18:02:50.082038 run osmo-nitb_10.42.42.2(pid=32095): stderr: | (launched: 2022-12-10_18:02:49.633878) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:02:50.218339 run osmo-nitb_10.42.42.2(pid=32095): stdout: | (launched: 2022-12-10_18:02:49.589599) 18:02:50.348706 run osmo-nitb_10.42.42.2(pid=32095): stderr: | (launched: 2022-12-10_18:02:49.633878) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f2803594268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32095): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32095) [trial-2377↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32095)] 18:02:50.758005 tst osmo-nitb_10.42.42.2(pid=32095): stdout: | (launched: 2022-12-10_18:02:49.589599) 18:02:50.878843 tst osmo-nitb_10.42.42.2(pid=32095): stderr: | (launched: 2022-12-10_18:02:49.633878) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:02:51.020822 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=32095): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32095) [trial-2377↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32095)] [trial-2377↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 18:02:51.029245 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 18:02:51.035777 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32094): Terminating (SIGTERM) 18:02:51.246124 --- ParallelTerminationStrategy: PID 32094 died... 18:02:51.267028 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32094): Terminated: ok {rc=0} 18:02:51.354915 bus /sierra_3: Setting Powered False 18:02:52.458189 bus /sierra_3: Setting Powered False 18:02:53.579079 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 18:02:54.773922 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:02:54.777811 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:02:54.806474 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:02:54.832770 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:02:54.883715 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:02:54.912326 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:02:54.938503 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:02:55.487188 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 18:02:55.492026 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:02:55.503063 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:02:55.546524 tst mo_mt_sms.py: using LAC 29670 18:02:55.665040 tst mo_mt_sms.py: using RAC 90 18:02:55.781143 tst mo_mt_sms.py: using CellId 29670 18:02:55.902522 tst mo_mt_sms.py: using BVCI 29671 18:02:56.010983 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:02:56.021850 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:02:56.032583 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:02:56.043170 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:02:56.053781 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:02:56.064271 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:02:56.181586 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:02:56.301350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:56.797500 run create_hlr_db(pid=32099): Launched 18:02:56.919568 bus /sierra_2: Setting Powered False 18:02:57.982705 run create_hlr_db(pid=32099): Terminated: ok {rc=0} 18:02:58.428214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32101): Launched 18:02:58.747125 run osmo-hlr_10.42.42.2(pid=32102): Launched 18:02:58.869020 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:59.416792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32104): Launched 18:02:59.735321 run osmo-stp_10.42.42.5(pid=32105): Launched 18:02:59.856864 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:00.437823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32107): Launched 18:03:00.758897 run osmo-msc_10.42.42.6(pid=32108): Launched 18:03:01.070354 run osmo-stp_10.42.42.5(pid=32105): ERR: Terminated: ERROR {rc=1} [trial-2377↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32105)] 18:03:01.287476 run osmo-stp_10.42.42.5(pid=32105): stdout: | (launched: 2022-12-10_18:02:59.676324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:01.504705 run osmo-stp_10.42.42.5(pid=32105): stderr: | 20221210180259869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180259869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180259869 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180259870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180259870 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180259870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180259870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:01.641364 run osmo-stp_10.42.42.5(pid=32105): stdout: | (launched: 2022-12-10_18:02:59.676324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:01.770654 run osmo-stp_10.42.42.5(pid=32105): stderr: | 20221210180259869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180259869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180259869 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180259870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180259870 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180259870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180259870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:01.926385 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=32105): Process ended prematurely: osmo-stp_10.42.42.5(pid=32105) [trial-2377↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32105)] [trial-2377↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 18:03:01.936223 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 18:03:01.968027 run osmo-hlr_10.42.42.2(pid=32102): ERR: Terminated: ERROR {rc=237} [trial-2377↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32102)] 18:03:02.021636 run osmo-hlr_10.42.42.2(pid=32102): stdout: | (launched: 2022-12-10_18:02:58.688310) 18:03:02.076453 run osmo-hlr_10.42.42.2(pid=32102): stderr: | 20221210180258885 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180258885 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180258885 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180258885 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180258885 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180258885 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180258897 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180258905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180258906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180258906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:02.152045 run osmo-msc_10.42.42.6(pid=32108): ERR: Terminated: ERROR {rc=2} [trial-2377↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32108)] 18:03:02.205434 run osmo-msc_10.42.42.6(pid=32108): stdout: | (launched: 2022-12-10_18:03:00.699935) 18:03:02.260257 run osmo-msc_10.42.42.6(pid=32108): stderr: | 20221210180301162 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180301162 DLGLOBAL DEBUG validating counter group 0x7f82eca40c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180301162 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180301163 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180301163 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180301163 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180301170 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180301171 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180301171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180301171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:02.315558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32101): Terminating (SIGTERM) 18:03:02.360047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32104): Terminating (SIGTERM) 18:03:02.403665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32107): Terminating (SIGTERM) 18:03:02.446565 --- ParallelTerminationStrategy: PID 32101 died... 18:03:02.466877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32101): Terminated: ok {rc=0} 18:03:02.514174 --- ParallelTerminationStrategy: PID 32104 died... 18:03:02.534117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32104): Terminated: ok {rc=0} 18:03:02.581296 --- ParallelTerminationStrategy: PID 32107 died... 18:03:02.600940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32107): Terminated: ok {rc=0} 18:03:02.689901 bus /sierra_3: Setting Powered False 18:03:03.790816 bus /sierra_3: Setting Powered False 18:03:04.909747 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 18:03:06.142574 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:06.147676 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:03:06.181548 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 18:03:06.188591 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 18:03:06.224383 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:03:06.254500 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 18:03:06.261384 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 18:03:06.783692 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2377 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 18:03:06.789862 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 18:03:06.801949 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:03:06.847780 tst assert_extension.py: using LAC 29671 18:03:06.972173 tst assert_extension.py: using RAC 91 18:03:07.095746 tst assert_extension.py: using CellId 29671 18:03:07.218580 tst assert_extension.py: using BVCI 29672 18:03:07.333656 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 18:03:07.448236 tst assert_extension.py:10: start nitb and bts... 18:03:07.648544 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:03:08.261721 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32114): Launched 18:03:08.562067 run osmo-nitb_10.42.42.2(pid=32115): Launched 18:03:08.728429 run osmo-nitb_10.42.42.2(pid=32115): ERR: Terminated: ERROR {rc=2} [trial-2377↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32115)] 18:03:08.863222 run osmo-nitb_10.42.42.2(pid=32115): stdout: | (launched: 2022-12-10_18:03:08.505875) 18:03:08.999021 run osmo-nitb_10.42.42.2(pid=32115): stderr: | (launched: 2022-12-10_18:03:08.550245) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:03:09.134992 run osmo-nitb_10.42.42.2(pid=32115): stdout: | (launched: 2022-12-10_18:03:08.505875) 18:03:09.265090 run osmo-nitb_10.42.42.2(pid=32115): stderr: | (launched: 2022-12-10_18:03:08.550245) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f2803594268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32115): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32115) [trial-2377↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32115)] 18:03:09.675584 tst osmo-nitb_10.42.42.2(pid=32115): stdout: | (launched: 2022-12-10_18:03:08.505875) 18:03:09.796386 tst osmo-nitb_10.42.42.2(pid=32115): stderr: | (launched: 2022-12-10_18:03:08.550245) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:03:09.938466 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=32115): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32115) [trial-2377↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32115)] [trial-2377↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 18:03:09.946744 tst assert_extension.py:12: Test FAILED (3.2 sec) 18:03:09.953441 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32114): Terminating (SIGTERM) 18:03:10.163945 --- ParallelTerminationStrategy: PID 32114 died... 18:03:10.184626 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32114): Terminated: ok {rc=0} 18:03:10.272113 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 18:03:11.451480 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:11.455835 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:03:11.486541 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:03:11.514401 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 18:03:11.549566 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:03:11.580448 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:03:11.607829 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 18:03:12.135973 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2377 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 18:03:12.141732 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:12.152855 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:03:12.198757 tst assert_extension.py: using LAC 29672 18:03:12.317945 tst assert_extension.py: using RAC 92 18:03:12.437985 tst assert_extension.py: using CellId 29672 18:03:12.554813 tst assert_extension.py: using BVCI 29673 18:03:12.662949 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:12.673850 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:12.684582 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:12.695277 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:12.705907 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:12.716445 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 18:03:12.832516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:13.325341 run create_hlr_db(pid=32119): Launched 18:03:13.447733 bus /sierra_2: Setting Powered False 18:03:14.510588 run create_hlr_db(pid=32119): Terminated: ok {rc=0} 18:03:14.939651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32121): Launched 18:03:15.238181 run osmo-hlr_10.42.42.2(pid=32122): Launched 18:03:15.352442 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:15.889259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32124): Launched 18:03:16.233977 run osmo-stp_10.42.42.5(pid=32125): Launched 18:03:16.478904 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:17.190008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32127): Launched 18:03:17.518117 run osmo-msc_10.42.42.6(pid=32128): Launched 18:03:17.696935 run osmo-stp_10.42.42.5(pid=32125): ERR: Terminated: ERROR {rc=1} [trial-2377↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32125)] 18:03:17.831809 run osmo-stp_10.42.42.5(pid=32125): stdout: | (launched: 2022-12-10_18:03:16.171533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:17.967044 run osmo-stp_10.42.42.5(pid=32125): stderr: | 20221210180316467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180316467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180316467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180316467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180316468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180316468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180316468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:18.101313 run osmo-stp_10.42.42.5(pid=32125): stdout: | (launched: 2022-12-10_18:03:16.171533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:18.227909 run osmo-stp_10.42.42.5(pid=32125): stderr: | 20221210180316467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180316467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180316467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180316467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180316468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180316468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180316468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:18.379369 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=32125): Process ended prematurely: osmo-stp_10.42.42.5(pid=32125) [trial-2377↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32125)] [trial-2377↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 18:03:18.388148 tst assert_extension.py:17: Test FAILED (6.2 sec) 18:03:18.416377 run osmo-hlr_10.42.42.2(pid=32122): ERR: Terminated: ERROR {rc=237} [trial-2377↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32122)] 18:03:18.466735 run osmo-hlr_10.42.42.2(pid=32122): stdout: | (launched: 2022-12-10_18:03:15.182433) 18:03:18.518806 run osmo-hlr_10.42.42.2(pid=32122): stderr: | 20221210180315360 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180315360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180315360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180315360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180315360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180315360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180315372 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180315383 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180315383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180315383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:18.591711 run osmo-msc_10.42.42.6(pid=32128): ERR: Terminated: ERROR {rc=2} [trial-2377↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32128)] 18:03:18.642161 run osmo-msc_10.42.42.6(pid=32128): stdout: | (launched: 2022-12-10_18:03:17.459178) 18:03:18.694536 run osmo-msc_10.42.42.6(pid=32128): stderr: | 20221210180317778 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180317778 DLGLOBAL DEBUG validating counter group 0x7ffa061d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180317779 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180317779 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180317779 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180317779 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180317781 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180317781 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180317781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180317781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:18.747084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32121): Terminating (SIGTERM) 18:03:18.789532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32124): Terminating (SIGTERM) 18:03:18.832149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32127): Terminating (SIGTERM) 18:03:18.874728 --- ParallelTerminationStrategy: PID 32121 died... 18:03:18.894889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32121): Terminated: ok {rc=0} 18:03:18.941921 --- ParallelTerminationStrategy: PID 32124 died... 18:03:18.961581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32124): Terminated: ok {rc=0} 18:03:19.008754 --- ParallelTerminationStrategy: PID 32127 died... 18:03:19.028633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32127): Terminated: ok {rc=0} 18:03:19.118439 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:03:20.327814 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:20.335310 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:03:20.366622 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:03:20.393962 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:03:20.447178 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:03:20.477531 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:03:20.505249 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:03:21.059137 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:03:21.112149 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:21.124305 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:03:21.191866 tst mo_mt_call.py: using LAC 29673 18:03:21.318814 tst mo_mt_call.py: using RAC 93 18:03:21.448251 tst mo_mt_call.py: using CellId 29673 18:03:21.575253 tst mo_mt_call.py: using BVCI 29674 18:03:21.693591 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:21.705320 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:21.716785 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:21.728578 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:21.740517 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:21.752329 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:03:21.869397 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:03:21.988631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:22.492657 run create_hlr_db(pid=32133): Launched 18:03:22.615818 bus /sierra_2: Setting Powered False 18:03:23.680396 run create_hlr_db(pid=32133): Terminated: ok {rc=0} 18:03:24.116440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32135): Launched 18:03:24.421540 run osmo-hlr_10.42.42.2(pid=32136): Launched 18:03:24.538090 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:25.065606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32138): Launched 18:03:25.371037 run osmo-stp_10.42.42.5(pid=32139): Launched 18:03:25.486883 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:26.037707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32141): Launched 18:03:26.342671 run osmo-msc_10.42.42.6(pid=32142): Launched 18:03:26.512425 run osmo-stp_10.42.42.5(pid=32139): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32139)] 18:03:26.652537 run osmo-stp_10.42.42.5(pid=32139): stdout: | (launched: 2022-12-10_18:03:25.314206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:26.791875 run osmo-stp_10.42.42.5(pid=32139): stderr: | 20221210180325486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180325486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180325486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180325487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180325489 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180325489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180325489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:26.927018 run osmo-stp_10.42.42.5(pid=32139): stdout: | (launched: 2022-12-10_18:03:25.314206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:27.056882 run osmo-stp_10.42.42.5(pid=32139): stderr: | 20221210180325486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180325486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180325486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180325487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180325489 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180325489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180325489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:27.211772 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32139): Process ended prematurely: osmo-stp_10.42.42.5(pid=32139) [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32139)] [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:03:27.221430 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:03:27.250022 run osmo-hlr_10.42.42.2(pid=32136): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32136)] 18:03:27.301698 run osmo-hlr_10.42.42.2(pid=32136): stdout: | (launched: 2022-12-10_18:03:24.364897) 18:03:27.354540 run osmo-hlr_10.42.42.2(pid=32136): stderr: | 20221210180324539 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180324539 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180324539 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180324539 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180324539 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180324539 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180324552 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180324561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180324561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180324561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:27.427844 run osmo-msc_10.42.42.6(pid=32142): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32142)] 18:03:27.478828 run osmo-msc_10.42.42.6(pid=32142): stdout: | (launched: 2022-12-10_18:03:26.285905) 18:03:27.531650 run osmo-msc_10.42.42.6(pid=32142): stderr: | 20221210180326558 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180326559 DLGLOBAL DEBUG validating counter group 0x7fd8d6b68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180326559 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180326559 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180326559 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180326559 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180326561 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180326561 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180326561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180326562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:27.584543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32135): Terminating (SIGTERM) 18:03:27.626915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32138): Terminating (SIGTERM) 18:03:27.669572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32141): Terminating (SIGTERM) 18:03:27.712505 --- ParallelTerminationStrategy: PID 32135 died... 18:03:27.732711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32135): Terminated: ok {rc=0} 18:03:27.779723 --- ParallelTerminationStrategy: PID 32138 died... 18:03:27.799642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32138): Terminated: ok {rc=0} 18:03:27.846725 --- ParallelTerminationStrategy: PID 32141 died... 18:03:27.866500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32141): Terminated: ok {rc=0} 18:03:27.955593 bus /sierra_3: Setting Powered False 18:03:29.052530 bus /sierra_3: Setting Powered False 18:03:30.166496 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:03:31.309742 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:31.322857 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:03:31.390000 tst mo_mt_call_osmux.py: using LAC 29674 18:03:31.520443 tst mo_mt_call_osmux.py: using RAC 94 18:03:31.644616 tst mo_mt_call_osmux.py: using CellId 29674 18:03:31.810978 tst mo_mt_call_osmux.py: using BVCI 29675 18:03:31.931032 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:31.943422 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:31.955713 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:31.968377 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:31.981064 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:31.994116 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:03:32.139933 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:03:32.276589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:32.750109 run create_hlr_db(pid=32144): Launched 18:03:32.875527 bus /sierra_2: Setting Powered False 18:03:33.937285 run create_hlr_db(pid=32144): Terminated: ok {rc=0} 18:03:34.381029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32146): Launched 18:03:34.707026 run osmo-hlr_10.42.42.2(pid=32147): Launched 18:03:34.830792 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:35.393284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32149): Launched 18:03:35.718872 run osmo-stp_10.42.42.5(pid=32150): Launched 18:03:35.842598 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:36.434029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32152): Launched 18:03:36.760517 run osmo-msc_10.42.42.6(pid=32153): Launched 18:03:36.942389 run osmo-stp_10.42.42.5(pid=32150): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32150)] 18:03:37.079109 run osmo-stp_10.42.42.5(pid=32150): stdout: | (launched: 2022-12-10_18:03:35.659158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:37.216419 run osmo-stp_10.42.42.5(pid=32150): stderr: | 20221210180335852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180335852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180335852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180335853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180335853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180335853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180335853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:37.352856 run osmo-stp_10.42.42.5(pid=32150): stdout: | (launched: 2022-12-10_18:03:35.659158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:37.482591 run osmo-stp_10.42.42.5(pid=32150): stderr: | 20221210180335852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180335852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180335852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180335853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180335853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180335853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180335853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:37.637333 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32150): Process ended prematurely: osmo-stp_10.42.42.5(pid=32150) [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32150)] [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:03:37.646867 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 18:03:37.675571 run osmo-hlr_10.42.42.2(pid=32147): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32147)] 18:03:37.726163 run osmo-hlr_10.42.42.2(pid=32147): stdout: | (launched: 2022-12-10_18:03:34.647352) 18:03:37.778300 run osmo-hlr_10.42.42.2(pid=32147): stderr: | 20221210180334848 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180334849 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180334849 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180334849 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180334849 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180334849 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180334862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180334870 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180334870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180334870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:37.851386 run osmo-msc_10.42.42.6(pid=32153): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32153)] 18:03:37.902021 run osmo-msc_10.42.42.6(pid=32153): stdout: | (launched: 2022-12-10_18:03:36.700328) 18:03:37.954440 run osmo-msc_10.42.42.6(pid=32153): stderr: | 20221210180337024 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180337024 DLGLOBAL DEBUG validating counter group 0x7fca101bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180337024 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180337024 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180337024 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180337024 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180337026 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180337026 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180337027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180337027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:38.007387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32146): Terminating (SIGTERM) 18:03:38.049737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32149): Terminating (SIGTERM) 18:03:38.092225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32152): Terminating (SIGTERM) 18:03:38.134763 --- ParallelTerminationStrategy: PID 32146 died... 18:03:38.154907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32146): Terminated: ok {rc=0} 18:03:38.201951 --- ParallelTerminationStrategy: PID 32149 died... 18:03:38.221718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32149): Terminated: ok {rc=0} 18:03:38.268506 --- ParallelTerminationStrategy: PID 32152 died... 18:03:38.288253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32152): Terminated: ok {rc=0} 18:03:38.378107 bus /sierra_3: Setting Powered False 18:03:39.477990 bus /sierra_3: Setting Powered False 18:03:40.594834 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:03:41.844315 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:41.851589 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:03:41.882215 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:03:41.910113 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:03:41.963053 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:03:41.993363 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:03:42.021169 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:03:42.577204 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:03:42.631027 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:42.642945 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:03:42.709039 tst mo_mt_call.py: using LAC 29675 18:03:42.834978 tst mo_mt_call.py: using RAC 95 18:03:42.961130 tst mo_mt_call.py: using CellId 29675 18:03:43.087124 tst mo_mt_call.py: using BVCI 29676 18:03:43.206728 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:43.218513 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:43.230434 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:43.242499 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:43.254320 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:43.266089 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:03:43.384114 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:03:43.499407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:43.971333 run create_hlr_db(pid=32158): Launched 18:03:44.096434 bus /sierra_2: Setting Powered False 18:03:45.157622 run create_hlr_db(pid=32158): Terminated: ok {rc=0} 18:03:45.601423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32160): Launched 18:03:45.964444 run osmo-hlr_10.42.42.2(pid=32161): Launched 18:03:46.106157 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:46.888847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32163): Launched 18:03:47.257566 run osmo-stp_10.42.42.5(pid=32164): Launched 18:03:47.432840 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:48.022267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32166): Launched 18:03:48.348060 run osmo-msc_10.42.42.6(pid=32167): Launched 18:03:48.529289 run osmo-stp_10.42.42.5(pid=32164): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32164)] 18:03:48.665711 run osmo-stp_10.42.42.5(pid=32164): stdout: | (launched: 2022-12-10_18:03:47.194096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:48.803119 run osmo-stp_10.42.42.5(pid=32164): stderr: | 20221210180347443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180347443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180347444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180347444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180347444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180347445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180347445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:48.939618 run osmo-stp_10.42.42.5(pid=32164): stdout: | (launched: 2022-12-10_18:03:47.194096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:49.069875 run osmo-stp_10.42.42.5(pid=32164): stderr: | 20221210180347443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180347443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180347444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180347444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180347444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180347445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180347445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:49.224848 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32164): Process ended prematurely: osmo-stp_10.42.42.5(pid=32164) [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32164)] [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:03:49.234498 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 18:03:49.263605 run osmo-hlr_10.42.42.2(pid=32161): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32161)] 18:03:49.314684 run osmo-hlr_10.42.42.2(pid=32161): stdout: | (launched: 2022-12-10_18:03:45.898316) 18:03:49.367405 run osmo-hlr_10.42.42.2(pid=32161): stderr: | 20221210180346301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180346301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180346302 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180346302 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180346302 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180346302 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180346319 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180346335 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180346335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180346335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:49.440810 run osmo-msc_10.42.42.6(pid=32167): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32167)] 18:03:49.491739 run osmo-msc_10.42.42.6(pid=32167): stdout: | (launched: 2022-12-10_18:03:48.288029) 18:03:49.544284 run osmo-msc_10.42.42.6(pid=32167): stderr: | 20221210180348612 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180348612 DLGLOBAL DEBUG validating counter group 0x7f423e14ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180348612 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180348612 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180348613 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180348613 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180348614 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180348615 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180348615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180348615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:49.597285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32160): Terminating (SIGTERM) 18:03:49.639568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32163): Terminating (SIGTERM) 18:03:49.682258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32166): Terminating (SIGTERM) 18:03:49.725037 --- ParallelTerminationStrategy: PID 32160 died... 18:03:49.745258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32160): Terminated: ok {rc=0} 18:03:49.792839 --- ParallelTerminationStrategy: PID 32163 died... 18:03:49.812933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32163): Terminated: ok {rc=0} 18:03:49.859869 --- ParallelTerminationStrategy: PID 32166 died... 18:03:49.879748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32166): Terminated: ok {rc=0} 18:03:49.968654 bus /sierra_3: Setting Powered False 18:03:51.066317 bus /sierra_3: Setting Powered False 18:03:52.183507 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:03:53.331460 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:53.343773 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:03:53.410873 tst mo_mt_call_osmux.py: using LAC 29676 18:03:53.531999 tst mo_mt_call_osmux.py: using RAC 96 18:03:53.661856 tst mo_mt_call_osmux.py: using CellId 29676 18:03:53.783587 tst mo_mt_call_osmux.py: using BVCI 29677 18:03:53.897430 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:53.909085 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:53.920429 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:53.932239 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:53.943993 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:53.955516 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:03:54.077797 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:03:54.196354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:54.671222 run create_hlr_db(pid=32169): Launched 18:03:54.795593 bus /sierra_2: Setting Powered False 18:03:55.856216 run create_hlr_db(pid=32169): Terminated: ok {rc=0} 18:03:56.281422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32171): Launched 18:03:56.588122 run osmo-hlr_10.42.42.2(pid=32172): Launched 18:03:56.704036 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:57.229380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32174): Launched 18:03:57.534822 run osmo-stp_10.42.42.5(pid=32175): Launched 18:03:57.653532 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:58.206250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32177): Launched 18:03:58.511356 run osmo-msc_10.42.42.6(pid=32178): Launched 18:03:58.682337 run osmo-stp_10.42.42.5(pid=32175): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32175)] 18:03:58.811639 run osmo-stp_10.42.42.5(pid=32175): stdout: | (launched: 2022-12-10_18:03:57.478279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:58.941072 run osmo-stp_10.42.42.5(pid=32175): stderr: | 20221210180357650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180357650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180357650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180357651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180357651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180357651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180357651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:59.069795 run osmo-stp_10.42.42.5(pid=32175): stdout: | (launched: 2022-12-10_18:03:57.478279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:59.191462 run osmo-stp_10.42.42.5(pid=32175): stderr: | 20221210180357650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180357650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180357650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180357651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180357651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180357651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180357651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:59.337305 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32175): Process ended prematurely: osmo-stp_10.42.42.5(pid=32175) [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32175)] [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:03:59.346461 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:03:59.373474 run osmo-hlr_10.42.42.2(pid=32172): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32172)] 18:03:59.421616 run osmo-hlr_10.42.42.2(pid=32172): stdout: | (launched: 2022-12-10_18:03:56.530692) 18:03:59.471496 run osmo-hlr_10.42.42.2(pid=32172): stderr: | 20221210180356713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180356713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180356713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180356713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180356713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180356713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180356755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180356764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180356764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180356764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:59.541197 run osmo-msc_10.42.42.6(pid=32178): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32178)] 18:03:59.589425 run osmo-msc_10.42.42.6(pid=32178): stdout: | (launched: 2022-12-10_18:03:58.454623) 18:03:59.639073 run osmo-msc_10.42.42.6(pid=32178): stderr: | 20221210180358730 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180358730 DLGLOBAL DEBUG validating counter group 0x7fa467e3fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180358730 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180358730 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180358730 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180358731 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180358732 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180358733 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180358733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180358733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:59.689738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32171): Terminating (SIGTERM) 18:03:59.729675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32174): Terminating (SIGTERM) 18:03:59.769816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32177): Terminating (SIGTERM) 18:03:59.810316 --- ParallelTerminationStrategy: PID 32171 died... 18:03:59.829749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32171): Terminated: ok {rc=0} 18:03:59.874170 --- ParallelTerminationStrategy: PID 32174 died... 18:03:59.892930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32174): Terminated: ok {rc=0} 18:03:59.937521 --- ParallelTerminationStrategy: PID 32177 died... 18:03:59.956372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32177): Terminated: ok {rc=0} 18:04:00.043521 bus /sierra_3: Setting Powered False 18:04:01.145966 bus /sierra_3: Setting Powered False 18:04:02.266591 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:04:03.513670 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:04:03.520157 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:04:03.550276 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:04:03.576810 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:04:03.630598 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:04:03.661451 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:04:03.688079 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:04:04.238662 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:04:04.288752 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:04.300418 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:04:04.366863 tst mo_mt_call.py: using LAC 29677 18:04:04.486993 tst mo_mt_call.py: using RAC 97 18:04:04.608164 tst mo_mt_call.py: using CellId 29677 18:04:04.728855 tst mo_mt_call.py: using BVCI 29678 18:04:04.838863 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:04.850446 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:04.861661 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:04.872684 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:04.883873 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:04.895025 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:04:05.016881 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:04:05.135751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:05.641717 run create_hlr_db(pid=32183): Launched 18:04:05.767146 bus /sierra_2: Setting Powered False 18:04:06.831654 run create_hlr_db(pid=32183): Terminated: ok {rc=0} 18:04:07.270109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32185): Launched 18:04:07.578354 run osmo-hlr_10.42.42.2(pid=32186): Launched 18:04:07.697010 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:08.224511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32188): Launched 18:04:08.529105 run osmo-stp_10.42.42.5(pid=32189): Launched 18:04:08.646566 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:09.204671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32191): Launched 18:04:09.510532 run osmo-msc_10.42.42.6(pid=32192): Launched 18:04:09.681917 run osmo-stp_10.42.42.5(pid=32189): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32189)] 18:04:09.810639 run osmo-stp_10.42.42.5(pid=32189): stdout: | (launched: 2022-12-10_18:04:08.472464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:09.939832 run osmo-stp_10.42.42.5(pid=32189): stderr: | 20221210180408643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180408643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180408643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180408644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180408644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180408644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180408644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:10.067148 run osmo-stp_10.42.42.5(pid=32189): stdout: | (launched: 2022-12-10_18:04:08.472464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:10.188138 run osmo-stp_10.42.42.5(pid=32189): stderr: | 20221210180408643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180408643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180408643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180408644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180408644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180408644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180408644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:10.333339 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32189): Process ended prematurely: osmo-stp_10.42.42.5(pid=32189) [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32189)] [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:04:10.342179 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:04:10.368733 run osmo-hlr_10.42.42.2(pid=32186): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32186)] 18:04:10.416877 run osmo-hlr_10.42.42.2(pid=32186): stdout: | (launched: 2022-12-10_18:04:07.521055) 18:04:10.466495 run osmo-hlr_10.42.42.2(pid=32186): stderr: | 20221210180407698 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180407699 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180407699 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180407699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180407699 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180407699 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180407711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180407719 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180407719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180407719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:10.535833 run osmo-msc_10.42.42.6(pid=32192): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32192)] 18:04:10.583990 run osmo-msc_10.42.42.6(pid=32192): stdout: | (launched: 2022-12-10_18:04:09.453666) 18:04:10.634093 run osmo-msc_10.42.42.6(pid=32192): stderr: | 20221210180409728 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180409728 DLGLOBAL DEBUG validating counter group 0x7f8245880c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180409728 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180409728 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180409728 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180409729 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180409730 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180409731 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180409731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180409731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:10.683933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32185): Terminating (SIGTERM) 18:04:10.723972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32188): Terminating (SIGTERM) 18:04:10.763903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32191): Terminating (SIGTERM) 18:04:10.804280 --- ParallelTerminationStrategy: PID 32185 died... 18:04:10.823538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32185): Terminated: ok {rc=0} 18:04:10.868158 --- ParallelTerminationStrategy: PID 32188 died... 18:04:10.887123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32188): Terminated: ok {rc=0} 18:04:10.931303 --- ParallelTerminationStrategy: PID 32191 died... 18:04:10.950216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32191): Terminated: ok {rc=0} 18:04:11.034921 bus /sierra_3: Setting Powered False 18:04:12.131788 bus /sierra_3: Setting Powered False 18:04:13.248140 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:04:14.395741 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:14.407644 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:04:14.473713 tst mo_mt_call_osmux.py: using LAC 29678 18:04:14.595104 tst mo_mt_call_osmux.py: using RAC 98 18:04:14.716118 tst mo_mt_call_osmux.py: using CellId 29678 18:04:14.836221 tst mo_mt_call_osmux.py: using BVCI 29679 18:04:14.948566 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:14.959992 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:14.971168 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:14.982460 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:14.993712 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:15.004760 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:04:15.120491 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:04:15.239100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:15.714454 run create_hlr_db(pid=32195): Launched 18:04:15.846954 bus /sierra_2: Setting Powered False 18:04:16.907656 run create_hlr_db(pid=32195): Terminated: ok {rc=0} 18:04:17.373425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32197): Launched 18:04:17.700750 run osmo-hlr_10.42.42.2(pid=32198): Launched 18:04:17.824925 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:18.389427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32200): Launched 18:04:18.715549 run osmo-stp_10.42.42.5(pid=32201): Launched 18:04:18.839422 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:19.428362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32203): Launched 18:04:19.754825 run osmo-msc_10.42.42.6(pid=32204): Launched 18:04:19.936190 run osmo-stp_10.42.42.5(pid=32201): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32201)] 18:04:20.074856 run osmo-stp_10.42.42.5(pid=32201): stdout: | (launched: 2022-12-10_18:04:18.655480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:20.213913 run osmo-stp_10.42.42.5(pid=32201): stderr: | 20221210180418848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180418848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180418849 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180418849 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180418849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180418849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180418850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:20.351218 run osmo-stp_10.42.42.5(pid=32201): stdout: | (launched: 2022-12-10_18:04:18.655480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:20.481301 run osmo-stp_10.42.42.5(pid=32201): stderr: | 20221210180418848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180418848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180418849 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180418849 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180418849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180418849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180418850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:20.636531 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32201): Process ended prematurely: osmo-stp_10.42.42.5(pid=32201) [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32201)] [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:04:20.646455 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:04:20.675567 run osmo-hlr_10.42.42.2(pid=32198): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32198)] 18:04:20.726977 run osmo-hlr_10.42.42.2(pid=32198): stdout: | (launched: 2022-12-10_18:04:17.640444) 18:04:20.780219 run osmo-hlr_10.42.42.2(pid=32198): stderr: | 20221210180417842 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180417842 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180417842 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180417842 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180417842 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180417842 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180417854 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180417864 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180417864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180417864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:20.854122 run osmo-msc_10.42.42.6(pid=32204): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32204)] 18:04:20.905358 run osmo-msc_10.42.42.6(pid=32204): stdout: | (launched: 2022-12-10_18:04:19.694637) 18:04:20.958698 run osmo-msc_10.42.42.6(pid=32204): stderr: | 20221210180420015 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180420015 DLGLOBAL DEBUG validating counter group 0x7f2b9013dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180420015 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180420015 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180420015 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180420015 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180420017 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180420018 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180420018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180420018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:21.012209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32197): Terminating (SIGTERM) 18:04:21.055323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32200): Terminating (SIGTERM) 18:04:21.098335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32203): Terminating (SIGTERM) 18:04:21.141313 --- ParallelTerminationStrategy: PID 32197 died... 18:04:21.161829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32197): Terminated: ok {rc=0} 18:04:21.209634 --- ParallelTerminationStrategy: PID 32200 died... 18:04:21.230043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32200): Terminated: ok {rc=0} 18:04:21.277482 --- ParallelTerminationStrategy: PID 32203 died... 18:04:21.297576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32203): Terminated: ok {rc=0} 18:04:21.386623 bus /sierra_3: Setting Powered False 18:04:22.487377 bus /sierra_3: Setting Powered False 18:04:23.604039 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 18:04:24.863749 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:04:24.871216 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 18:04:24.900320 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 18:04:24.927335 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 18:04:24.986227 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 18:04:25.015420 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 18:04:25.041859 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 18:04:25.588030 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 18:04:25.636612 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:25.648043 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:04:25.713435 tst mo_mt_call.py: using LAC 29679 18:04:25.832840 tst mo_mt_call.py: using RAC 99 18:04:25.955167 tst mo_mt_call.py: using CellId 29679 18:04:26.075160 tst mo_mt_call.py: using BVCI 29680 18:04:26.186672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:26.197964 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:26.209163 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:26.220256 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:26.231339 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:26.242377 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:04:26.362177 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:04:26.481426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:26.986459 run create_hlr_db(pid=32209): Launched 18:04:27.111808 bus /sierra_2: Setting Powered False 18:04:28.176105 run create_hlr_db(pid=32209): Terminated: ok {rc=0} 18:04:28.615416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32211): Launched 18:04:28.922215 run osmo-hlr_10.42.42.2(pid=32212): Launched 18:04:29.038587 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:29.564321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32214): Launched 18:04:29.869330 run osmo-stp_10.42.42.5(pid=32215): Launched 18:04:29.985297 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:30.535222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32217): Launched 18:04:30.846010 run osmo-msc_10.42.42.6(pid=32218): Launched 18:04:31.193493 run osmo-stp_10.42.42.5(pid=32215): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32215)] 18:04:31.395894 run osmo-stp_10.42.42.5(pid=32215): stdout: | (launched: 2022-12-10_18:04:29.812608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:31.561369 run osmo-stp_10.42.42.5(pid=32215): stderr: | 20221210180429983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180429984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180429984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180429984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180429985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180429985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180429985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:31.703762 run osmo-stp_10.42.42.5(pid=32215): stdout: | (launched: 2022-12-10_18:04:29.812608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:31.838731 run osmo-stp_10.42.42.5(pid=32215): stderr: | 20221210180429983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180429984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180429984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180429984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180429985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180429985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180429985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:31.998887 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32215): Process ended prematurely: osmo-stp_10.42.42.5(pid=32215) [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32215)] [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 18:04:32.009862 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:04:32.042857 run osmo-hlr_10.42.42.2(pid=32212): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32212)] 18:04:32.096163 run osmo-hlr_10.42.42.2(pid=32212): stdout: | (launched: 2022-12-10_18:04:28.865203) 18:04:32.151465 run osmo-hlr_10.42.42.2(pid=32212): stderr: | 20221210180429042 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180429042 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180429042 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180429042 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180429042 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180429043 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180429055 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180429064 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180429064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180429064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:32.228400 run osmo-msc_10.42.42.6(pid=32218): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32218)] 18:04:32.281703 run osmo-msc_10.42.42.6(pid=32218): stdout: | (launched: 2022-12-10_18:04:30.783470) 18:04:32.336256 run osmo-msc_10.42.42.6(pid=32218): stderr: | 20221210180431164 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180431164 DLGLOBAL DEBUG validating counter group 0x7f4f51f10c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180431165 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180431165 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180431165 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180431165 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180431168 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180431169 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180431169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180431169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:32.392090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32211): Terminating (SIGTERM) 18:04:32.436642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32214): Terminating (SIGTERM) 18:04:32.479732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32217): Terminating (SIGTERM) 18:04:32.523084 --- ParallelTerminationStrategy: PID 32211 died... 18:04:32.543312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32211): Terminated: ok {rc=0} 18:04:32.591936 --- ParallelTerminationStrategy: PID 32214 died... 18:04:32.611753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32214): Terminated: ok {rc=0} 18:04:32.659020 --- ParallelTerminationStrategy: PID 32217 died... 18:04:32.677898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32217): Terminated: ok {rc=0} 18:04:32.761445 bus /sierra_3: Setting Powered False 18:04:33.858006 bus /sierra_3: Setting Powered False 18:04:34.973319 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 18:04:36.130319 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:36.142239 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:04:36.212729 tst mo_mt_call_osmux.py: using LAC 29680 18:04:36.332507 tst mo_mt_call_osmux.py: using RAC 100 18:04:36.458262 tst mo_mt_call_osmux.py: using CellId 29680 18:04:36.583193 tst mo_mt_call_osmux.py: using BVCI 29681 18:04:36.699910 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:36.711672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:36.723157 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:36.734989 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:36.746926 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:36.758602 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:04:36.873585 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:04:36.989311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:37.456812 run create_hlr_db(pid=32220): Launched 18:04:37.580339 bus /sierra_2: Setting Powered False 18:04:38.640545 run create_hlr_db(pid=32220): Terminated: ok {rc=0} 18:04:39.077560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32222): Launched 18:04:39.398618 run osmo-hlr_10.42.42.2(pid=32223): Launched 18:04:39.520466 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:40.072501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32225): Launched 18:04:40.393590 run osmo-stp_10.42.42.5(pid=32226): Launched 18:04:40.516408 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:41.099137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32228): Launched 18:04:41.419977 run osmo-msc_10.42.42.6(pid=32229): Launched 18:04:41.599698 run osmo-stp_10.42.42.5(pid=32226): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32226)] 18:04:41.735876 run osmo-stp_10.42.42.5(pid=32226): stdout: | (launched: 2022-12-10_18:04:40.334611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:41.873079 run osmo-stp_10.42.42.5(pid=32226): stderr: | 20221210180440526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180440526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180440526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180440526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180440527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180440527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180440527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:42.007277 run osmo-stp_10.42.42.5(pid=32226): stdout: | (launched: 2022-12-10_18:04:40.334611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:42.135528 run osmo-stp_10.42.42.5(pid=32226): stderr: | 20221210180440526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180440526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180440526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180440526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180440527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180440527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180440527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:42.288553 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32226): Process ended prematurely: osmo-stp_10.42.42.5(pid=32226) [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32226)] [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 18:04:42.298090 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:04:42.326655 run osmo-hlr_10.42.42.2(pid=32223): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32223)] 18:04:42.376643 run osmo-hlr_10.42.42.2(pid=32223): stdout: | (launched: 2022-12-10_18:04:39.339810) 18:04:42.428377 run osmo-hlr_10.42.42.2(pid=32223): stderr: | 20221210180439536 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180439536 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180439536 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180439536 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180439536 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180439536 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180439551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180439560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180439560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180439560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:42.500522 run osmo-msc_10.42.42.6(pid=32229): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32229)] 18:04:42.550656 run osmo-msc_10.42.42.6(pid=32229): stdout: | (launched: 2022-12-10_18:04:41.361458) 18:04:42.602189 run osmo-msc_10.42.42.6(pid=32229): stderr: | 20221210180441679 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180441679 DLGLOBAL DEBUG validating counter group 0x7f52cd02fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180441679 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180441679 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180441679 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180441680 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180441681 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180441682 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180441682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180441682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:42.654407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32222): Terminating (SIGTERM) 18:04:42.696453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32225): Terminating (SIGTERM) 18:04:42.737988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32228): Terminating (SIGTERM) 18:04:42.779910 --- ParallelTerminationStrategy: PID 32222 died... 18:04:42.799867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32222): Terminated: ok {rc=0} 18:04:42.846186 --- ParallelTerminationStrategy: PID 32225 died... 18:04:42.865588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32225): Terminated: ok {rc=0} 18:04:42.911893 --- ParallelTerminationStrategy: PID 32228 died... 18:04:42.931403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32228): Terminated: ok {rc=0} 18:04:43.019226 bus /sierra_3: Setting Powered False 18:04:44.114356 bus /sierra_3: Setting Powered False 18:04:45.228460 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:04:46.496758 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:04:46.505251 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:04:46.544155 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:04:46.577185 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:04:46.640236 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:04:46.693888 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:04:46.738874 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:04:47.255938 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:04:47.305074 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:04:47.316293 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:04:47.381582 tst mo_mt_call.py: using LAC 29681 18:04:47.499355 tst mo_mt_call.py: using RAC 101 18:04:47.619702 tst mo_mt_call.py: using CellId 29681 18:04:47.737368 tst mo_mt_call.py: using BVCI 29682 18:04:47.846368 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:04:47.857696 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:04:47.868685 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:04:47.879818 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:04:47.890991 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:04:47.902074 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:04:48.019591 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:04:48.134964 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:48.601044 run create_hlr_db(pid=32235): Launched 18:04:48.723105 bus /sierra_2: Setting Powered False 18:04:49.782843 run create_hlr_db(pid=32235): Terminated: ok {rc=0} 18:04:50.221101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32237): Launched 18:04:50.542815 run osmo-hlr_10.42.42.2(pid=32238): Launched 18:04:50.667727 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:51.219574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32240): Launched 18:04:51.541262 run osmo-stp_10.42.42.5(pid=32241): Launched 18:04:51.666048 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:52.247648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32243): Launched 18:04:52.569515 run osmo-msc_10.42.42.6(pid=32244): Launched 18:04:52.751595 run osmo-stp_10.42.42.5(pid=32241): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32241)] 18:04:52.886936 run osmo-stp_10.42.42.5(pid=32241): stdout: | (launched: 2022-12-10_18:04:51.482319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:53.022642 run osmo-stp_10.42.42.5(pid=32241): stderr: | 20221210180451673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180451673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180451674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180451674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180451674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180451674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180451675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:53.157782 run osmo-stp_10.42.42.5(pid=32241): stdout: | (launched: 2022-12-10_18:04:51.482319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:53.285542 run osmo-stp_10.42.42.5(pid=32241): stderr: | 20221210180451673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180451673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180451674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180451674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180451674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180451674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180451675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:53.438364 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32241): Process ended prematurely: osmo-stp_10.42.42.5(pid=32241) [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32241)] [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:04:53.447823 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:04:53.476064 run osmo-hlr_10.42.42.2(pid=32238): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32238)] 18:04:53.525715 run osmo-hlr_10.42.42.2(pid=32238): stdout: | (launched: 2022-12-10_18:04:50.484243) 18:04:53.577140 run osmo-hlr_10.42.42.2(pid=32238): stderr: | 20221210180450680 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180450680 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180450680 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180450680 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180450680 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180450681 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180450693 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180450703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180450703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180450703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:53.649198 run osmo-msc_10.42.42.6(pid=32244): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32244)] 18:04:53.699019 run osmo-msc_10.42.42.6(pid=32244): stdout: | (launched: 2022-12-10_18:04:52.510475) 18:04:53.750660 run osmo-msc_10.42.42.6(pid=32244): stderr: | 20221210180452828 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180452828 DLGLOBAL DEBUG validating counter group 0x7f802c055c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180452828 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180452828 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180452828 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180452829 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180452830 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180452831 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180452831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180452831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:53.802430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32237): Terminating (SIGTERM) 18:04:53.844117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32240): Terminating (SIGTERM) 18:04:53.885730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32243): Terminating (SIGTERM) 18:04:53.927606 --- ParallelTerminationStrategy: PID 32237 died... 18:04:53.947437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32237): Terminated: ok {rc=0} 18:04:53.993695 --- ParallelTerminationStrategy: PID 32240 died... 18:04:54.012881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32240): Terminated: ok {rc=0} 18:04:54.059620 --- ParallelTerminationStrategy: PID 32243 died... 18:04:54.079034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32243): Terminated: ok {rc=0} 18:04:54.167185 bus /sierra_3: Setting Powered False 18:04:55.266139 bus /sierra_3: Setting Powered False 18:04:56.383648 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:04:57.533167 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:04:57.545513 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:04:57.613044 tst mo_mt_call_osmux.py: using LAC 29682 18:04:57.738251 tst mo_mt_call_osmux.py: using RAC 102 18:04:57.864246 tst mo_mt_call_osmux.py: using CellId 29682 18:04:57.991454 tst mo_mt_call_osmux.py: using BVCI 29683 18:04:58.108296 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:04:58.119998 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:04:58.131581 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:04:58.143309 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:04:58.155074 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:04:58.166777 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:04:58.286973 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:04:58.403447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:58.871463 run create_hlr_db(pid=32246): Launched 18:04:58.995039 bus /sierra_2: Setting Powered False 18:05:00.054875 run create_hlr_db(pid=32246): Terminated: ok {rc=0} 18:05:00.472339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32248): Launched 18:05:00.772311 run osmo-hlr_10.42.42.2(pid=32249): Launched 18:05:00.890676 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:01.582957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32251): Launched 18:05:01.937944 run osmo-stp_10.42.42.5(pid=32254): Launched 18:05:02.119693 run osmo-msc_10.42.42.6: Starting osmo-msc 18:05:02.881031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32264): Launched 18:05:03.201959 run osmo-msc_10.42.42.6(pid=32265): Launched 18:05:03.380381 run osmo-stp_10.42.42.5(pid=32254): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32254)] 18:05:03.516013 run osmo-stp_10.42.42.5(pid=32254): stdout: | (launched: 2022-12-10_18:05:01.864596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:03.653335 run osmo-stp_10.42.42.5(pid=32254): stderr: | 20221210180502196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180502196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180502197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180502197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180502197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180502198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180502198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:03.787845 run osmo-stp_10.42.42.5(pid=32254): stdout: | (launched: 2022-12-10_18:05:01.864596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:03.915502 run osmo-stp_10.42.42.5(pid=32254): stderr: | 20221210180502196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180502196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180502197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180502197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180502197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180502198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180502198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:04.068849 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32254): Process ended prematurely: osmo-stp_10.42.42.5(pid=32254) [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32254)] [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:05:04.078710 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 18:05:04.107383 run osmo-hlr_10.42.42.2(pid=32249): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32249)] 18:05:04.157424 run osmo-hlr_10.42.42.2(pid=32249): stdout: | (launched: 2022-12-10_18:05:00.716562) 18:05:04.209157 run osmo-hlr_10.42.42.2(pid=32249): stderr: | 20221210180501000 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180501000 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180501000 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180501000 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180501000 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180501005 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180501024 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180501034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180501035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180501035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:04.281289 run osmo-msc_10.42.42.6(pid=32265): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32265)] 18:05:04.331572 run osmo-msc_10.42.42.6(pid=32265): stdout: | (launched: 2022-12-10_18:05:03.143267) 18:05:04.383421 run osmo-msc_10.42.42.6(pid=32265): stderr: | 20221210180503462 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180503462 DLGLOBAL DEBUG validating counter group 0x7ff392719c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180503462 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180503462 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180503462 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180503462 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180503464 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180503464 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180503465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180503465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:05:04.435446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32248): Terminating (SIGTERM) 18:05:04.477061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32251): Terminating (SIGTERM) 18:05:04.518743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32264): Terminating (SIGTERM) 18:05:04.560879 --- ParallelTerminationStrategy: PID 32248 died... 18:05:04.581100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32248): Terminated: ok {rc=0} 18:05:04.627360 --- ParallelTerminationStrategy: PID 32251 died... 18:05:04.647169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32251): Terminated: ok {rc=0} 18:05:04.693328 --- ParallelTerminationStrategy: PID 32264 died... 18:05:04.712676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32264): Terminated: ok {rc=0} 18:05:04.800169 bus /sierra_3: Setting Powered False 18:05:05.898501 bus /sierra_3: Setting Powered False 18:05:07.014392 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:05:08.262730 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:05:08.269712 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:05:08.300794 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:05:08.328526 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:05:08.381880 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:05:08.412023 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:05:08.439181 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:05:08.994250 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:05:09.045991 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:09.058626 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:05:09.126858 tst mo_mt_call.py: using LAC 29683 18:05:09.258888 tst mo_mt_call.py: using RAC 103 18:05:09.377088 tst mo_mt_call.py: using CellId 29683 18:05:09.493707 tst mo_mt_call.py: using BVCI 29684 18:05:09.602426 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:09.613859 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:09.624913 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:09.636082 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:09.647311 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:09.658521 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:05:09.776390 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:05:09.896765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:10.395563 run create_hlr_db(pid=32270): Launched 18:05:10.518422 bus /sierra_2: Setting Powered False 18:05:11.582206 run create_hlr_db(pid=32270): Terminated: ok {rc=0} 18:05:12.028691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32272): Launched 18:05:12.350145 run osmo-hlr_10.42.42.2(pid=32273): Launched 18:05:12.472810 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:13.033400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32281): Launched 18:05:13.363545 run osmo-stp_10.42.42.5(pid=32319): Launched 18:05:13.566554 run osmo-msc_10.42.42.6: Starting osmo-msc 18:05:14.217831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32455): Launched 18:05:14.553757 run osmo-msc_10.42.42.6(pid=32494): Launched 18:05:14.807927 run osmo-stp_10.42.42.5(pid=32319): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32319)] 18:05:15.030214 run osmo-stp_10.42.42.5(pid=32319): stdout: | (launched: 2022-12-10_18:05:13.302819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:15.247950 run osmo-stp_10.42.42.5(pid=32319): stderr: | 20221210180513541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180513541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180513541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180513542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180513542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180513542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180513542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:15.404006 run osmo-stp_10.42.42.5(pid=32319): stdout: | (launched: 2022-12-10_18:05:13.302819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:15.532547 run osmo-stp_10.42.42.5(pid=32319): stderr: | 20221210180513541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180513541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180513541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180513542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180513542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180513542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180513542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:15.686636 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32319): Process ended prematurely: osmo-stp_10.42.42.5(pid=32319) [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32319)] [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:05:15.696293 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 18:05:15.725646 run osmo-hlr_10.42.42.2(pid=32273): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32273)] 18:05:15.777377 run osmo-hlr_10.42.42.2(pid=32273): stdout: | (launched: 2022-12-10_18:05:12.291166) 18:05:15.830606 run osmo-hlr_10.42.42.2(pid=32273): stderr: | 20221210180512488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180512488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180512488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180512488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180512488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180512488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180512500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180512508 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180512508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180512509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:15.919142 run osmo-msc_10.42.42.6(pid=32494): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32494)] 18:05:15.971253 run osmo-msc_10.42.42.6(pid=32494): stdout: | (launched: 2022-12-10_18:05:14.489772) 18:05:16.024632 run osmo-msc_10.42.42.6(pid=32494): stderr: | 20221210180515046 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180515046 DLGLOBAL DEBUG validating counter group 0x7fe90a9ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180515046 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180515046 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180515046 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180515046 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180515048 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180515048 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180515053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180515053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:05:16.078779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32272): Terminating (SIGTERM) 18:05:16.122255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32281): Terminating (SIGTERM) 18:05:16.165459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32455): Terminating (SIGTERM) 18:05:16.209441 --- ParallelTerminationStrategy: PID 32272 died... 18:05:16.229902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32272): Terminated: ok {rc=0} 18:05:16.279469 --- ParallelTerminationStrategy: PID 32281 died... 18:05:16.299711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32281): Terminated: ok {rc=0} 18:05:16.348410 --- ParallelTerminationStrategy: PID 32455 died... 18:05:16.368670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32455): Terminated: ok {rc=0} 18:05:16.457933 bus /sierra_3: Setting Powered False 18:05:17.557568 bus /sierra_3: Setting Powered False 18:05:18.672208 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:05:19.817234 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:19.829213 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:05:19.895763 tst mo_mt_call_osmux.py: using LAC 29684 18:05:20.013893 tst mo_mt_call_osmux.py: using RAC 104 18:05:20.135563 tst mo_mt_call_osmux.py: using CellId 29684 18:05:20.265745 tst mo_mt_call_osmux.py: using BVCI 29685 18:05:20.384378 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:20.396356 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:20.408086 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:20.420517 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:20.433075 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:20.445620 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:05:20.567853 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:05:20.681691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:21.147889 run create_hlr_db(pid=32632): Launched 18:05:21.271194 bus /sierra_2: Setting Powered False 18:05:22.331438 run create_hlr_db(pid=32632): Terminated: ok {rc=0} 18:05:22.768761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32634): Launched 18:05:23.090297 run osmo-hlr_10.42.42.2(pid=32635): Launched 18:05:23.212413 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:23.785150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32656): Launched 18:05:24.129812 run osmo-stp_10.42.42.5(pid=32735): Launched 18:05:24.257777 run osmo-msc_10.42.42.6: Starting osmo-msc 18:05:24.929822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=349): Launched 18:05:25.251303 run osmo-msc_10.42.42.6(pid=355): Launched 18:05:25.604226 run osmo-stp_10.42.42.5(pid=32735): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32735)] 18:05:25.891450 run osmo-stp_10.42.42.5(pid=32735): stdout: | (launched: 2022-12-10_18:05:24.063749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:26.056657 run osmo-stp_10.42.42.5(pid=32735): stderr: | 20221210180524358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180524358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180524358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180524359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180524359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180524359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180524359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:26.194485 run osmo-stp_10.42.42.5(pid=32735): stdout: | (launched: 2022-12-10_18:05:24.063749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:26.324732 run osmo-stp_10.42.42.5(pid=32735): stderr: | 20221210180524358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180524358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180524358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180524359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180524359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180524359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180524359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:26.482054 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32735): Process ended prematurely: osmo-stp_10.42.42.5(pid=32735) [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32735)] [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:05:26.492643 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 18:05:26.524277 run osmo-hlr_10.42.42.2(pid=32635): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32635)] 18:05:26.576764 run osmo-hlr_10.42.42.2(pid=32635): stdout: | (launched: 2022-12-10_18:05:23.031064) 18:05:26.630774 run osmo-hlr_10.42.42.2(pid=32635): stderr: | 20221210180523224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180523224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180523224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180523224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180523224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180523225 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180523237 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180523245 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180523245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180523245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:26.705985 run osmo-msc_10.42.42.6(pid=355): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=355)] 18:05:26.758524 run osmo-msc_10.42.42.6(pid=355): stdout: | (launched: 2022-12-10_18:05:25.190956) 18:05:26.812748 run osmo-msc_10.42.42.6(pid=355): stderr: | 20221210180525684 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180525684 DLGLOBAL DEBUG validating counter group 0x7fecc95d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180525684 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180525684 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180525692 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180525692 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180525694 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180525694 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180525694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180525694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:05:26.867564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32634): Terminating (SIGTERM) 18:05:26.911401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32656): Terminating (SIGTERM) 18:05:26.958394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=349): Terminating (SIGTERM) 18:05:27.004755 --- ParallelTerminationStrategy: PID 32634 died... 18:05:27.025726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32634): Terminated: ok {rc=0} 18:05:27.077258 --- ParallelTerminationStrategy: PID 32656 died... 18:05:27.098035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32656): Terminated: ok {rc=0} 18:05:27.148576 --- ParallelTerminationStrategy: PID 349 died... 18:05:27.169422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=349): Terminated: ok {rc=0} 18:05:27.261880 bus /sierra_3: Setting Powered False 18:05:28.366052 bus /sierra_3: Setting Powered False 18:05:29.490720 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:05:30.738645 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:05:30.744190 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:05:30.772942 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 18:05:30.799320 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 18:05:30.866427 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:05:30.914030 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 18:05:30.942107 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 18:05:31.473393 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 18:05:31.534062 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:31.546207 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:05:31.619663 tst mo_mt_call.py: using LAC 29685 18:05:31.782676 tst mo_mt_call.py: using RAC 105 18:05:31.947367 tst mo_mt_call.py: using CellId 29685 18:05:32.068047 tst mo_mt_call.py: using BVCI 29686 18:05:32.180337 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:32.191863 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:32.203458 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:32.215658 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:32.227745 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:32.240694 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:05:32.359078 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:05:32.478450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:32.976801 run create_hlr_db(pid=362): Launched 18:05:33.099870 bus /sierra_2: Setting Powered False 18:05:34.164515 run create_hlr_db(pid=362): Terminated: ok {rc=0} 18:05:34.594412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=369): Launched 18:05:34.900026 run osmo-hlr_10.42.42.2(pid=370): Launched 18:05:35.015132 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:35.545404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=372): Launched 18:05:35.846544 run osmo-stp_10.42.42.5(pid=373): Launched 18:05:35.960688 run osmo-msc_10.42.42.6: Starting osmo-msc 18:05:36.503504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=375): Launched 18:05:36.805652 run osmo-msc_10.42.42.6(pid=376): Launched 18:05:36.975202 run osmo-stp_10.42.42.5(pid=373): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=373)] 18:05:37.102141 run osmo-stp_10.42.42.5(pid=373): stdout: | (launched: 2022-12-10_18:05:35.790622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:37.228831 run osmo-stp_10.42.42.5(pid=373): stderr: | 20221210180535959 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180535959 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180535960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180535960 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180535961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180535961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180535961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:37.353704 run osmo-stp_10.42.42.5(pid=373): stdout: | (launched: 2022-12-10_18:05:35.790622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:37.472779 run osmo-stp_10.42.42.5(pid=373): stderr: | 20221210180535959 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180535959 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180535960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180535960 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180535961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180535961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180535961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:37.615302 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=373): Process ended prematurely: osmo-stp_10.42.42.5(pid=373) [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=373)] [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 18:05:37.624041 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:05:37.650726 run osmo-hlr_10.42.42.2(pid=370): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=370)] 18:05:37.698067 run osmo-hlr_10.42.42.2(pid=370): stdout: | (launched: 2022-12-10_18:05:34.843690) 18:05:37.747571 run osmo-hlr_10.42.42.2(pid=370): stderr: | 20221210180535018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180535018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180535018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180535018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180535018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180535018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180535030 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180535040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180535040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180535040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:37.816612 run osmo-msc_10.42.42.6(pid=376): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=376)] 18:05:37.864346 run osmo-msc_10.42.42.6(pid=376): stdout: | (launched: 2022-12-10_18:05:36.749947) 18:05:37.913510 run osmo-msc_10.42.42.6(pid=376): stderr: | 20221210180537019 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180537019 DLGLOBAL DEBUG validating counter group 0x7f1495f71c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180537019 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180537019 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180537019 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180537020 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180537021 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180537022 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180537022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180537022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:05:37.963412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=369): Terminating (SIGTERM) 18:05:38.003068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=372): Terminating (SIGTERM) 18:05:38.042665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=375): Terminating (SIGTERM) 18:05:38.082507 --- ParallelTerminationStrategy: PID 369 died... 18:05:38.101704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=369): Terminated: ok {rc=0} 18:05:38.146169 --- ParallelTerminationStrategy: PID 372 died... 18:05:38.164823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=372): Terminated: ok {rc=0} 18:05:38.208891 --- ParallelTerminationStrategy: PID 375 died... 18:05:38.228006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=375): Terminated: ok {rc=0} 18:05:38.313995 bus /sierra_3: Setting Powered False 18:05:39.413514 bus /sierra_3: Setting Powered False 18:05:40.526398 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 18:05:41.674407 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:41.686806 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:05:41.759990 tst mo_mt_call_osmux.py: using LAC 29686 18:05:41.886307 tst mo_mt_call_osmux.py: using RAC 106 18:05:42.010102 tst mo_mt_call_osmux.py: using CellId 29686 18:05:42.134814 tst mo_mt_call_osmux.py: using BVCI 29687 18:05:42.253000 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:42.264648 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:42.276055 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:42.287615 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:42.299245 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:42.310777 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:05:42.425407 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:05:42.544082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:43.043157 run create_hlr_db(pid=379): Launched 18:05:43.168623 bus /sierra_2: Setting Powered False 18:05:44.232650 run create_hlr_db(pid=379): Terminated: ok {rc=0} 18:05:44.663963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=381): Launched 18:05:44.967706 run osmo-hlr_10.42.42.2(pid=382): Launched 18:05:45.082086 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:45.599964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=384): Launched 18:05:45.905146 run osmo-stp_10.42.42.5(pid=385): Launched 18:05:46.238517 run osmo-msc_10.42.42.6: Starting osmo-msc 18:05:46.798989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=387): Launched 18:05:47.117679 run osmo-msc_10.42.42.6(pid=388): Launched 18:05:47.345410 run osmo-stp_10.42.42.5(pid=385): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=385)] 18:05:47.472511 run osmo-stp_10.42.42.5(pid=385): stdout: | (launched: 2022-12-10_18:05:45.845885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:47.601523 run osmo-stp_10.42.42.5(pid=385): stderr: | 20221210180546072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180546072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180546072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180546074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180546074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180546074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180546075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:47.726979 run osmo-stp_10.42.42.5(pid=385): stdout: | (launched: 2022-12-10_18:05:45.845885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:47.846945 run osmo-stp_10.42.42.5(pid=385): stderr: | 20221210180546072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180546072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180546072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180546074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180546074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180546074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180546075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:47.990095 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=385): Process ended prematurely: osmo-stp_10.42.42.5(pid=385) [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=385)] [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 18:05:47.998970 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 18:05:48.025488 run osmo-hlr_10.42.42.2(pid=382): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=382)] 18:05:48.072761 run osmo-hlr_10.42.42.2(pid=382): stdout: | (launched: 2022-12-10_18:05:44.912443) 18:05:48.121842 run osmo-hlr_10.42.42.2(pid=382): stderr: | 20221210180545090 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180545090 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180545090 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180545090 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180545090 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180545091 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180545104 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180545115 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180545115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180545115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:48.190506 run osmo-msc_10.42.42.6(pid=388): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=388)] 18:05:48.237767 run osmo-msc_10.42.42.6(pid=388): stdout: | (launched: 2022-12-10_18:05:47.060845) 18:05:48.286502 run osmo-msc_10.42.42.6(pid=388): stderr: | 20221210180547459 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180547460 DLGLOBAL DEBUG validating counter group 0x7f2130256c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180547460 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180547460 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180547460 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180547460 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180547462 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180547462 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180547463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180547463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:05:48.335576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=381): Terminating (SIGTERM) 18:05:48.374896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=384): Terminating (SIGTERM) 18:05:48.414343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=387): Terminating (SIGTERM) 18:05:48.454247 --- ParallelTerminationStrategy: PID 381 died... 18:05:48.473078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=381): Terminated: ok {rc=0} 18:05:48.517179 --- ParallelTerminationStrategy: PID 384 died... 18:05:48.535551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=384): Terminated: ok {rc=0} 18:05:48.579440 --- ParallelTerminationStrategy: PID 387 died... 18:05:48.597944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=387): Terminated: ok {rc=0} 18:05:48.683576 bus /sierra_3: Setting Powered False 18:05:49.783155 bus /sierra_3: Setting Powered False 18:05:50.897142 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 18:05:52.143840 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:05:52.148515 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:05:52.179020 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:05:52.207126 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 18:05:52.293309 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:05:52.323385 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:05:52.350798 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 18:05:52.937283 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2377 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 18:05:52.942364 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:05:52.953825 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:05:53.000177 tst emergency_mo_mt_call.py: using LAC 29687 18:05:53.125367 tst emergency_mo_mt_call.py: using RAC 107 18:05:53.249777 tst emergency_mo_mt_call.py: using CellId 29687 18:05:53.366146 tst emergency_mo_mt_call.py: using BVCI 29688 18:05:53.472610 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:05:53.483691 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:05:53.494549 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:05:53.505470 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:05:53.516309 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:05:53.527230 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:05:53.643137 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:05:53.758475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:54.218089 run create_hlr_db(pid=393): Launched 18:05:54.341336 bus /sierra_2: Setting Powered False 18:05:55.400671 run create_hlr_db(pid=393): Terminated: ok {rc=0} 18:05:55.833312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=395): Launched 18:05:56.151921 run osmo-hlr_10.42.42.2(pid=396): Launched 18:05:56.272070 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:56.813324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=398): Launched 18:05:57.129543 run osmo-stp_10.42.42.5(pid=399): Launched 18:05:57.259177 tst emergency_mo_mt_call.py: using MSISDN 7829 18:05:57.420827 run osmo-msc_10.42.42.6: Starting osmo-msc 18:05:57.992931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=401): Launched 18:05:58.310383 run osmo-msc_10.42.42.6(pid=402): Launched 18:05:58.488792 run osmo-stp_10.42.42.5(pid=399): ERR: Terminated: ERROR {rc=1} [trial-2377↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=399)] 18:05:58.623052 run osmo-stp_10.42.42.5(pid=399): stdout: | (launched: 2022-12-10_18:05:57.070988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:58.758041 run osmo-stp_10.42.42.5(pid=399): stderr: | 20221210180557262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180557262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180557263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180557263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180557264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180557264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180557264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:58.891840 run osmo-stp_10.42.42.5(pid=399): stdout: | (launched: 2022-12-10_18:05:57.070988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:59.018137 run osmo-stp_10.42.42.5(pid=399): stderr: | 20221210180557262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180557262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180557263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180557263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180557264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180557264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180557264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:59.169828 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=399): Process ended prematurely: osmo-stp_10.42.42.5(pid=399) [trial-2377↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=399)] [trial-2377↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 18:05:59.178877 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 18:05:59.207192 run osmo-hlr_10.42.42.2(pid=396): ERR: Terminated: ERROR {rc=237} [trial-2377↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=396)] 18:05:59.258061 run osmo-hlr_10.42.42.2(pid=396): stdout: | (launched: 2022-12-10_18:05:56.093820) 18:05:59.310462 run osmo-hlr_10.42.42.2(pid=396): stderr: | 20221210180556292 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180556292 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180556292 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180556292 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180556292 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180556292 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180556304 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180556312 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180556312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180556312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:59.383478 run osmo-msc_10.42.42.6(pid=402): ERR: Terminated: ERROR {rc=2} [trial-2377↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=402)] 18:05:59.433903 run osmo-msc_10.42.42.6(pid=402): stdout: | (launched: 2022-12-10_18:05:58.252348) 18:05:59.486231 run osmo-msc_10.42.42.6(pid=402): stderr: | 20221210180558572 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180558572 DLGLOBAL DEBUG validating counter group 0x7f1abaf27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180558572 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180558572 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180558572 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180558572 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180558574 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180558575 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180558575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180558575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:05:59.538849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=395): Terminating (SIGTERM) 18:05:59.580730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=398): Terminating (SIGTERM) 18:05:59.622905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=401): Terminating (SIGTERM) 18:05:59.665252 --- ParallelTerminationStrategy: PID 395 died... 18:05:59.685361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=395): Terminated: ok {rc=0} 18:05:59.732307 --- ParallelTerminationStrategy: PID 398 died... 18:05:59.751906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=398): Terminated: ok {rc=0} 18:05:59.798502 --- ParallelTerminationStrategy: PID 401 died... 18:05:59.817970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=401): Terminated: ok {rc=0} 18:05:59.906177 bus /sierra_3: Setting Powered False 18:06:01.005463 bus /sierra_3: Setting Powered False 18:06:02.132072 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 18:06:03.221872 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:03.233952 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:06:03.283001 tst emergency_preemptive_call.py: using LAC 29688 18:06:03.408043 tst emergency_preemptive_call.py: using RAC 108 18:06:03.532725 tst emergency_preemptive_call.py: using CellId 29688 18:06:03.656392 tst emergency_preemptive_call.py: using BVCI 29689 18:06:03.770860 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:03.782268 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:03.793312 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:03.804651 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:03.816052 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:03.827279 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:03.945144 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:04.060438 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:04.174097 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:04.289610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:04.781281 run create_hlr_db(pid=404): Launched 18:06:04.903924 bus /sierra_2: Setting Powered False 18:06:05.967927 run create_hlr_db(pid=404): Terminated: ok {rc=0} 18:06:06.393708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=406): Launched 18:06:06.691279 run osmo-hlr_10.42.42.2(pid=407): Launched 18:06:06.805268 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:07.313682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=409): Launched 18:06:07.610063 run osmo-stp_10.42.42.5(pid=410): Launched 18:06:07.730961 tst emergency_preemptive_call.py: using MSISDN 7830 18:06:07.881122 run osmo-msc_10.42.42.6: Starting osmo-msc 18:06:08.412847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=412): Launched 18:06:08.708850 run osmo-msc_10.42.42.6(pid=413): Launched 18:06:08.873986 run osmo-stp_10.42.42.5(pid=410): ERR: Terminated: ERROR {rc=1} [trial-2377↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=410)] 18:06:08.998674 run osmo-stp_10.42.42.5(pid=410): stdout: | (launched: 2022-12-10_18:06:07.554771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:09.123707 run osmo-stp_10.42.42.5(pid=410): stderr: | 20221210180607728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180607728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180607729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180607729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180607730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180607730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180607730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:09.247256 run osmo-stp_10.42.42.5(pid=410): stdout: | (launched: 2022-12-10_18:06:07.554771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:09.364540 run osmo-stp_10.42.42.5(pid=410): stderr: | 20221210180607728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180607728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180607729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180607729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180607730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180607730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180607730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:09.504921 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=410): Process ended prematurely: osmo-stp_10.42.42.5(pid=410) [trial-2377↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=410)] [trial-2377↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 18:06:09.513299 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 18:06:09.539615 run osmo-hlr_10.42.42.2(pid=407): ERR: Terminated: ERROR {rc=237} [trial-2377↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=407)] 18:06:09.586872 run osmo-hlr_10.42.42.2(pid=407): stdout: | (launched: 2022-12-10_18:06:06.636596) 18:06:09.636097 run osmo-hlr_10.42.42.2(pid=407): stderr: | 20221210180606811 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180606811 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180606811 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180606811 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180606811 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180606811 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180606822 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180606830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180606831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180606831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:09.704811 run osmo-msc_10.42.42.6(pid=413): ERR: Terminated: ERROR {rc=2} [trial-2377↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=413)] 18:06:09.752492 run osmo-msc_10.42.42.6(pid=413): stdout: | (launched: 2022-12-10_18:06:08.653802) 18:06:09.801482 run osmo-msc_10.42.42.6(pid=413): stderr: | 20221210180608923 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210180608924 DLGLOBAL DEBUG validating counter group 0x7fc64f3f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210180608925 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210180608925 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210180608925 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210180608925 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210180608927 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210180608927 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210180608928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210180608928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:06:09.850722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=406): Terminating (SIGTERM) 18:06:09.889858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=409): Terminating (SIGTERM) 18:06:09.929197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=412): Terminating (SIGTERM) 18:06:09.968735 --- ParallelTerminationStrategy: PID 406 died... 18:06:09.987771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=406): Terminated: ok {rc=0} 18:06:10.032091 --- ParallelTerminationStrategy: PID 409 died... 18:06:10.050918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=409): Terminated: ok {rc=0} 18:06:10.094531 --- ParallelTerminationStrategy: PID 412 died... 18:06:10.112904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=412): Terminated: ok {rc=0} 18:06:10.196346 bus /sierra_9: Setting Powered False 18:06:11.293427 bus /sierra_9: Setting Powered False 18:06:12.410267 bus /sierra_8: Setting Powered False 18:06:13.508298 bus /sierra_8: Setting Powered False 18:06:14.624208 bus /sierra_3: Setting Powered False 18:06:15.718847 bus /sierra_3: Setting Powered False 18:06:16.833877 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 18:06:18.103959 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:06:18.108239 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:06:18.137389 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 18:06:18.175643 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 18:06:18.262065 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:06:18.290876 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 18:06:18.328863 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 18:06:18.922035 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 18:06:18.971097 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:18.982072 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:06:19.027165 tst cs_paging_gprs_active.py: using LAC 29689 18:06:19.147807 tst cs_paging_gprs_active.py: using RAC 109 18:06:19.272711 tst cs_paging_gprs_active.py: using CellId 29689 18:06:19.390318 tst cs_paging_gprs_active.py: using BVCI 29690 18:06:19.499376 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:19.510172 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:19.520758 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:19.531281 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:19.541695 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:19.552005 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:19.562614 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:19.573452 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:19.584019 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:19.701315 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:19.818862 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:06:20.021722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:20.325171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=418): Launched 18:06:20.588453 run iperf3-srv_10.42.42.10(pid=419): Launched 18:06:20.702073 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:06:20.902696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:21.204374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=420): Launched 18:06:21.466890 run iperf3-srv_10.42.42.10(pid=421): Launched 18:06:21.581980 tst cs_paging_gprs_active.py:38: start network... 18:06:21.782605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:22.295333 run create_hlr_db(pid=422): Launched 18:06:22.419818 bus /sierra_2: Setting Powered False 18:06:23.484435 run create_hlr_db(pid=422): Terminated: ok {rc=0} 18:06:23.913754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=424): Launched 18:06:24.216374 run osmo-hlr_10.42.42.2(pid=425): Launched 18:06:24.331111 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:24.848528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=427): Launched 18:06:25.151951 run osmo-stp_10.42.42.5(pid=428): Launched 18:06:25.267298 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:06:25.786266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=430): Launched 18:06:25.901829 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:06:26.157229 run patchelf(pid=431): Launched 18:06:26.325469 run osmo-stp_10.42.42.5(pid=428): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=428)] 18:06:26.453630 run osmo-stp_10.42.42.5(pid=428): stdout: | (launched: 2022-12-10_18:06:25.095984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:26.582753 run osmo-stp_10.42.42.5(pid=428): stderr: | 20221210180625264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180625264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180625264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180625265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180625265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180625265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180625265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:26.712022 run osmo-stp_10.42.42.5(pid=428): stdout: | (launched: 2022-12-10_18:06:25.095984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:26.835928 run osmo-stp_10.42.42.5(pid=428): stderr: | 20221210180625264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180625264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180625264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180625265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180625265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180625265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180625265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:26.982766 run patchelf(pid=431): Terminating (SIGINT) 18:06:27.152320 run patchelf(pid=431): Terminated: ok {rc=0} 18:06:27.273954 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=428): Process ended prematurely: osmo-stp_10.42.42.5(pid=428) [trial-2377↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=428)] [trial-2377↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 18:06:27.283321 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 18:06:27.310589 run osmo-hlr_10.42.42.2(pid=425): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=425)] 18:06:27.357933 run osmo-hlr_10.42.42.2(pid=425): stdout: | (launched: 2022-12-10_18:06:24.160486) 18:06:27.406852 run osmo-hlr_10.42.42.2(pid=425): stderr: | 20221210180624335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180624335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180624335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180624335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180624335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180624335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180624347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180624356 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180624356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180624356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:27.456110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=418): Terminating (SIGTERM) 18:06:27.495806 run iperf3-srv_10.42.42.10(pid=419): Terminating (SIGTERM) 18:06:27.535566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=420): Terminating (SIGTERM) 18:06:27.575256 run iperf3-srv_10.42.42.10(pid=421): Terminating (SIGTERM) 18:06:27.614769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=424): Terminating (SIGTERM) 18:06:27.654463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=427): Terminating (SIGTERM) 18:06:27.693945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=430): Terminating (SIGTERM) 18:06:27.734126 --- ParallelTerminationStrategy: PID 418 died... 18:06:27.753376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=418): Terminated: ok {rc=0} 18:06:27.797774 --- ParallelTerminationStrategy: PID 419 died... 18:06:27.816594 run iperf3-srv_10.42.42.10(pid=419): Terminated {rc=256} 18:06:27.860565 --- ParallelTerminationStrategy: PID 420 died... 18:06:27.879388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=420): Terminated: ok {rc=0} 18:06:27.923514 --- ParallelTerminationStrategy: PID 421 died... 18:06:27.942354 run iperf3-srv_10.42.42.10(pid=421): Terminated {rc=256} 18:06:27.987172 --- ParallelTerminationStrategy: PID 424 died... 18:06:28.006092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=424): Terminated: ok {rc=0} 18:06:28.050495 --- ParallelTerminationStrategy: PID 427 died... 18:06:28.069537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=427): Terminated: ok {rc=0} 18:06:28.114193 --- ParallelTerminationStrategy: PID 430 died... 18:06:28.133282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=430): Terminated: ok {rc=0} 18:06:28.220091 bus /gobi_0: Setting Powered False 18:06:29.320710 bus /gobi_0: Setting Powered False 18:06:30.436471 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 18:06:31.618504 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:31.635489 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:06:31.699685 tst iperf3.py: using LAC 29690 18:06:31.872148 tst iperf3.py: using RAC 110 18:06:32.006281 tst iperf3.py: using CellId 29690 18:06:32.131080 tst iperf3.py: using BVCI 29691 18:06:32.257750 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:32.270508 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:32.282481 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:32.293720 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:32.304778 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:32.316067 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:32.327451 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:32.338626 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:32.350886 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:32.465622 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:06:32.669031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:32.972493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=432): Launched 18:06:33.236584 run iperf3-srv_10.42.42.10(pid=433): Launched 18:06:33.350895 tst iperf3.py:8: start network... 18:06:33.552350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:34.018380 run create_hlr_db(pid=434): Launched 18:06:34.143589 bus /gobi_6: Setting Powered False 18:06:35.203773 run create_hlr_db(pid=434): Terminated: ok {rc=0} 18:06:35.641703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=436): Launched 18:06:35.966141 run osmo-hlr_10.42.42.2(pid=437): Launched 18:06:36.089953 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:36.645699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=439): Launched 18:06:36.970053 run osmo-stp_10.42.42.5(pid=440): Launched 18:06:37.094889 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:06:37.651110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=442): Launched 18:06:37.776129 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:06:38.050131 run patchelf(pid=443): Launched 18:06:38.230896 run osmo-stp_10.42.42.5(pid=440): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=440)] 18:06:38.367467 run osmo-stp_10.42.42.5(pid=440): stdout: | (launched: 2022-12-10_18:06:36.911118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:38.505580 run osmo-stp_10.42.42.5(pid=440): stderr: | 20221210180637101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180637101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180637101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180637102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180637102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180637102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180637102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:38.643684 run osmo-stp_10.42.42.5(pid=440): stdout: | (launched: 2022-12-10_18:06:36.911118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:38.775382 run osmo-stp_10.42.42.5(pid=440): stderr: | 20221210180637101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180637101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180637101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180637102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180637102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180637102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180637102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:38.931584 run patchelf(pid=443): Terminating (SIGINT) 18:06:39.112340 run patchelf(pid=443): Terminated: ok {rc=0} 18:06:39.241934 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=440): Process ended prematurely: osmo-stp_10.42.42.5(pid=440) [trial-2377↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=440)] [trial-2377↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 18:06:39.251995 tst iperf3.py:8: Test FAILED (7.7 sec) 18:06:39.281421 run osmo-hlr_10.42.42.2(pid=437): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=437)] 18:06:39.331961 run osmo-hlr_10.42.42.2(pid=437): stdout: | (launched: 2022-12-10_18:06:35.907088) 18:06:39.384072 run osmo-hlr_10.42.42.2(pid=437): stderr: | 20221210180636104 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180636104 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180636104 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180636104 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180636105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180636105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180636117 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180636125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180636125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180636125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:39.436541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=432): Terminating (SIGTERM) 18:06:39.478896 run iperf3-srv_10.42.42.10(pid=433): Terminating (SIGTERM) 18:06:39.522314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=436): Terminating (SIGTERM) 18:06:39.564079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=439): Terminating (SIGTERM) 18:06:39.604046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=442): Terminating (SIGTERM) 18:06:39.644159 --- ParallelTerminationStrategy: PID 432 died... 18:06:39.663420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=432): Terminated: ok {rc=0} 18:06:39.707680 --- ParallelTerminationStrategy: PID 433 died... 18:06:39.726474 run iperf3-srv_10.42.42.10(pid=433): Terminated {rc=256} 18:06:39.770168 --- ParallelTerminationStrategy: PID 436 died... 18:06:39.788875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=436): Terminated: ok {rc=0} 18:06:39.833248 --- ParallelTerminationStrategy: PID 439 died... 18:06:39.852004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=439): Terminated: ok {rc=0} 18:06:39.895769 --- ParallelTerminationStrategy: PID 442 died... 18:06:39.914549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=442): Terminated: ok {rc=0} 18:06:40.000015 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 18:06:41.147763 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:41.159348 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:06:41.204931 tst iperf3m4.py: using LAC 29691 18:06:41.324777 tst iperf3m4.py: using RAC 111 18:06:41.445800 tst iperf3m4.py: using CellId 29691 18:06:41.573408 tst iperf3m4.py: using BVCI 29692 18:06:41.692806 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:41.704566 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:41.715718 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:41.727642 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:41.738667 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:41.751557 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:41.763657 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:41.775291 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:41.787170 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:41.902444 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:42.019658 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:42.137861 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:42.258474 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:06:42.460665 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:42.762999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=444): Launched 18:06:43.025765 run iperf3-srv_10.42.42.10(pid=445): Launched 18:06:43.138803 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:06:43.339425 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:43.641366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=446): Launched 18:06:43.904740 run iperf3-srv_10.42.42.10(pid=447): Launched 18:06:44.018253 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:06:44.219291 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:44.522752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=448): Launched 18:06:44.785127 run iperf3-srv_10.42.42.10(pid=449): Launched 18:06:44.898748 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:06:45.099842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:45.403122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=450): Launched 18:06:45.666716 run iperf3-srv_10.42.42.10(pid=451): Launched 18:06:45.782556 tst iperf3m4.py:8: start network... 18:06:46.010198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:46.494994 run create_hlr_db(pid=452): Launched 18:06:46.634034 bus /gobi_6: Setting Powered False 18:06:47.698002 run create_hlr_db(pid=452): Terminated: ok {rc=0} 18:06:48.179866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=454): Launched 18:06:48.506368 run osmo-hlr_10.42.42.2(pid=455): Launched 18:06:48.631872 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:49.287715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=457): Launched 18:06:49.602286 run osmo-stp_10.42.42.5(pid=458): Launched 18:06:49.723228 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:06:50.265404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=460): Launched 18:06:50.386466 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:06:50.653270 run patchelf(pid=461): Launched 18:06:50.828894 run osmo-stp_10.42.42.5(pid=458): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=458)] 18:06:50.962503 run osmo-stp_10.42.42.5(pid=458): stdout: | (launched: 2022-12-10_18:06:49.544849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:51.097476 run osmo-stp_10.42.42.5(pid=458): stderr: | 20221210180649733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180649733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180649733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180649734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180649734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180649734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180649734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:51.232835 run osmo-stp_10.42.42.5(pid=458): stdout: | (launched: 2022-12-10_18:06:49.544849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:51.362281 run osmo-stp_10.42.42.5(pid=458): stderr: | 20221210180649733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180649733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180649733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180649734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180649734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180649734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180649734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:51.515682 run patchelf(pid=461): Terminating (SIGINT) 18:06:51.692468 run patchelf(pid=461): Terminated: ok {rc=0} 18:06:51.819950 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=458): Process ended prematurely: osmo-stp_10.42.42.5(pid=458) [trial-2377↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=458)] [trial-2377↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 18:06:51.830185 tst iperf3m4.py:8: Test FAILED (10.7 sec) 18:06:51.859653 run osmo-hlr_10.42.42.2(pid=455): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=455)] 18:06:51.909737 run osmo-hlr_10.42.42.2(pid=455): stdout: | (launched: 2022-12-10_18:06:48.447338) 18:06:51.961376 run osmo-hlr_10.42.42.2(pid=455): stderr: | 20221210180648640 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180648640 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180648640 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180648640 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180648640 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180648640 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180648654 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180648663 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180648663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180648663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:52.013431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=444): Terminating (SIGTERM) 18:06:52.055062 run iperf3-srv_10.42.42.10(pid=445): Terminating (SIGTERM) 18:06:52.096803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=446): Terminating (SIGTERM) 18:06:52.138896 run iperf3-srv_10.42.42.10(pid=447): Terminating (SIGTERM) 18:06:52.180669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=448): Terminating (SIGTERM) 18:06:52.222041 run iperf3-srv_10.42.42.10(pid=449): Terminating (SIGTERM) 18:06:52.263951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=450): Terminating (SIGTERM) 18:06:52.305864 run iperf3-srv_10.42.42.10(pid=451): Terminating (SIGTERM) 18:06:52.347744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=454): Terminating (SIGTERM) 18:06:52.389841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=457): Terminating (SIGTERM) 18:06:52.431383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=460): Terminating (SIGTERM) 18:06:52.473502 --- ParallelTerminationStrategy: PID 444 died... 18:06:52.493464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=444): Terminated: ok {rc=0} 18:06:52.539770 --- ParallelTerminationStrategy: PID 445 died... 18:06:52.559641 run iperf3-srv_10.42.42.10(pid=445): Terminated {rc=256} 18:06:52.606127 --- ParallelTerminationStrategy: PID 446 died... 18:06:52.625738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=446): Terminated: ok {rc=0} 18:06:52.672097 --- ParallelTerminationStrategy: PID 447 died... 18:06:52.691415 run iperf3-srv_10.42.42.10(pid=447): Terminated {rc=256} 18:06:52.737798 --- ParallelTerminationStrategy: PID 448 died... 18:06:52.757506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=448): Terminated: ok {rc=0} 18:06:52.803653 --- ParallelTerminationStrategy: PID 449 died... 18:06:52.823200 run iperf3-srv_10.42.42.10(pid=449): Terminated {rc=256} 18:06:52.869595 --- ParallelTerminationStrategy: PID 450 died... 18:06:52.889182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=450): Terminated: ok {rc=0} 18:06:52.935489 --- ParallelTerminationStrategy: PID 451 died... 18:06:52.955113 run iperf3-srv_10.42.42.10(pid=451): Terminated {rc=256} 18:06:53.001588 --- ParallelTerminationStrategy: PID 454 died... 18:06:53.021247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=454): Terminated: ok {rc=0} 18:06:53.067626 --- ParallelTerminationStrategy: PID 457 died... 18:06:53.087095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=457): Terminated: ok {rc=0} 18:06:53.133815 --- ParallelTerminationStrategy: PID 460 died... 18:06:53.153402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=460): Terminated: ok {rc=0} 18:06:53.241175 bus /gobi_4: Setting Powered False 18:06:54.338589 bus /gobi_4: Setting Powered False 18:06:55.457555 bus /gobi_1: Setting Powered False 18:06:56.554914 bus /gobi_1: Setting Powered False 18:06:57.669252 bus /gobi_0: Setting Powered False 18:06:58.764647 bus /gobi_0: Setting Powered False 18:06:59.878763 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 18:07:00.984063 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:00.998146 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:07:01.054259 tst ping.py: using LAC 29692 18:07:01.183529 tst ping.py: using RAC 112 18:07:01.307322 tst ping.py: using CellId 29692 18:07:01.447797 tst ping.py: using BVCI 29693 18:07:01.556631 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:01.567979 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:01.579404 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:01.590838 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:01.602345 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:01.614216 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:01.626797 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:01.639318 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:07:01.760016 tst ping.py:19: start network... 18:07:02.006442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:02.489113 run create_hlr_db(pid=462): Launched 18:07:02.608169 bus /gobi_6: Setting Powered False 18:07:03.670152 run create_hlr_db(pid=462): Terminated: ok {rc=0} 18:07:04.085548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=464): Launched 18:07:04.377070 run osmo-hlr_10.42.42.2(pid=465): Launched 18:07:04.488928 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:04.992154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=467): Launched 18:07:05.283367 run osmo-stp_10.42.42.5(pid=468): Launched 18:07:05.395042 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:05.897621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=470): Launched 18:07:06.008941 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:06.255439 run patchelf(pid=471): Launched 18:07:06.417998 run osmo-stp_10.42.42.5(pid=468): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=468)] 18:07:06.542658 run osmo-stp_10.42.42.5(pid=468): stdout: | (launched: 2022-12-10_18:07:05.229691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:06.667375 run osmo-stp_10.42.42.5(pid=468): stderr: | 20221210180705397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180705398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180705398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180705398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180705399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180705399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180705399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:06.792189 run osmo-stp_10.42.42.5(pid=468): stdout: | (launched: 2022-12-10_18:07:05.229691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:06.911431 run osmo-stp_10.42.42.5(pid=468): stderr: | 20221210180705397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180705398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180705398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180705398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180705399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180705399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180705399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:07.052910 run patchelf(pid=471): Terminating (SIGINT) 18:07:07.216195 run patchelf(pid=471): Terminated: ok {rc=0} 18:07:07.334339 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=468): Process ended prematurely: osmo-stp_10.42.42.5(pid=468) [trial-2377↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=468)] [trial-2377↪gprs:trx-lms-limenet-micro↪ping.py:22] 18:07:07.343359 tst ping.py:22: Test FAILED (6.4 sec) 18:07:07.369513 run osmo-hlr_10.42.42.2(pid=465): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=465)] 18:07:07.416539 run osmo-hlr_10.42.42.2(pid=465): stdout: | (launched: 2022-12-10_18:07:04.323151) 18:07:07.465494 run osmo-hlr_10.42.42.2(pid=465): stderr: | 20221210180704497 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180704497 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180704497 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180704497 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180704497 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180704497 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180704509 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180704518 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180704519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180704519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:07.514960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=464): Terminating (SIGTERM) 18:07:07.554106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=467): Terminating (SIGTERM) 18:07:07.593416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=470): Terminating (SIGTERM) 18:07:07.633296 --- ParallelTerminationStrategy: PID 464 died... 18:07:07.652186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=464): Terminated: ok {rc=0} 18:07:07.695768 --- ParallelTerminationStrategy: PID 467 died... 18:07:07.714297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=467): Terminated: ok {rc=0} 18:07:07.757764 --- ParallelTerminationStrategy: PID 470 died... 18:07:07.776066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=470): Terminated: ok {rc=0} 18:07:07.861526 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 18:07:08.950380 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:08.962262 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:07:09.008604 tst ping_idle_ping.py: using LAC 29693 18:07:09.129570 tst ping_idle_ping.py: using RAC 113 18:07:09.244330 tst ping_idle_ping.py: using CellId 29693 18:07:09.357103 tst ping_idle_ping.py: using BVCI 29694 18:07:09.462477 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:09.473260 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:09.483780 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:09.494286 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:09.504639 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:09.515148 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:09.525884 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:09.536343 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:07:09.651742 tst ping_idle_ping.py:24: start network... 18:07:09.861013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:10.345219 run create_hlr_db(pid=472): Launched 18:07:10.465068 bus /gobi_6: Setting Powered False 18:07:11.523013 run create_hlr_db(pid=472): Terminated: ok {rc=0} 18:07:11.958356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=474): Launched 18:07:12.270628 run osmo-hlr_10.42.42.2(pid=475): Launched 18:07:12.390230 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:12.929431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=477): Launched 18:07:13.241605 run osmo-stp_10.42.42.5(pid=478): Launched 18:07:13.362291 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:13.900155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=480): Launched 18:07:14.019845 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:14.283752 run patchelf(pid=481): Launched 18:07:14.457353 run osmo-stp_10.42.42.5(pid=478): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=478)] 18:07:14.590233 run osmo-stp_10.42.42.5(pid=478): stdout: | (launched: 2022-12-10_18:07:13.184435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:14.724188 run osmo-stp_10.42.42.5(pid=478): stderr: | 20221210180713375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180713375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180713375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180713375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180713376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180713376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180713376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:14.858453 run osmo-stp_10.42.42.5(pid=478): stdout: | (launched: 2022-12-10_18:07:13.184435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:14.986715 run osmo-stp_10.42.42.5(pid=478): stderr: | 20221210180713375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180713375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180713375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180713375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180713376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180713376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180713376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:15.138511 run patchelf(pid=481): Terminating (SIGINT) 18:07:15.312592 run patchelf(pid=481): Terminated: ok {rc=0} 18:07:15.438237 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=478): Process ended prematurely: osmo-stp_10.42.42.5(pid=478) [trial-2377↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=478)] [trial-2377↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 18:07:15.447713 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:07:15.476174 run osmo-hlr_10.42.42.2(pid=475): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=475)] 18:07:15.526118 run osmo-hlr_10.42.42.2(pid=475): stdout: | (launched: 2022-12-10_18:07:12.213272) 18:07:15.578034 run osmo-hlr_10.42.42.2(pid=475): stderr: | 20221210180712410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180712410 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180712410 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180712410 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180712410 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180712410 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180712427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180712437 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180712437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180712437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:15.630375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=474): Terminating (SIGTERM) 18:07:15.672480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=477): Terminating (SIGTERM) 18:07:15.714493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=480): Terminating (SIGTERM) 18:07:15.756902 --- ParallelTerminationStrategy: PID 474 died... 18:07:15.776907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=474): Terminated: ok {rc=0} 18:07:15.823602 --- ParallelTerminationStrategy: PID 477 died... 18:07:15.843671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=477): Terminated: ok {rc=0} 18:07:15.905663 --- ParallelTerminationStrategy: PID 480 died... 18:07:15.938543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=480): Terminated: ok {rc=0} 18:07:16.025649 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 18:07:17.323652 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:07:17.330820 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:07:17.360209 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:07:17.398470 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:07:17.487982 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:07:17.516477 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:07:17.555459 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:07:18.147007 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:07:18.200214 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:18.211941 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:07:18.258949 tst cs_paging_gprs_active.py: using LAC 29694 18:07:18.383741 tst cs_paging_gprs_active.py: using RAC 114 18:07:18.500679 tst cs_paging_gprs_active.py: using CellId 29694 18:07:18.616747 tst cs_paging_gprs_active.py: using BVCI 29695 18:07:18.732719 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:18.744289 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:18.755712 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:18.767389 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:18.778903 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:18.790618 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:18.802632 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:18.814198 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:18.825883 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:07:18.942054 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:07:19.056299 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:07:19.255628 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:19.554571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=485): Launched 18:07:19.814061 run iperf3-srv_10.42.42.10(pid=486): Launched 18:07:19.927806 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:07:20.125449 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:20.423801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=487): Launched 18:07:20.684932 run iperf3-srv_10.42.42.10(pid=488): Launched 18:07:20.796701 tst cs_paging_gprs_active.py:38: start network... 18:07:20.994790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:21.457389 run create_hlr_db(pid=489): Launched 18:07:21.581145 bus /gobi_6: Setting Powered False 18:07:22.641225 run create_hlr_db(pid=489): Terminated: ok {rc=0} 18:07:23.075667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=491): Launched 18:07:23.394626 run osmo-hlr_10.42.42.2(pid=492): Launched 18:07:23.518534 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:24.065053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=494): Launched 18:07:24.383975 run osmo-stp_10.42.42.5(pid=495): Launched 18:07:24.505710 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:25.056587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=497): Launched 18:07:25.179152 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:25.448503 run patchelf(pid=498): Launched 18:07:25.625765 run osmo-stp_10.42.42.5(pid=495): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=495)] 18:07:25.760245 run osmo-stp_10.42.42.5(pid=495): stdout: | (launched: 2022-12-10_18:07:24.325151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:25.895797 run osmo-stp_10.42.42.5(pid=495): stderr: | 20221210180724515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180724515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180724515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180724515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180724516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180724516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180724516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:26.031858 run osmo-stp_10.42.42.5(pid=495): stdout: | (launched: 2022-12-10_18:07:24.325151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:26.163101 run osmo-stp_10.42.42.5(pid=495): stderr: | 20221210180724515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180724515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180724515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180724515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180724516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180724516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180724516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:26.318093 run patchelf(pid=498): Terminating (SIGINT) 18:07:26.495469 run patchelf(pid=498): Terminated: ok {rc=0} 18:07:26.623821 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=495): Process ended prematurely: osmo-stp_10.42.42.5(pid=495) [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=495)] [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:07:26.634031 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:07:26.663414 run osmo-hlr_10.42.42.2(pid=492): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=492)] 18:07:26.713923 run osmo-hlr_10.42.42.2(pid=492): stdout: | (launched: 2022-12-10_18:07:23.336321) 18:07:26.766219 run osmo-hlr_10.42.42.2(pid=492): stderr: | 20221210180723533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180723533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180723533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180723533 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180723533 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180723533 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180723545 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180723553 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180723553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180723553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:26.819045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=485): Terminating (SIGTERM) 18:07:26.861294 run iperf3-srv_10.42.42.10(pid=486): Terminating (SIGTERM) 18:07:26.903586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=487): Terminating (SIGTERM) 18:07:26.945757 run iperf3-srv_10.42.42.10(pid=488): Terminating (SIGTERM) 18:07:26.987926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=491): Terminating (SIGTERM) 18:07:27.030234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=494): Terminating (SIGTERM) 18:07:27.072156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=497): Terminating (SIGTERM) 18:07:27.114616 --- ParallelTerminationStrategy: PID 485 died... 18:07:27.134876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=485): Terminated: ok {rc=0} 18:07:27.181745 --- ParallelTerminationStrategy: PID 486 died... 18:07:27.201323 run iperf3-srv_10.42.42.10(pid=486): Terminated {rc=256} 18:07:27.247764 --- ParallelTerminationStrategy: PID 487 died... 18:07:27.267449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=487): Terminated: ok {rc=0} 18:07:27.314124 --- ParallelTerminationStrategy: PID 488 died... 18:07:27.333647 run iperf3-srv_10.42.42.10(pid=488): Terminated {rc=256} 18:07:27.380101 --- ParallelTerminationStrategy: PID 491 died... 18:07:27.399551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=491): Terminated: ok {rc=0} 18:07:27.446153 --- ParallelTerminationStrategy: PID 494 died... 18:07:27.465828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=494): Terminated: ok {rc=0} 18:07:27.512436 --- ParallelTerminationStrategy: PID 497 died... 18:07:27.531990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=497): Terminated: ok {rc=0} 18:07:27.620863 bus /gobi_0: Setting Powered False 18:07:28.720463 bus /gobi_0: Setting Powered False 18:07:29.836794 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:07:30.996351 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:31.009450 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:07:31.060665 tst iperf3.py: using LAC 29695 18:07:31.180041 tst iperf3.py: using RAC 115 18:07:31.307314 tst iperf3.py: using CellId 29695 18:07:31.433458 tst iperf3.py: using BVCI 29696 18:07:31.588285 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:31.604800 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:31.622162 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:31.638689 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:31.656373 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:31.672593 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:31.685121 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:31.700161 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:31.712888 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:07:31.833232 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:07:32.052819 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:32.375203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=499): Launched 18:07:32.653894 run iperf3-srv_10.42.42.10(pid=500): Launched 18:07:32.775262 tst iperf3.py:8: start network... 18:07:32.988099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:33.478080 run create_hlr_db(pid=501): Launched 18:07:33.601950 bus /gobi_6: Setting Powered False 18:07:34.664636 run create_hlr_db(pid=501): Terminated: ok {rc=0} 18:07:35.105477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=503): Launched 18:07:35.424270 run osmo-hlr_10.42.42.2(pid=504): Launched 18:07:35.545492 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:36.094307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=508): Launched 18:07:36.390769 run osmo-stp_10.42.42.5(pid=509): Launched 18:07:36.503252 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:37.014713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=511): Launched 18:07:37.127377 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:37.377861 run patchelf(pid=512): Launched 18:07:37.542965 run osmo-stp_10.42.42.5(pid=509): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=509)] 18:07:37.668237 run osmo-stp_10.42.42.5(pid=509): stdout: | (launched: 2022-12-10_18:07:36.335359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:37.795129 run osmo-stp_10.42.42.5(pid=509): stderr: | 20221210180736506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180736506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180736506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180736506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180736507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180736507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180736507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:37.921878 run osmo-stp_10.42.42.5(pid=509): stdout: | (launched: 2022-12-10_18:07:36.335359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:38.043673 run osmo-stp_10.42.42.5(pid=509): stderr: | 20221210180736506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180736506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180736506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180736506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180736507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180736507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180736507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:38.187191 run patchelf(pid=512): Terminating (SIGINT) 18:07:38.353122 run patchelf(pid=512): Terminated: ok {rc=0} 18:07:38.472353 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=509): Process ended prematurely: osmo-stp_10.42.42.5(pid=509) [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=509)] [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 18:07:38.481712 tst iperf3.py:8: Test FAILED (7.5 sec) 18:07:38.508272 run osmo-hlr_10.42.42.2(pid=504): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=504)] 18:07:38.555075 run osmo-hlr_10.42.42.2(pid=504): stdout: | (launched: 2022-12-10_18:07:35.365619) 18:07:38.603621 run osmo-hlr_10.42.42.2(pid=504): stderr: | 20221210180735563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180735563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180735563 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180735563 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180735563 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180735563 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180735579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180735589 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180735589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180735590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:38.652602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=499): Terminating (SIGTERM) 18:07:38.691669 run iperf3-srv_10.42.42.10(pid=500): Terminating (SIGTERM) 18:07:38.731372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=503): Terminating (SIGTERM) 18:07:38.770553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=508): Terminating (SIGTERM) 18:07:38.809877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=511): Terminating (SIGTERM) 18:07:38.849289 --- ParallelTerminationStrategy: PID 499 died... 18:07:38.867935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=499): Terminated: ok {rc=0} 18:07:38.911092 --- ParallelTerminationStrategy: PID 500 died... 18:07:38.929517 run iperf3-srv_10.42.42.10(pid=500): Terminated {rc=256} 18:07:38.972518 --- ParallelTerminationStrategy: PID 503 died... 18:07:38.990817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=503): Terminated: ok {rc=0} 18:07:39.034389 --- ParallelTerminationStrategy: PID 508 died... 18:07:39.052559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=508): Terminated: ok {rc=0} 18:07:39.096388 --- ParallelTerminationStrategy: PID 511 died... 18:07:39.114815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=511): Terminated: ok {rc=0} 18:07:39.199630 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:07:40.345347 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:40.356739 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:07:40.404128 tst iperf3m4.py: using LAC 29696 18:07:40.520579 tst iperf3m4.py: using RAC 116 18:07:40.646605 tst iperf3m4.py: using CellId 29696 18:07:40.771758 tst iperf3m4.py: using BVCI 29697 18:07:40.879684 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:40.890975 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:40.902047 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:40.912907 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:40.923919 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:40.934956 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:40.946076 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:40.956751 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:40.967925 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:07:41.088494 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:07:41.208335 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:07:41.324320 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:07:41.439187 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:07:41.637664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:41.936630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=513): Launched 18:07:42.195569 run iperf3-srv_10.42.42.10(pid=514): Launched 18:07:42.307237 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:07:42.505484 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:42.803855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=515): Launched 18:07:43.063285 run iperf3-srv_10.42.42.10(pid=516): Launched 18:07:43.175189 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:07:43.372494 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:43.670102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=517): Launched 18:07:43.928805 run iperf3-srv_10.42.42.10(pid=518): Launched 18:07:44.040152 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:07:44.238072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:44.535858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=519): Launched 18:07:44.795457 run iperf3-srv_10.42.42.10(pid=520): Launched 18:07:44.906768 tst iperf3m4.py:8: start network... 18:07:45.104251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:45.564650 run create_hlr_db(pid=521): Launched 18:07:45.688590 bus /gobi_6: Setting Powered False 18:07:46.757144 run create_hlr_db(pid=521): Terminated: ok {rc=0} 18:07:47.213975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=523): Launched 18:07:47.532929 run osmo-hlr_10.42.42.2(pid=524): Launched 18:07:47.654351 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:48.204786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=526): Launched 18:07:48.523735 run osmo-stp_10.42.42.5(pid=527): Launched 18:07:48.644159 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:49.191002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=529): Launched 18:07:49.312280 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:49.580753 run patchelf(pid=530): Launched 18:07:49.756916 run osmo-stp_10.42.42.5(pid=527): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=527)] 18:07:49.891611 run osmo-stp_10.42.42.5(pid=527): stdout: | (launched: 2022-12-10_18:07:48.465539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:50.028029 run osmo-stp_10.42.42.5(pid=527): stderr: | 20221210180748652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180748652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180748653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180748653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180748654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180748654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180748654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:50.164822 run osmo-stp_10.42.42.5(pid=527): stdout: | (launched: 2022-12-10_18:07:48.465539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:50.295223 run osmo-stp_10.42.42.5(pid=527): stderr: | 20221210180748652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180748652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180748653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180748653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180748654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180748654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180748654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:50.449579 run patchelf(pid=530): Terminating (SIGINT) 18:07:50.627045 run patchelf(pid=530): Terminated: ok {rc=0} 18:07:50.755106 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=527): Process ended prematurely: osmo-stp_10.42.42.5(pid=527) [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=527)] [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 18:07:50.765512 tst iperf3m4.py:8: Test FAILED (10.5 sec) 18:07:50.794807 run osmo-hlr_10.42.42.2(pid=524): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=524)] 18:07:50.844856 run osmo-hlr_10.42.42.2(pid=524): stdout: | (launched: 2022-12-10_18:07:47.474082) 18:07:50.896771 run osmo-hlr_10.42.42.2(pid=524): stderr: | 20221210180747668 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180747668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180747668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180747668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180747668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180747668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180747681 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180747691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180747691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180747691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:50.949179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=513): Terminating (SIGTERM) 18:07:50.990948 run iperf3-srv_10.42.42.10(pid=514): Terminating (SIGTERM) 18:07:51.032708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=515): Terminating (SIGTERM) 18:07:51.075159 run iperf3-srv_10.42.42.10(pid=516): Terminating (SIGTERM) 18:07:51.117129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=517): Terminating (SIGTERM) 18:07:51.159235 run iperf3-srv_10.42.42.10(pid=518): Terminating (SIGTERM) 18:07:51.201054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=519): Terminating (SIGTERM) 18:07:51.242686 run iperf3-srv_10.42.42.10(pid=520): Terminating (SIGTERM) 18:07:51.284447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=523): Terminating (SIGTERM) 18:07:51.326549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=526): Terminating (SIGTERM) 18:07:51.368148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=529): Terminating (SIGTERM) 18:07:51.409977 --- ParallelTerminationStrategy: PID 513 died... 18:07:51.429735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=513): Terminated: ok {rc=0} 18:07:51.476252 --- ParallelTerminationStrategy: PID 514 died... 18:07:51.495941 run iperf3-srv_10.42.42.10(pid=514): Terminated {rc=256} 18:07:51.542073 --- ParallelTerminationStrategy: PID 515 died... 18:07:51.561471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=515): Terminated: ok {rc=0} 18:07:51.607693 --- ParallelTerminationStrategy: PID 516 died... 18:07:51.627045 run iperf3-srv_10.42.42.10(pid=516): Terminated {rc=256} 18:07:51.673338 --- ParallelTerminationStrategy: PID 517 died... 18:07:51.692678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=517): Terminated: ok {rc=0} 18:07:51.739072 --- ParallelTerminationStrategy: PID 518 died... 18:07:51.758453 run iperf3-srv_10.42.42.10(pid=518): Terminated {rc=256} 18:07:51.804732 --- ParallelTerminationStrategy: PID 519 died... 18:07:51.824257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=519): Terminated: ok {rc=0} 18:07:51.870671 --- ParallelTerminationStrategy: PID 520 died... 18:07:51.890077 run iperf3-srv_10.42.42.10(pid=520): Terminated {rc=256} 18:07:51.936104 --- ParallelTerminationStrategy: PID 523 died... 18:07:51.955509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=523): Terminated: ok {rc=0} 18:07:52.001854 --- ParallelTerminationStrategy: PID 526 died... 18:07:52.021357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=526): Terminated: ok {rc=0} 18:07:52.067790 --- ParallelTerminationStrategy: PID 529 died... 18:07:52.087491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=529): Terminated: ok {rc=0} 18:07:52.175343 bus /gobi_4: Setting Powered False 18:07:53.273515 bus /gobi_4: Setting Powered False 18:07:54.389510 bus /gobi_1: Setting Powered False 18:07:55.484085 bus /gobi_1: Setting Powered False 18:07:56.598000 bus /gobi_0: Setting Powered False 18:07:57.698702 bus /gobi_0: Setting Powered False 18:07:58.818061 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 18:07:59.922824 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.934843 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:07:59.983543 tst ping.py: using LAC 29697 18:08:00.108460 tst ping.py: using RAC 117 18:08:00.230663 tst ping.py: using CellId 29697 18:08:00.352193 tst ping.py: using BVCI 29698 18:08:00.464308 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:00.475801 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:00.487089 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:00.498606 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:00.510089 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:00.521362 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:00.533806 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:00.545449 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:08:00.660664 tst ping.py:19: start network... 18:08:00.858451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:01.324109 run create_hlr_db(pid=531): Launched 18:08:01.480436 bus /gobi_6: Setting Powered False 18:08:02.542393 run create_hlr_db(pid=531): Terminated: ok {rc=0} 18:08:02.961388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=533): Launched 18:08:03.253251 run osmo-hlr_10.42.42.2(pid=534): Launched 18:08:03.364024 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:03.868578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=536): Launched 18:08:04.159735 run osmo-stp_10.42.42.5(pid=537): Launched 18:08:04.270375 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:04.774824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=539): Launched 18:08:04.886673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:05.134698 run patchelf(pid=540): Launched 18:08:05.296829 run osmo-stp_10.42.42.5(pid=537): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=537)] 18:08:05.420362 run osmo-stp_10.42.42.5(pid=537): stdout: | (launched: 2022-12-10_18:08:04.105747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:05.545142 run osmo-stp_10.42.42.5(pid=537): stderr: | 20221210180804275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180804275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180804276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180804276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180804277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180804277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180804277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:05.670255 run osmo-stp_10.42.42.5(pid=537): stdout: | (launched: 2022-12-10_18:08:04.105747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:05.789691 run osmo-stp_10.42.42.5(pid=537): stderr: | 20221210180804275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180804275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180804276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180804276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180804277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180804277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180804277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:05.931108 run patchelf(pid=540): Terminating (SIGINT) 18:08:06.094311 run patchelf(pid=540): Terminated: ok {rc=0} 18:08:06.211917 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=537): Process ended prematurely: osmo-stp_10.42.42.5(pid=537) [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=537)] [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 18:08:06.220677 tst ping.py:22: Test FAILED (6.3 sec) 18:08:06.247245 run osmo-hlr_10.42.42.2(pid=534): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=534)] 18:08:06.294306 run osmo-hlr_10.42.42.2(pid=534): stdout: | (launched: 2022-12-10_18:08:03.199086) 18:08:06.342950 run osmo-hlr_10.42.42.2(pid=534): stderr: | 20221210180803374 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180803374 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180803374 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180803374 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180803374 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180803375 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180803387 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180803397 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180803398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180803398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:06.392326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=533): Terminating (SIGTERM) 18:08:06.431641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=536): Terminating (SIGTERM) 18:08:06.470752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=539): Terminating (SIGTERM) 18:08:06.510282 --- ParallelTerminationStrategy: PID 533 died... 18:08:06.529171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=533): Terminated: ok {rc=0} 18:08:06.572776 --- ParallelTerminationStrategy: PID 536 died... 18:08:06.591286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=536): Terminated: ok {rc=0} 18:08:06.634856 --- ParallelTerminationStrategy: PID 539 died... 18:08:06.653367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=539): Terminated: ok {rc=0} 18:08:06.738487 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:08:07.826614 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:07.838716 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:08:07.886563 tst ping_idle_ping.py: using LAC 29698 18:08:08.003099 tst ping_idle_ping.py: using RAC 118 18:08:08.118440 tst ping_idle_ping.py: using CellId 29698 18:08:08.234976 tst ping_idle_ping.py: using BVCI 29699 18:08:08.351521 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:08.363226 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:08.374638 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:08.386838 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:08.398801 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:08.410988 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:08.423276 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:08.435406 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:08:08.555384 tst ping_idle_ping.py:24: start network... 18:08:08.765034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:09.251969 run create_hlr_db(pid=541): Launched 18:08:09.371438 bus /gobi_6: Setting Powered False 18:08:10.433629 run create_hlr_db(pid=541): Terminated: ok {rc=0} 18:08:10.852842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=543): Launched 18:08:11.147595 run osmo-hlr_10.42.42.2(pid=544): Launched 18:08:11.258916 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:11.761682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=546): Launched 18:08:12.054350 run osmo-stp_10.42.42.5(pid=547): Launched 18:08:12.166184 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:12.671428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=549): Launched 18:08:12.783098 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:13.031508 run patchelf(pid=550): Launched 18:08:13.195228 run osmo-stp_10.42.42.5(pid=547): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=547)] 18:08:13.319785 run osmo-stp_10.42.42.5(pid=547): stdout: | (launched: 2022-12-10_18:08:11.999867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:13.445332 run osmo-stp_10.42.42.5(pid=547): stderr: | 20221210180812169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180812169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180812170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180812170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180812170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180812171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180812171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:13.571220 run osmo-stp_10.42.42.5(pid=547): stdout: | (launched: 2022-12-10_18:08:11.999867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:13.691574 run osmo-stp_10.42.42.5(pid=547): stderr: | 20221210180812169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180812169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180812170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180812170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180812170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180812171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180812171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:13.834231 run patchelf(pid=550): Terminating (SIGINT) 18:08:13.998376 run patchelf(pid=550): Terminated: ok {rc=0} 18:08:14.116699 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=547): Process ended prematurely: osmo-stp_10.42.42.5(pid=547) [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=547)] [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 18:08:14.125778 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 18:08:14.152407 run osmo-hlr_10.42.42.2(pid=544): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=544)] 18:08:14.199549 run osmo-hlr_10.42.42.2(pid=544): stdout: | (launched: 2022-12-10_18:08:11.092274) 18:08:14.248195 run osmo-hlr_10.42.42.2(pid=544): stderr: | 20221210180811270 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180811270 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180811270 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180811270 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180811270 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180811270 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180811285 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180811295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180811295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180811295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:14.297303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=543): Terminating (SIGTERM) 18:08:14.336688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=546): Terminating (SIGTERM) 18:08:14.375962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=549): Terminating (SIGTERM) 18:08:14.415588 --- ParallelTerminationStrategy: PID 543 died... 18:08:14.434493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=543): Terminated: ok {rc=0} 18:08:14.477883 --- ParallelTerminationStrategy: PID 546 died... 18:08:14.496535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=546): Terminated: ok {rc=0} 18:08:14.539994 --- ParallelTerminationStrategy: PID 549 died... 18:08:14.558397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=549): Terminated: ok {rc=0} 18:08:14.641233 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:08:15.941346 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:08:15.949864 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:08:15.979644 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:08:16.018334 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:08:16.106296 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:08:16.172625 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:08:16.226170 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:08:16.798894 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:08:16.859205 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:16.879255 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:08:16.958891 tst cs_paging_gprs_active.py: using LAC 29699 18:08:17.099147 tst cs_paging_gprs_active.py: using RAC 119 18:08:17.264550 tst cs_paging_gprs_active.py: using CellId 29699 18:08:17.398440 tst cs_paging_gprs_active.py: using BVCI 29700 18:08:17.528218 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:17.540922 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:17.552893 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:17.573949 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:17.586060 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:17.602486 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:17.615969 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:17.635517 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:17.652794 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:08:17.782268 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:08:17.932489 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:08:18.162266 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:18.530240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=659): Launched 18:08:18.863888 run iperf3-srv_10.42.42.10(pid=704): Launched 18:08:19.030431 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:08:19.280511 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:19.671181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=805): Launched 18:08:19.989700 run iperf3-srv_10.42.42.10(pid=828): Launched 18:08:20.128458 tst cs_paging_gprs_active.py:38: start network... 18:08:20.331367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:20.811475 run create_hlr_db(pid=833): Launched 18:08:20.972682 bus /gobi_6: Setting Powered False 18:08:22.032681 run create_hlr_db(pid=833): Terminated: ok {rc=0} 18:08:22.465153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=837): Launched 18:08:22.790269 run osmo-hlr_10.42.42.2(pid=838): Launched 18:08:23.029626 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:23.735436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=840): Launched 18:08:24.055190 run osmo-stp_10.42.42.5(pid=841): Launched 18:08:24.289180 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:24.964588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=844): Launched 18:08:25.095843 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:25.359041 run patchelf(pid=845): Launched 18:08:25.546541 run osmo-stp_10.42.42.5(pid=841): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=841)] 18:08:25.678950 run osmo-stp_10.42.42.5(pid=841): stdout: | (launched: 2022-12-10_18:08:23.997327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:25.811056 run osmo-stp_10.42.42.5(pid=841): stderr: | 20221210180824325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180824326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180824326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180824326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180824327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180824327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180824327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:25.944644 run osmo-stp_10.42.42.5(pid=841): stdout: | (launched: 2022-12-10_18:08:23.997327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:26.072160 run osmo-stp_10.42.42.5(pid=841): stderr: | 20221210180824325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180824326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180824326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180824326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180824327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180824327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180824327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:26.223147 run patchelf(pid=845): Terminating (SIGINT) 18:08:26.396147 run patchelf(pid=845): Terminated: ok {rc=0} 18:08:26.521758 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=841): Process ended prematurely: osmo-stp_10.42.42.5(pid=841) [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=841)] [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:08:26.531762 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 18:08:26.560293 run osmo-hlr_10.42.42.2(pid=838): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=838)] 18:08:26.609970 run osmo-hlr_10.42.42.2(pid=838): stdout: | (launched: 2022-12-10_18:08:22.727078) 18:08:26.662065 run osmo-hlr_10.42.42.2(pid=838): stderr: | 20221210180823067 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180823067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180823067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180823067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180823067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180823067 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180823087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180823095 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180823096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180823096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:26.713363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=659): Terminating (SIGTERM) 18:08:26.754572 run iperf3-srv_10.42.42.10(pid=704): Terminating (SIGTERM) 18:08:26.798875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=805): Terminating (SIGTERM) 18:08:26.840893 run iperf3-srv_10.42.42.10(pid=828): Terminating (SIGTERM) 18:08:26.885986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=837): Terminating (SIGTERM) 18:08:26.928308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=840): Terminating (SIGTERM) 18:08:26.971389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=844): Terminating (SIGTERM) 18:08:27.014654 --- ParallelTerminationStrategy: PID 659 died... 18:08:27.034427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=659): Terminated: ok {rc=0} 18:08:27.082402 --- ParallelTerminationStrategy: PID 704 died... 18:08:27.101658 run iperf3-srv_10.42.42.10(pid=704): Terminated {rc=256} 18:08:27.146448 --- ParallelTerminationStrategy: PID 805 died... 18:08:27.165657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=805): Terminated: ok {rc=0} 18:08:27.210995 --- ParallelTerminationStrategy: PID 828 died... 18:08:27.230135 run iperf3-srv_10.42.42.10(pid=828): Terminated {rc=256} 18:08:27.275762 --- ParallelTerminationStrategy: PID 837 died... 18:08:27.295528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=837): Terminated: ok {rc=0} 18:08:27.341230 --- ParallelTerminationStrategy: PID 840 died... 18:08:27.360983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=840): Terminated: ok {rc=0} 18:08:27.406041 --- ParallelTerminationStrategy: PID 844 died... 18:08:27.426206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=844): Terminated: ok {rc=0} 18:08:27.513136 bus /gobi_0: Setting Powered False 18:08:28.613183 bus /gobi_0: Setting Powered False 18:08:29.730863 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:08:30.904848 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:30.919105 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:08:31.010756 tst iperf3.py: using LAC 29700 18:08:31.166310 tst iperf3.py: using RAC 120 18:08:31.338244 tst iperf3.py: using CellId 29700 18:08:31.459979 tst iperf3.py: using BVCI 29701 18:08:31.599605 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:31.613685 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:31.627551 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:31.641992 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:31.658628 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:31.672673 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:31.687171 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:31.701089 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:31.715261 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:08:31.855327 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:08:32.110067 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:32.491604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=846): Launched 18:08:32.826178 run iperf3-srv_10.42.42.10(pid=847): Launched 18:08:32.969470 tst iperf3.py:8: start network... 18:08:33.225352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:33.711312 run create_hlr_db(pid=848): Launched 18:08:33.878954 bus /gobi_6: Setting Powered False 18:08:34.940284 run create_hlr_db(pid=848): Terminated: ok {rc=0} 18:08:35.375502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=850): Launched 18:08:35.706314 run osmo-hlr_10.42.42.2(pid=851): Launched 18:08:35.939395 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:36.666895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=853): Launched 18:08:36.994155 run osmo-stp_10.42.42.5(pid=854): Launched 18:08:37.235780 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:37.918345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=856): Launched 18:08:38.047872 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:38.311897 run patchelf(pid=857): Launched 18:08:38.499097 run osmo-stp_10.42.42.5(pid=854): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=854)] 18:08:38.631497 run osmo-stp_10.42.42.5(pid=854): stdout: | (launched: 2022-12-10_18:08:36.933939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:38.767103 run osmo-stp_10.42.42.5(pid=854): stderr: | 20221210180837269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180837269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180837270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180837270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180837271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180837271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180837271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:38.903250 run osmo-stp_10.42.42.5(pid=854): stdout: | (launched: 2022-12-10_18:08:36.933939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:39.030346 run osmo-stp_10.42.42.5(pid=854): stderr: | 20221210180837269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180837269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180837270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180837270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180837271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180837271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180837271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:39.182711 run patchelf(pid=857): Terminating (SIGINT) 18:08:39.358062 run patchelf(pid=857): Terminated: ok {rc=0} 18:08:39.485907 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=854): Process ended prematurely: osmo-stp_10.42.42.5(pid=854) [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=854)] [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 18:08:39.496531 tst iperf3.py:8: Test FAILED (8.7 sec) 18:08:39.525729 run osmo-hlr_10.42.42.2(pid=851): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=851)] 18:08:39.575761 run osmo-hlr_10.42.42.2(pid=851): stdout: | (launched: 2022-12-10_18:08:35.640537) 18:08:39.627763 run osmo-hlr_10.42.42.2(pid=851): stderr: | 20221210180835988 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180835988 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180835988 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180835988 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180835988 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180835989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180836007 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180836020 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180836020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180836020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:39.681873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=846): Terminating (SIGTERM) 18:08:39.724328 run iperf3-srv_10.42.42.10(pid=847): Terminating (SIGTERM) 18:08:39.770425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=850): Terminating (SIGTERM) 18:08:39.814124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=853): Terminating (SIGTERM) 18:08:39.858516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=856): Terminating (SIGTERM) 18:08:39.902667 --- ParallelTerminationStrategy: PID 846 died... 18:08:39.922563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=846): Terminated: ok {rc=0} 18:08:39.969724 --- ParallelTerminationStrategy: PID 847 died... 18:08:39.989256 run iperf3-srv_10.42.42.10(pid=847): Terminated {rc=256} 18:08:40.034856 --- ParallelTerminationStrategy: PID 850 died... 18:08:40.055578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=850): Terminated: ok {rc=0} 18:08:40.101198 --- ParallelTerminationStrategy: PID 853 died... 18:08:40.121357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=853): Terminated: ok {rc=0} 18:08:40.166768 --- ParallelTerminationStrategy: PID 856 died... 18:08:40.186280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=856): Terminated: ok {rc=0} 18:08:40.274160 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:08:41.422473 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:41.434864 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:08:41.503169 tst iperf3m4.py: using LAC 29701 18:08:41.629242 tst iperf3m4.py: using RAC 121 18:08:41.755323 tst iperf3m4.py: using CellId 29701 18:08:41.879209 tst iperf3m4.py: using BVCI 29702 18:08:41.994627 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:42.006152 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:42.017567 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:42.029055 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:42.040479 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:42.052004 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:42.063990 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:42.075635 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:42.087358 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:08:42.207218 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:08:42.325394 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:08:42.443269 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:08:42.560698 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:08:42.758800 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:43.058326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=859): Launched 18:08:43.318651 run iperf3-srv_10.42.42.10(pid=860): Launched 18:08:43.432012 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:08:43.629741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:43.928142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=861): Launched 18:08:44.188561 run iperf3-srv_10.42.42.10(pid=862): Launched 18:08:44.300357 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:08:44.498699 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:44.797839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=863): Launched 18:08:45.057194 run iperf3-srv_10.42.42.10(pid=864): Launched 18:08:45.170570 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:08:45.369071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:45.668073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=865): Launched 18:08:45.947675 run iperf3-srv_10.42.42.10(pid=866): Launched 18:08:46.105724 tst iperf3m4.py:8: start network... 18:08:46.307442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:46.786104 run create_hlr_db(pid=867): Launched 18:08:46.942997 bus /gobi_6: Setting Powered False 18:08:48.003195 run create_hlr_db(pid=867): Terminated: ok {rc=0} 18:08:48.438604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=869): Launched 18:08:48.759332 run osmo-hlr_10.42.42.2(pid=870): Launched 18:08:48.882131 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:49.434368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=882): Launched 18:08:49.753423 run osmo-stp_10.42.42.5(pid=887): Launched 18:08:49.876151 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:50.425710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=889): Launched 18:08:50.549508 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:50.819818 run patchelf(pid=890): Launched 18:08:50.997704 run osmo-stp_10.42.42.5(pid=887): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=887)] 18:08:51.133047 run osmo-stp_10.42.42.5(pid=887): stdout: | (launched: 2022-12-10_18:08:49.694539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:51.269805 run osmo-stp_10.42.42.5(pid=887): stderr: | 20221210180849884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180849885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180849885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180849885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180849886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180849886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180849886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:51.407062 run osmo-stp_10.42.42.5(pid=887): stdout: | (launched: 2022-12-10_18:08:49.694539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:51.538127 run osmo-stp_10.42.42.5(pid=887): stderr: | 20221210180849884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180849885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180849885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180849885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180849886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180849886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180849886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:51.693318 run patchelf(pid=890): Terminating (SIGINT) 18:08:51.871589 run patchelf(pid=890): Terminated: ok {rc=0} 18:08:52.000343 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=887): Process ended prematurely: osmo-stp_10.42.42.5(pid=887) [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=887)] [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:08:52.010698 tst iperf3m4.py:8: Test FAILED (10.6 sec) 18:08:52.040343 run osmo-hlr_10.42.42.2(pid=870): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=870)] 18:08:52.090408 run osmo-hlr_10.42.42.2(pid=870): stdout: | (launched: 2022-12-10_18:08:48.699743) 18:08:52.142271 run osmo-hlr_10.42.42.2(pid=870): stderr: | 20221210180848897 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180848897 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180848897 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180848897 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180848897 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180848897 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180848908 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180848917 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180848917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180848917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:52.194574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=859): Terminating (SIGTERM) 18:08:52.237134 run iperf3-srv_10.42.42.10(pid=860): Terminating (SIGTERM) 18:08:52.279511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=861): Terminating (SIGTERM) 18:08:52.321756 run iperf3-srv_10.42.42.10(pid=862): Terminating (SIGTERM) 18:08:52.363834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=863): Terminating (SIGTERM) 18:08:52.405689 run iperf3-srv_10.42.42.10(pid=864): Terminating (SIGTERM) 18:08:52.447441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=865): Terminating (SIGTERM) 18:08:52.489323 run iperf3-srv_10.42.42.10(pid=866): Terminating (SIGTERM) 18:08:52.531447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=869): Terminating (SIGTERM) 18:08:52.573783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=882): Terminating (SIGTERM) 18:08:52.615817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=889): Terminating (SIGTERM) 18:08:52.657910 --- ParallelTerminationStrategy: PID 859 died... 18:08:52.677467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=859): Terminated: ok {rc=0} 18:08:52.723874 --- ParallelTerminationStrategy: PID 860 died... 18:08:52.743211 run iperf3-srv_10.42.42.10(pid=860): Terminated {rc=256} 18:08:52.789344 --- ParallelTerminationStrategy: PID 861 died... 18:08:52.808580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=861): Terminated: ok {rc=0} 18:08:52.854793 --- ParallelTerminationStrategy: PID 862 died... 18:08:52.873940 run iperf3-srv_10.42.42.10(pid=862): Terminated {rc=256} 18:08:52.920101 --- ParallelTerminationStrategy: PID 863 died... 18:08:52.939450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=863): Terminated: ok {rc=0} 18:08:52.985584 --- ParallelTerminationStrategy: PID 864 died... 18:08:53.004940 run iperf3-srv_10.42.42.10(pid=864): Terminated {rc=256} 18:08:53.051513 --- ParallelTerminationStrategy: PID 865 died... 18:08:53.070820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=865): Terminated: ok {rc=0} 18:08:53.117188 --- ParallelTerminationStrategy: PID 866 died... 18:08:53.136494 run iperf3-srv_10.42.42.10(pid=866): Terminated {rc=256} 18:08:53.183430 --- ParallelTerminationStrategy: PID 869 died... 18:08:53.202973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=869): Terminated: ok {rc=0} 18:08:53.249422 --- ParallelTerminationStrategy: PID 882 died... 18:08:53.268913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=882): Terminated: ok {rc=0} 18:08:53.316055 --- ParallelTerminationStrategy: PID 889 died... 18:08:53.335726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=889): Terminated: ok {rc=0} 18:08:53.424608 bus /gobi_4: Setting Powered False 18:08:54.523030 bus /gobi_4: Setting Powered False 18:08:55.639849 bus /gobi_1: Setting Powered False 18:08:56.738315 bus /gobi_1: Setting Powered False 18:08:57.852761 bus /gobi_0: Setting Powered False 18:08:58.950443 bus /gobi_0: Setting Powered False 18:09:00.065792 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:09:01.170840 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:01.183943 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:09:01.257144 tst ping.py: using LAC 29702 18:09:01.420778 tst ping.py: using RAC 122 18:09:01.538641 tst ping.py: using CellId 29702 18:09:01.699680 tst ping.py: using BVCI 29703 18:09:01.853458 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:01.870436 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:01.888548 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:01.906598 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:01.924733 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:01.942752 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:01.961477 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:01.979372 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:02.105876 tst ping.py:19: start network... 18:09:02.319206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:02.801356 run create_hlr_db(pid=891): Launched 18:09:02.921454 bus /gobi_6: Setting Powered False 18:09:03.984003 run create_hlr_db(pid=891): Terminated: ok {rc=0} 18:09:04.420407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=893): Launched 18:09:04.733478 run osmo-hlr_10.42.42.2(pid=894): Launched 18:09:04.852694 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:05.394014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=896): Launched 18:09:05.706328 run osmo-stp_10.42.42.5(pid=897): Launched 18:09:05.826668 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:06.364719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=899): Launched 18:09:06.484063 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:06.748352 run patchelf(pid=900): Launched 18:09:06.922300 run osmo-stp_10.42.42.5(pid=897): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=897)] 18:09:07.054624 run osmo-stp_10.42.42.5(pid=897): stdout: | (launched: 2022-12-10_18:09:05.648856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:07.188543 run osmo-stp_10.42.42.5(pid=897): stderr: | 20221210180905841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180905841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180905841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180905842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180905842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180905842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180905842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:07.322292 run osmo-stp_10.42.42.5(pid=897): stdout: | (launched: 2022-12-10_18:09:05.648856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:07.450415 run osmo-stp_10.42.42.5(pid=897): stderr: | 20221210180905841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180905841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180905841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180905842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180905842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180905842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180905842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:07.601992 run patchelf(pid=900): Terminating (SIGINT) 18:09:07.775998 run patchelf(pid=900): Terminated: ok {rc=0} 18:09:07.901636 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=897): Process ended prematurely: osmo-stp_10.42.42.5(pid=897) [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=897)] [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 18:09:07.911062 tst ping.py:22: Test FAILED (6.7 sec) 18:09:07.939642 run osmo-hlr_10.42.42.2(pid=894): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=894)] 18:09:07.989519 run osmo-hlr_10.42.42.2(pid=894): stdout: | (launched: 2022-12-10_18:09:04.675304) 18:09:08.041226 run osmo-hlr_10.42.42.2(pid=894): stderr: | 20221210180904876 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180904876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180904876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180904876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180904876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180904876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180904889 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180904897 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180904897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180904897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:08.093407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=893): Terminating (SIGTERM) 18:09:08.134985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=896): Terminating (SIGTERM) 18:09:08.177157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=899): Terminating (SIGTERM) 18:09:08.219355 --- ParallelTerminationStrategy: PID 893 died... 18:09:08.239283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=893): Terminated: ok {rc=0} 18:09:08.285921 --- ParallelTerminationStrategy: PID 896 died... 18:09:08.305533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=896): Terminated: ok {rc=0} 18:09:08.351829 --- ParallelTerminationStrategy: PID 899 died... 18:09:08.371312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=899): Terminated: ok {rc=0} 18:09:08.458192 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:09:09.545957 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:09.558246 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:09:09.626527 tst ping_idle_ping.py: using LAC 29703 18:09:09.743511 tst ping_idle_ping.py: using RAC 123 18:09:09.860723 tst ping_idle_ping.py: using CellId 29703 18:09:09.978682 tst ping_idle_ping.py: using BVCI 29704 18:09:10.086634 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:10.097891 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:10.108617 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:10.119914 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:10.133488 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:10.146191 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:10.158170 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:10.170450 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:10.287096 tst ping_idle_ping.py:24: start network... 18:09:10.498300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:10.984214 run create_hlr_db(pid=901): Launched 18:09:11.104793 bus /gobi_6: Setting Powered False 18:09:12.167668 run create_hlr_db(pid=901): Terminated: ok {rc=0} 18:09:12.587843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=903): Launched 18:09:12.881521 run osmo-hlr_10.42.42.2(pid=904): Launched 18:09:12.993261 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:13.498984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=906): Launched 18:09:13.792643 run osmo-stp_10.42.42.5(pid=907): Launched 18:09:13.905799 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:14.412365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=909): Launched 18:09:14.524414 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:14.771762 run patchelf(pid=910): Launched 18:09:14.935628 run osmo-stp_10.42.42.5(pid=907): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=907)] 18:09:15.060327 run osmo-stp_10.42.42.5(pid=907): stdout: | (launched: 2022-12-10_18:09:13.737680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:15.185864 run osmo-stp_10.42.42.5(pid=907): stderr: | 20221210180913911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180913911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180913911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180913911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180913912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180913912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180913912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:15.311733 run osmo-stp_10.42.42.5(pid=907): stdout: | (launched: 2022-12-10_18:09:13.737680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:15.431707 run osmo-stp_10.42.42.5(pid=907): stderr: | 20221210180913911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180913911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180913911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180913911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180913912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180913912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180913912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:15.574665 run patchelf(pid=910): Terminating (SIGINT) 18:09:15.738353 run patchelf(pid=910): Terminated: ok {rc=0} 18:09:15.870345 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=907): Process ended prematurely: osmo-stp_10.42.42.5(pid=907) [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=907)] [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:09:15.879869 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 18:09:15.924647 run osmo-hlr_10.42.42.2(pid=904): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=904)] 18:09:15.972901 run osmo-hlr_10.42.42.2(pid=904): stdout: | (launched: 2022-12-10_18:09:12.826894) 18:09:16.023977 run osmo-hlr_10.42.42.2(pid=904): stderr: | 20221210180913001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180913001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180913001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180913001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180913001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180913001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180913013 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180913024 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180913024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180913024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:16.075027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=903): Terminating (SIGTERM) 18:09:16.116406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=906): Terminating (SIGTERM) 18:09:16.159204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=909): Terminating (SIGTERM) 18:09:16.201423 --- ParallelTerminationStrategy: PID 903 died... 18:09:16.220658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=903): Terminated: ok {rc=0} 18:09:16.265303 --- ParallelTerminationStrategy: PID 906 died... 18:09:16.284115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=906): Terminated: ok {rc=0} 18:09:16.328664 --- ParallelTerminationStrategy: PID 909 died... 18:09:16.347733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=909): Terminated: ok {rc=0} 18:09:16.431470 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:09:17.729324 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:09:17.735308 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:09:17.763994 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 18:09:17.802123 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 18:09:17.888217 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:09:17.916866 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 18:09:17.954848 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 18:09:18.561678 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 18:09:18.617279 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:18.628769 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:09:18.696676 tst cs_paging_gprs_active.py: using LAC 29704 18:09:18.820785 tst cs_paging_gprs_active.py: using RAC 124 18:09:18.944520 tst cs_paging_gprs_active.py: using CellId 29704 18:09:19.068277 tst cs_paging_gprs_active.py: using BVCI 29705 18:09:19.185648 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:19.197167 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:19.208394 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:19.220421 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:19.232703 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:19.244679 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:19.256793 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:19.268598 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:19.280936 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:09:19.396028 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:09:19.514469 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:09:19.730895 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:20.051444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=917): Launched 18:09:20.333373 run iperf3-srv_10.42.42.10(pid=918): Launched 18:09:20.454729 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:09:20.669855 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:20.990867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=919): Launched 18:09:21.272675 run iperf3-srv_10.42.42.10(pid=920): Launched 18:09:21.395225 tst cs_paging_gprs_active.py:38: start network... 18:09:21.610619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:22.106779 run create_hlr_db(pid=921): Launched 18:09:22.229447 bus /gobi_6: Setting Powered False 18:09:23.292791 run create_hlr_db(pid=921): Terminated: ok {rc=0} 18:09:23.721401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=923): Launched 18:09:24.022564 run osmo-hlr_10.42.42.2(pid=924): Launched 18:09:24.137065 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:24.656531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=926): Launched 18:09:24.956176 run osmo-stp_10.42.42.5(pid=927): Launched 18:09:25.069885 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:25.586323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=929): Launched 18:09:25.702533 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:25.962258 run patchelf(pid=930): Launched 18:09:26.129551 run osmo-stp_10.42.42.5(pid=927): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=927)] 18:09:26.256336 run osmo-stp_10.42.42.5(pid=927): stdout: | (launched: 2022-12-10_18:09:24.900378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:26.384750 run osmo-stp_10.42.42.5(pid=927): stderr: | 20221210180925073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180925073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180925073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180925074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180925074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180925074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180925074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:26.512742 run osmo-stp_10.42.42.5(pid=927): stdout: | (launched: 2022-12-10_18:09:24.900378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:26.635985 run osmo-stp_10.42.42.5(pid=927): stderr: | 20221210180925073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180925073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180925073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180925074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180925074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180925074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180925074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:26.781787 run patchelf(pid=930): Terminating (SIGINT) 18:09:26.949351 run patchelf(pid=930): Terminated: ok {rc=0} 18:09:27.069829 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=927): Process ended prematurely: osmo-stp_10.42.42.5(pid=927) [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=927)] [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 18:09:27.079191 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:09:27.106553 run osmo-hlr_10.42.42.2(pid=924): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=924)] 18:09:27.154099 run osmo-hlr_10.42.42.2(pid=924): stdout: | (launched: 2022-12-10_18:09:23.966230) 18:09:27.203152 run osmo-hlr_10.42.42.2(pid=924): stderr: | 20221210180924144 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180924144 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180924144 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180924144 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180924144 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180924144 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180924157 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180924166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180924166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180924166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:27.252665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=917): Terminating (SIGTERM) 18:09:27.291938 run iperf3-srv_10.42.42.10(pid=918): Terminating (SIGTERM) 18:09:27.331299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=919): Terminating (SIGTERM) 18:09:27.370921 run iperf3-srv_10.42.42.10(pid=920): Terminating (SIGTERM) 18:09:27.410179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=923): Terminating (SIGTERM) 18:09:27.449332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=926): Terminating (SIGTERM) 18:09:27.488536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=929): Terminating (SIGTERM) 18:09:27.528123 --- ParallelTerminationStrategy: PID 917 died... 18:09:27.547178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=917): Terminated: ok {rc=0} 18:09:27.591250 --- ParallelTerminationStrategy: PID 918 died... 18:09:27.609720 run iperf3-srv_10.42.42.10(pid=918): Terminated {rc=256} 18:09:27.653142 --- ParallelTerminationStrategy: PID 919 died... 18:09:27.671805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=919): Terminated: ok {rc=0} 18:09:27.715268 --- ParallelTerminationStrategy: PID 920 died... 18:09:27.733799 run iperf3-srv_10.42.42.10(pid=920): Terminated {rc=256} 18:09:27.777333 --- ParallelTerminationStrategy: PID 923 died... 18:09:27.795902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=923): Terminated: ok {rc=0} 18:09:27.839453 --- ParallelTerminationStrategy: PID 926 died... 18:09:27.858080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=926): Terminated: ok {rc=0} 18:09:27.901566 --- ParallelTerminationStrategy: PID 929 died... 18:09:27.920121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=929): Terminated: ok {rc=0} 18:09:28.006299 bus /gobi_0: Setting Powered False 18:09:29.105960 bus /gobi_0: Setting Powered False 18:09:30.220901 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 18:09:31.377650 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:31.390782 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:09:31.465382 tst iperf3.py: using LAC 29705 18:09:31.637541 tst iperf3.py: using RAC 125 18:09:31.769244 tst iperf3.py: using CellId 29705 18:09:31.896306 tst iperf3.py: using BVCI 29706 18:09:32.026937 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:32.038761 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:32.050023 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:32.063018 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:32.075417 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:32.086974 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:32.099443 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:32.111543 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:32.123943 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:09:32.239576 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:09:32.454296 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:32.773664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=931): Launched 18:09:33.051311 run iperf3-srv_10.42.42.10(pid=932): Launched 18:09:33.171153 tst iperf3.py:8: start network... 18:09:33.385318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:33.878954 run create_hlr_db(pid=933): Launched 18:09:34.001891 bus /gobi_6: Setting Powered False 18:09:35.065473 run create_hlr_db(pid=933): Terminated: ok {rc=0} 18:09:35.493632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=936): Launched 18:09:35.794551 run osmo-hlr_10.42.42.2(pid=937): Launched 18:09:35.908469 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:36.441703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=939): Launched 18:09:36.742576 run osmo-stp_10.42.42.5(pid=940): Launched 18:09:36.856403 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:37.386966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=942): Launched 18:09:37.501148 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:37.755178 run patchelf(pid=943): Launched 18:09:37.921506 run osmo-stp_10.42.42.5(pid=940): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=940)] 18:09:38.048003 run osmo-stp_10.42.42.5(pid=940): stdout: | (launched: 2022-12-10_18:09:36.686580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:38.176478 run osmo-stp_10.42.42.5(pid=940): stderr: | 20221210180936860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180936860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180936860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180936861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180936861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180936861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180936861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:38.304774 run osmo-stp_10.42.42.5(pid=940): stdout: | (launched: 2022-12-10_18:09:36.686580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:38.427296 run osmo-stp_10.42.42.5(pid=940): stderr: | 20221210180936860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180936860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180936860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180936861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180936861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180936861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180936861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:38.572602 run patchelf(pid=943): Terminating (SIGINT) 18:09:38.741158 run patchelf(pid=943): Terminated: ok {rc=0} 18:09:38.861980 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=940): Process ended prematurely: osmo-stp_10.42.42.5(pid=940) [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=940)] [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 18:09:38.871362 tst iperf3.py:8: Test FAILED (7.5 sec) 18:09:38.898433 run osmo-hlr_10.42.42.2(pid=937): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=937)] 18:09:38.945852 run osmo-hlr_10.42.42.2(pid=937): stdout: | (launched: 2022-12-10_18:09:35.739090) 18:09:38.994868 run osmo-hlr_10.42.42.2(pid=937): stderr: | 20221210180935915 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180935915 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180935915 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180935915 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180935915 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180935915 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180935926 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180935937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180935937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180935937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:39.044286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=931): Terminating (SIGTERM) 18:09:39.083748 run iperf3-srv_10.42.42.10(pid=932): Terminating (SIGTERM) 18:09:39.123102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=936): Terminating (SIGTERM) 18:09:39.162602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=939): Terminating (SIGTERM) 18:09:39.202411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=942): Terminating (SIGTERM) 18:09:39.242048 --- ParallelTerminationStrategy: PID 931 died... 18:09:39.260815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=931): Terminated: ok {rc=0} 18:09:39.304793 --- ParallelTerminationStrategy: PID 932 died... 18:09:39.323288 run iperf3-srv_10.42.42.10(pid=932): Terminated {rc=256} 18:09:39.366769 --- ParallelTerminationStrategy: PID 936 died... 18:09:39.385268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=936): Terminated: ok {rc=0} 18:09:39.428568 --- ParallelTerminationStrategy: PID 939 died... 18:09:39.447355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=939): Terminated: ok {rc=0} 18:09:39.491010 --- ParallelTerminationStrategy: PID 942 died... 18:09:39.509622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=942): Terminated: ok {rc=0} 18:09:39.592491 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 18:09:40.734782 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:40.746534 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:09:40.815979 tst iperf3m4.py: using LAC 29706 18:09:40.933111 tst iperf3m4.py: using RAC 126 18:09:41.048601 tst iperf3m4.py: using CellId 29706 18:09:41.164139 tst iperf3m4.py: using BVCI 29707 18:09:41.272260 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:41.283532 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:41.294532 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:41.305446 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:41.316425 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:41.327340 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:41.338503 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:41.349504 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:41.360619 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:09:41.480114 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:09:41.602265 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:09:41.719403 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:09:41.836512 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:09:42.036120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:42.336026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=944): Launched 18:09:42.598396 run iperf3-srv_10.42.42.10(pid=945): Launched 18:09:42.711190 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:09:42.910120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:43.210643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=946): Launched 18:09:43.471830 run iperf3-srv_10.42.42.10(pid=947): Launched 18:09:43.584059 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:09:43.783311 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:44.084133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=948): Launched 18:09:44.345831 run iperf3-srv_10.42.42.10(pid=949): Launched 18:09:44.457586 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:09:44.655762 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:44.955792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=950): Launched 18:09:45.216456 run iperf3-srv_10.42.42.10(pid=951): Launched 18:09:45.328669 tst iperf3m4.py:8: start network... 18:09:45.527188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:45.998745 run create_hlr_db(pid=953): Launched 18:09:46.136794 bus /gobi_6: Setting Powered False 18:09:47.199431 run create_hlr_db(pid=953): Terminated: ok {rc=0} 18:09:47.649204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=955): Launched 18:09:47.970477 run osmo-hlr_10.42.42.2(pid=957): Launched 18:09:48.092138 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:48.647339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=959): Launched 18:09:48.968299 run osmo-stp_10.42.42.5(pid=960): Launched 18:09:49.091203 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:49.643245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=962): Launched 18:09:49.767407 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:50.037760 run patchelf(pid=963): Launched 18:09:50.217749 run osmo-stp_10.42.42.5(pid=960): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=960)] 18:09:50.353378 run osmo-stp_10.42.42.5(pid=960): stdout: | (launched: 2022-12-10_18:09:48.909044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:50.490203 run osmo-stp_10.42.42.5(pid=960): stderr: | 20221210180949098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180949098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180949098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180949099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180949099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180949099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180949099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:50.626953 run osmo-stp_10.42.42.5(pid=960): stdout: | (launched: 2022-12-10_18:09:48.909044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:50.758002 run osmo-stp_10.42.42.5(pid=960): stderr: | 20221210180949098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210180949098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210180949098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210180949099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210180949099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210180949099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210180949099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:50.912999 run patchelf(pid=963): Terminating (SIGINT) 18:09:51.091975 run patchelf(pid=963): Terminated: ok {rc=0} 18:09:51.221400 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=960): Process ended prematurely: osmo-stp_10.42.42.5(pid=960) [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=960)] [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 18:09:51.231701 tst iperf3m4.py:8: Test FAILED (10.5 sec) 18:09:51.261390 run osmo-hlr_10.42.42.2(pid=957): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=957)] 18:09:51.311775 run osmo-hlr_10.42.42.2(pid=957): stdout: | (launched: 2022-12-10_18:09:47.910939) 18:09:51.363825 run osmo-hlr_10.42.42.2(pid=957): stderr: | 20221210180948109 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210180948109 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210180948109 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210180948109 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210180948109 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210180948109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210180948122 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210180948130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210180948130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210180948131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:51.416064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=944): Terminating (SIGTERM) 18:09:51.458023 run iperf3-srv_10.42.42.10(pid=945): Terminating (SIGTERM) 18:09:51.499997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=946): Terminating (SIGTERM) 18:09:51.542039 run iperf3-srv_10.42.42.10(pid=947): Terminating (SIGTERM) 18:09:51.583924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=948): Terminating (SIGTERM) 18:09:51.625976 run iperf3-srv_10.42.42.10(pid=949): Terminating (SIGTERM) 18:09:51.667710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=950): Terminating (SIGTERM) 18:09:51.709523 run iperf3-srv_10.42.42.10(pid=951): Terminating (SIGTERM) 18:09:51.751325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=955): Terminating (SIGTERM) 18:09:51.793546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=959): Terminating (SIGTERM) 18:09:51.835648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=962): Terminating (SIGTERM) 18:09:51.877806 --- ParallelTerminationStrategy: PID 944 died... 18:09:51.897973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=944): Terminated: ok {rc=0} 18:09:51.944483 --- ParallelTerminationStrategy: PID 945 died... 18:09:51.963883 run iperf3-srv_10.42.42.10(pid=945): Terminated {rc=256} 18:09:52.010225 --- ParallelTerminationStrategy: PID 946 died... 18:09:52.029759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=946): Terminated: ok {rc=0} 18:09:52.076076 --- ParallelTerminationStrategy: PID 947 died... 18:09:52.095516 run iperf3-srv_10.42.42.10(pid=947): Terminated {rc=256} 18:09:52.141743 --- ParallelTerminationStrategy: PID 948 died... 18:09:52.161237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=948): Terminated: ok {rc=0} 18:09:52.208454 --- ParallelTerminationStrategy: PID 949 died... 18:09:52.228039 run iperf3-srv_10.42.42.10(pid=949): Terminated {rc=256} 18:09:52.275107 --- ParallelTerminationStrategy: PID 950 died... 18:09:52.294737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=950): Terminated: ok {rc=0} 18:09:52.341782 --- ParallelTerminationStrategy: PID 951 died... 18:09:52.361411 run iperf3-srv_10.42.42.10(pid=951): Terminated {rc=256} 18:09:52.408251 --- ParallelTerminationStrategy: PID 955 died... 18:09:52.427950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=955): Terminated: ok {rc=0} 18:09:52.474777 --- ParallelTerminationStrategy: PID 959 died... 18:09:52.494428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=959): Terminated: ok {rc=0} 18:09:52.541338 --- ParallelTerminationStrategy: PID 962 died... 18:09:52.561088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=962): Terminated: ok {rc=0} 18:09:52.650113 bus /gobi_4: Setting Powered False 18:09:53.750135 bus /gobi_4: Setting Powered False 18:09:54.868432 bus /gobi_1: Setting Powered False 18:09:55.966854 bus /gobi_1: Setting Powered False 18:09:57.082848 bus /gobi_0: Setting Powered False 18:09:58.181575 bus /gobi_0: Setting Powered False 18:09:59.300198 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 18:10:00.402782 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:00.415045 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:10:00.485750 tst ping.py: using LAC 29707 18:10:00.603867 tst ping.py: using RAC 127 18:10:00.718539 tst ping.py: using CellId 29707 18:10:00.841276 tst ping.py: using BVCI 29708 18:10:00.967310 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:00.979371 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:00.991221 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:01.003087 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:01.014574 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:01.026356 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:01.037998 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:01.049621 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:10:01.187853 tst ping.py:19: start network... 18:10:01.405462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:01.924578 run create_hlr_db(pid=967): Launched 18:10:02.087184 bus /gobi_6: Setting Powered False 18:10:03.149501 run create_hlr_db(pid=967): Terminated: ok {rc=0} 18:10:03.588024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=969): Launched 18:10:03.902987 run osmo-hlr_10.42.42.2(pid=970): Launched 18:10:04.023490 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:04.567358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=972): Launched 18:10:04.880518 run osmo-stp_10.42.42.5(pid=973): Launched 18:10:05.000169 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:10:05.541315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=975): Launched 18:10:05.661972 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:10:05.927704 run patchelf(pid=976): Launched 18:10:06.102753 run osmo-stp_10.42.42.5(pid=973): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=973)] 18:10:06.236169 run osmo-stp_10.42.42.5(pid=973): stdout: | (launched: 2022-12-10_18:10:04.823001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:06.370601 run osmo-stp_10.42.42.5(pid=973): stderr: | 20221210181005011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181005011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181005012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181005012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181005013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181005013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181005013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:06.504776 run osmo-stp_10.42.42.5(pid=973): stdout: | (launched: 2022-12-10_18:10:04.823001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:06.633460 run osmo-stp_10.42.42.5(pid=973): stderr: | 20221210181005011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181005011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181005012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181005012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181005013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181005013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181005013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:06.785796 run patchelf(pid=976): Terminating (SIGINT) 18:10:06.961388 run patchelf(pid=976): Terminated: ok {rc=0} 18:10:07.087785 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=973): Process ended prematurely: osmo-stp_10.42.42.5(pid=973) [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=973)] [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 18:10:07.097393 tst ping.py:22: Test FAILED (6.7 sec) 18:10:07.125728 run osmo-hlr_10.42.42.2(pid=970): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=970)] 18:10:07.175467 run osmo-hlr_10.42.42.2(pid=970): stdout: | (launched: 2022-12-10_18:10:03.845180) 18:10:07.227158 run osmo-hlr_10.42.42.2(pid=970): stderr: | 20221210181004040 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181004040 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181004040 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181004040 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181004040 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181004040 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181004054 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181004062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181004062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181004062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:07.279018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=969): Terminating (SIGTERM) 18:10:07.320397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=972): Terminating (SIGTERM) 18:10:07.362212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=975): Terminating (SIGTERM) 18:10:07.403879 --- ParallelTerminationStrategy: PID 969 died... 18:10:07.423740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=969): Terminated: ok {rc=0} 18:10:07.470270 --- ParallelTerminationStrategy: PID 972 died... 18:10:07.489620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=972): Terminated: ok {rc=0} 18:10:07.535598 --- ParallelTerminationStrategy: PID 975 died... 18:10:07.555016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=975): Terminated: ok {rc=0} 18:10:07.642593 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 18:10:08.731552 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:08.744230 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:10:08.815121 tst ping_idle_ping.py: using LAC 29708 18:10:08.939115 tst ping_idle_ping.py: using RAC 128 18:10:09.060365 tst ping_idle_ping.py: using CellId 29708 18:10:09.187081 tst ping_idle_ping.py: using BVCI 29709 18:10:09.302193 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:09.313709 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:09.325148 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:09.336620 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:09.347869 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:09.359693 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:09.371739 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:09.383268 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:10:09.500050 tst ping_idle_ping.py:24: start network... 18:10:09.696436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:10.154768 run create_hlr_db(pid=977): Launched 18:10:10.276049 bus /gobi_6: Setting Powered False 18:10:11.334892 run create_hlr_db(pid=977): Terminated: ok {rc=0} 18:10:11.766418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=979): Launched 18:10:12.082778 run osmo-hlr_10.42.42.2(pid=980): Launched 18:10:12.204420 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:12.730915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=982): Launched 18:10:13.026209 run osmo-stp_10.42.42.5(pid=983): Launched 18:10:13.136663 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:10:13.644559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=985): Launched 18:10:13.757723 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:10:14.007461 run patchelf(pid=986): Launched 18:10:14.172003 run osmo-stp_10.42.42.5(pid=983): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=983)] 18:10:14.297348 run osmo-stp_10.42.42.5(pid=983): stdout: | (launched: 2022-12-10_18:10:12.970605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:14.423526 run osmo-stp_10.42.42.5(pid=983): stderr: | 20221210181013142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181013142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181013143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181013143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181013145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181013145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181013146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:14.550242 run osmo-stp_10.42.42.5(pid=983): stdout: | (launched: 2022-12-10_18:10:12.970605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:14.671430 run osmo-stp_10.42.42.5(pid=983): stderr: | 20221210181013142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181013142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181013143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181013143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181013145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181013145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181013146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:14.814654 run patchelf(pid=986): Terminating (SIGINT) 18:10:14.980529 run patchelf(pid=986): Terminated: ok {rc=0} 18:10:15.099445 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=983): Process ended prematurely: osmo-stp_10.42.42.5(pid=983) [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=983)] [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 18:10:15.108370 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 18:10:15.135126 run osmo-hlr_10.42.42.2(pid=980): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=980)] 18:10:15.182446 run osmo-hlr_10.42.42.2(pid=980): stdout: | (launched: 2022-12-10_18:10:12.024668) 18:10:15.232164 run osmo-hlr_10.42.42.2(pid=980): stderr: | 20221210181012223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181012223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181012223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181012223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181012223 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181012223 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181012235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181012243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181012244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181012244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:15.281811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=979): Terminating (SIGTERM) 18:10:15.321819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=982): Terminating (SIGTERM) 18:10:15.361740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=985): Terminating (SIGTERM) 18:10:15.401780 --- ParallelTerminationStrategy: PID 979 died... 18:10:15.420853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=979): Terminated: ok {rc=0} 18:10:15.465067 --- ParallelTerminationStrategy: PID 982 died... 18:10:15.483939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=982): Terminated: ok {rc=0} 18:10:15.527572 --- ParallelTerminationStrategy: PID 985 died... 18:10:15.546232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=985): Terminated: ok {rc=0} 18:10:15.631727 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:10:16.967886 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:10:16.975381 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:10:17.015199 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:10:17.059118 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:10:17.127478 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:10:17.175933 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:10:17.221655 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:10:17.752820 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2377 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:10:17.759846 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:10:17.772098 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:10:17.837825 tst switch_tch_pdch.py: using LAC 29709 18:10:17.955157 tst switch_tch_pdch.py: using RAC 129 18:10:18.072626 tst switch_tch_pdch.py: using CellId 29709 18:10:18.187350 tst switch_tch_pdch.py: using BVCI 29710 18:10:18.294495 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:10:18.305906 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:10:18.316906 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:10:18.328053 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:10:18.339098 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:10:18.350246 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:10:18.361489 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:10:18.372448 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:10:18.490342 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:10:18.606518 tst switch_tch_pdch.py:51: start network... 18:10:18.801640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:19.256048 run create_hlr_db(pid=994): Launched 18:10:19.376259 bus /gobi_6: Setting Powered False 18:10:20.436178 run create_hlr_db(pid=994): Terminated: ok {rc=0} 18:10:20.866595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=997): Launched 18:10:21.184196 run osmo-hlr_10.42.42.2(pid=998): Launched 18:10:21.306037 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:21.850777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1000): Launched 18:10:22.167963 run osmo-stp_10.42.42.5(pid=1001): Launched 18:10:22.287790 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:10:22.829801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1003): Launched 18:10:22.950032 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:10:23.215123 run patchelf(pid=1004): Launched 18:10:23.390622 run osmo-stp_10.42.42.5(pid=1001): ERR: Terminated: ERROR {rc=1} [trial-2377↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1001)] 18:10:23.524102 run osmo-stp_10.42.42.5(pid=1001): stdout: | (launched: 2022-12-10_18:10:22.109591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:23.658628 run osmo-stp_10.42.42.5(pid=1001): stderr: | 20221210181022300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181022300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181022300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181022300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181022301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181022301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181022301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:23.793082 run osmo-stp_10.42.42.5(pid=1001): stdout: | (launched: 2022-12-10_18:10:22.109591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:23.922176 run osmo-stp_10.42.42.5(pid=1001): stderr: | 20221210181022300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181022300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181022300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181022300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181022301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181022301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181022301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:24.075039 run patchelf(pid=1004): Terminating (SIGINT) 18:10:24.250512 run patchelf(pid=1004): Terminated: ok {rc=0} 18:10:24.376856 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1001): Process ended prematurely: osmo-stp_10.42.42.5(pid=1001) [trial-2377↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1001)] [trial-2377↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:10:24.386500 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 18:10:24.415108 run osmo-hlr_10.42.42.2(pid=998): ERR: Terminated: ERROR {rc=237} [trial-2377↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=998)] 18:10:24.465179 run osmo-hlr_10.42.42.2(pid=998): stdout: | (launched: 2022-12-10_18:10:21.125864) 18:10:24.517423 run osmo-hlr_10.42.42.2(pid=998): stderr: | 20221210181021324 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181021324 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181021324 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181021324 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181021324 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181021324 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181021336 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181021344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181021344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181021344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:24.569845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=997): Terminating (SIGTERM) 18:10:24.611455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1000): Terminating (SIGTERM) 18:10:24.653219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1003): Terminating (SIGTERM) 18:10:24.695256 --- ParallelTerminationStrategy: PID 997 died... 18:10:24.715178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=997): Terminated: ok {rc=0} 18:10:24.761601 --- ParallelTerminationStrategy: PID 1000 died... 18:10:24.780891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1000): Terminated: ok {rc=0} 18:10:24.827349 --- ParallelTerminationStrategy: PID 1003 died... 18:10:24.846925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1003): Terminated: ok {rc=0} 18:10:24.934629 bus /gobi_0: Setting Powered False 18:10:26.033300 bus /gobi_0: Setting Powered False 18:10:27.148554 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 18:10:28.406342 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:10:28.412606 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 18:10:28.442844 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 18:10:28.478062 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 18:10:28.532198 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 18:10:28.561903 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 18:10:28.596727 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 18:10:29.155350 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2377 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 18:10:29.160633 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:10:29.172291 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 18:10:29.241161 tst switch_tch_pdch.py: using LAC 29710 18:10:29.357183 tst switch_tch_pdch.py: using RAC 130 18:10:29.471617 tst switch_tch_pdch.py: using CellId 29710 18:10:29.586227 tst switch_tch_pdch.py: using BVCI 29711 18:10:29.691972 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:10:29.703217 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:10:29.714294 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:10:29.725051 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:10:29.735756 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:10:29.746611 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:10:29.757488 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:10:29.768269 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:10:29.883515 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:10:30.004237 tst switch_tch_pdch.py:51: start network... 18:10:30.215119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:30.671709 run create_hlr_db(pid=1009): Launched 18:10:30.791015 bus /gobi_6: Setting Powered False 18:10:31.851193 run create_hlr_db(pid=1009): Terminated: ok {rc=0} 18:10:32.268511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1011): Launched 18:10:32.581710 run osmo-hlr_10.42.42.2(pid=1012): Launched 18:10:32.701216 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:33.215257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1014): Launched 18:10:33.530619 run osmo-stp_10.42.42.5(pid=1015): Launched 18:10:33.652297 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:10:34.166003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1017): Launched 18:10:34.286521 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:10:34.551019 run patchelf(pid=1018): Launched 18:10:34.725408 run osmo-stp_10.42.42.5(pid=1015): ERR: Terminated: ERROR {rc=1} [trial-2377↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1015)] 18:10:34.858058 run osmo-stp_10.42.42.5(pid=1015): stdout: | (launched: 2022-12-10_18:10:33.472934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:34.992080 run osmo-stp_10.42.42.5(pid=1015): stderr: | 20221210181033663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181033663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181033663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181033663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181033664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181033664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181033664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:35.126187 run osmo-stp_10.42.42.5(pid=1015): stdout: | (launched: 2022-12-10_18:10:33.472934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:35.254897 run osmo-stp_10.42.42.5(pid=1015): stderr: | 20221210181033663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181033663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181033663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181033663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181033664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181033664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181033664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:35.407180 run patchelf(pid=1018): Terminating (SIGINT) 18:10:35.581588 run patchelf(pid=1018): Terminated: ok {rc=0} 18:10:35.707223 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1015): Process ended prematurely: osmo-stp_10.42.42.5(pid=1015) [trial-2377↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1015)] [trial-2377↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 18:10:35.716662 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 18:10:35.744759 run osmo-hlr_10.42.42.2(pid=1012): ERR: Terminated: ERROR {rc=237} [trial-2377↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1012)] 18:10:35.794722 run osmo-hlr_10.42.42.2(pid=1012): stdout: | (launched: 2022-12-10_18:10:32.523404) 18:10:35.846181 run osmo-hlr_10.42.42.2(pid=1012): stderr: | 20221210181032721 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181032721 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181032721 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181032722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181032722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181032722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181032732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181032741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181032741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181032741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:35.897954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1011): Terminating (SIGTERM) 18:10:35.939456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1014): Terminating (SIGTERM) 18:10:35.981035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1017): Terminating (SIGTERM) 18:10:36.022982 --- ParallelTerminationStrategy: PID 1011 died... 18:10:36.042635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1011): Terminated: ok {rc=0} 18:10:36.088725 --- ParallelTerminationStrategy: PID 1014 died... 18:10:36.108122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1014): Terminated: ok {rc=0} 18:10:36.154343 --- ParallelTerminationStrategy: PID 1017 died... 18:10:36.173634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1017): Terminated: ok {rc=0} 18:10:36.261360 bus /gobi_0: Setting Powered False 18:10:37.359854 bus /gobi_0: Setting Powered False 18:10:38.475121 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2377 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 nitb_sms:nanobts --------------------------------------------------------------------- 18:10:39.722239 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:10:39.725920 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 18:10:39.749313 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 18:10:39.756292 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 18:10:39.812053 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 18:10:39.837903 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 18:10:39.844733 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 18:10:40.375194 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 18:10:40.380287 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 18:10:40.391111 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 18:10:40.429378 tst mo_mt_sms.py: using LAC 29711 18:10:40.546113 tst mo_mt_sms.py: using RAC 131 18:10:40.659338 tst mo_mt_sms.py: using CellId 29711 18:10:40.773247 tst mo_mt_sms.py: using BVCI 29712 18:10:40.878933 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 18:10:40.994427 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 18:10:41.109172 tst mo_mt_sms.py:9: start nitb and bts... 18:10:41.304105 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:10:41.909886 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1023): Launched 18:10:42.227173 run osmo-nitb_10.42.42.2(pid=1024): Launched 18:10:42.402552 run osmo-nitb_10.42.42.2(pid=1024): ERR: Terminated: ERROR {rc=2} [trial-2377↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1024)] 18:10:42.543400 run osmo-nitb_10.42.42.2(pid=1024): stdout: | (launched: 2022-12-10_18:10:42.169251) 18:10:42.686039 run osmo-nitb_10.42.42.2(pid=1024): stderr: | (launched: 2022-12-10_18:10:42.216057) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:10:42.828202 run osmo-nitb_10.42.42.2(pid=1024): stdout: | (launched: 2022-12-10_18:10:42.169251) 18:10:42.964726 run osmo-nitb_10.42.42.2(pid=1024): stderr: | (launched: 2022-12-10_18:10:42.216057) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f2803594268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1024): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1024) [trial-2377↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1024)] 18:10:43.347146 tst osmo-nitb_10.42.42.2(pid=1024): stdout: | (launched: 2022-12-10_18:10:42.169251) 18:10:43.473315 tst osmo-nitb_10.42.42.2(pid=1024): stderr: | (launched: 2022-12-10_18:10:42.216057) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:10:43.621535 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=1024): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1024) [trial-2377↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1024)] [trial-2377↪nitb_sms:nanobts↪mo_mt_sms.py:11] 18:10:43.630567 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 18:10:43.637655 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1023): Terminating (SIGTERM) 18:10:43.848622 --- ParallelTerminationStrategy: PID 1023 died... 18:10:43.869790 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1023): Terminated: ok {rc=0} 18:10:43.957601 bus /sierra_3: Setting Powered False 18:10:45.054690 bus /sierra_3: Setting Powered False 18:10:46.174320 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 sms:nanobts+band-1900 --------------------------------------------------------------------- 18:10:47.366684 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:10:47.373408 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:10:47.398843 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 18:10:47.426267 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 18:10:47.479900 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:10:47.504480 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 18:10:47.530844 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 18:10:48.079772 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 18:10:48.085242 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:10:48.096449 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:10:48.135980 tst mo_mt_sms.py: using LAC 29712 18:10:48.252255 tst mo_mt_sms.py: using RAC 132 18:10:48.368696 tst mo_mt_sms.py: using CellId 29712 18:10:48.482621 tst mo_mt_sms.py: using BVCI 29713 18:10:48.587687 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:10:48.598348 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:10:48.608929 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:10:48.619378 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:10:48.629786 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:10:48.640073 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 18:10:48.756891 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 18:10:48.872535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:49.358111 run create_hlr_db(pid=1028): Launched 18:10:49.479774 bus /sierra_2: Setting Powered False 18:10:50.541705 run create_hlr_db(pid=1028): Terminated: ok {rc=0} 18:10:50.962402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1030): Launched 18:10:51.257311 run osmo-hlr_10.42.42.2(pid=1031): Launched 18:10:51.368442 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:51.888875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1033): Launched 18:10:52.181955 run osmo-stp_10.42.42.5(pid=1034): Launched 18:10:52.296092 run osmo-msc_10.42.42.6: Starting osmo-msc 18:10:52.826846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1036): Launched 18:10:53.120776 run osmo-msc_10.42.42.6(pid=1037): Launched 18:10:53.284653 run osmo-stp_10.42.42.5(pid=1034): ERR: Terminated: ERROR {rc=1} [trial-2377↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1034)] 18:10:53.409373 run osmo-stp_10.42.42.5(pid=1034): stdout: | (launched: 2022-12-10_18:10:52.127273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:53.534121 run osmo-stp_10.42.42.5(pid=1034): stderr: | 20221210181052298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181052298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181052298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181052298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181052299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181052299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181052299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:53.656368 run osmo-stp_10.42.42.5(pid=1034): stdout: | (launched: 2022-12-10_18:10:52.127273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:53.772846 run osmo-stp_10.42.42.5(pid=1034): stderr: | 20221210181052298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181052298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181052298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181052298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181052299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181052299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181052299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:53.911837 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=1034): Process ended prematurely: osmo-stp_10.42.42.5(pid=1034) [trial-2377↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1034)] [trial-2377↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 18:10:53.920067 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 18:10:53.945808 run osmo-hlr_10.42.42.2(pid=1031): ERR: Terminated: ERROR {rc=237} [trial-2377↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1031)] 18:10:53.992900 run osmo-hlr_10.42.42.2(pid=1031): stdout: | (launched: 2022-12-10_18:10:51.202184) 18:10:54.042002 run osmo-hlr_10.42.42.2(pid=1031): stderr: | 20221210181051379 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181051379 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181051379 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181051379 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181051379 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181051380 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181051392 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181051400 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181051401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181051401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:54.110348 run osmo-msc_10.42.42.6(pid=1037): ERR: Terminated: ERROR {rc=2} [trial-2377↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1037)] 18:10:54.157434 run osmo-msc_10.42.42.6(pid=1037): stdout: | (launched: 2022-12-10_18:10:53.065387) 18:10:54.206355 run osmo-msc_10.42.42.6(pid=1037): stderr: | 20221210181053337 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210181053338 DLGLOBAL DEBUG validating counter group 0x7ff31d574c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210181053338 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210181053338 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210181053338 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210181053338 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210181053340 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210181053340 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210181053340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210181053340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:10:54.255773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1030): Terminating (SIGTERM) 18:10:54.295154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1033): Terminating (SIGTERM) 18:10:54.334196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1036): Terminating (SIGTERM) 18:10:54.373452 --- ParallelTerminationStrategy: PID 1030 died... 18:10:54.392218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1030): Terminated: ok {rc=0} 18:10:54.435523 --- ParallelTerminationStrategy: PID 1033 died... 18:10:54.453883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1033): Terminated: ok {rc=0} 18:10:54.496917 --- ParallelTerminationStrategy: PID 1036 died... 18:10:54.515912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1036): Terminated: ok {rc=0} 18:10:54.600907 bus /sierra_3: Setting Powered False 18:10:55.700168 bus /sierra_3: Setting Powered False 18:10:56.815590 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 18:10:58.044651 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:10:58.049800 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:10:58.074670 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 18:10:58.082700 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 18:10:58.117798 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:10:58.141181 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 18:10:58.147683 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 18:10:58.668680 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2377 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 18:10:58.673552 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 18:10:58.684277 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:10:58.722334 tst assert_extension.py: using LAC 29713 18:10:58.837430 tst assert_extension.py: using RAC 133 18:10:58.950682 tst assert_extension.py: using CellId 29713 18:10:59.064304 tst assert_extension.py: using BVCI 29714 18:10:59.170540 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 18:10:59.285284 tst assert_extension.py:10: start nitb and bts... 18:10:59.496082 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:11:00.136397 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1042): Launched 18:11:00.450878 run osmo-nitb_10.42.42.2(pid=1043): Launched 18:11:00.627380 run osmo-nitb_10.42.42.2(pid=1043): ERR: Terminated: ERROR {rc=2} [trial-2377↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1043)] 18:11:00.768235 run osmo-nitb_10.42.42.2(pid=1043): stdout: | (launched: 2022-12-10_18:11:00.393410) 18:11:00.948864 run osmo-nitb_10.42.42.2(pid=1043): stderr: | (launched: 2022-12-10_18:11:00.439775) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:11:01.101865 run osmo-nitb_10.42.42.2(pid=1043): stdout: | (launched: 2022-12-10_18:11:00.393410) 18:11:01.242178 run osmo-nitb_10.42.42.2(pid=1043): stderr: | (launched: 2022-12-10_18:11:00.439775) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f2803594268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1043): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1043) [trial-2377↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1043)] 18:11:01.570989 tst osmo-nitb_10.42.42.2(pid=1043): stdout: | (launched: 2022-12-10_18:11:00.393410) 18:11:01.714446 tst osmo-nitb_10.42.42.2(pid=1043): stderr: | (launched: 2022-12-10_18:11:00.439775) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:11:01.882851 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=1043): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1043) [trial-2377↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1043)] [trial-2377↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 18:11:01.891854 tst assert_extension.py:12: Test FAILED (3.2 sec) 18:11:01.899004 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1042): Terminating (SIGTERM) 18:11:02.110629 --- ParallelTerminationStrategy: PID 1042 died... 18:11:02.130387 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1042): Terminated: ok {rc=0} 18:11:02.217040 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 ussd:nanobts+band-1900 --------------------------------------------------------------------- 18:11:03.379159 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:03.384294 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:11:03.408210 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 18:11:03.434489 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 18:11:03.470369 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:11:03.494652 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 18:11:03.523053 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 18:11:04.048159 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2377 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 18:11:04.053975 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:04.065224 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:11:04.103035 tst assert_extension.py: using LAC 29714 18:11:04.218284 tst assert_extension.py: using RAC 134 18:11:04.334666 tst assert_extension.py: using CellId 29714 18:11:04.449351 tst assert_extension.py: using BVCI 29715 18:11:04.554859 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:04.565618 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:04.576148 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:04.586707 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:04.597304 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:04.607724 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 18:11:04.723794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:05.209423 run create_hlr_db(pid=1047): Launched 18:11:05.329692 bus /sierra_2: Setting Powered False 18:11:06.392468 run create_hlr_db(pid=1047): Terminated: ok {rc=0} 18:11:06.813057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1049): Launched 18:11:07.108040 run osmo-hlr_10.42.42.2(pid=1050): Launched 18:11:07.220726 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:07.730917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1052): Launched 18:11:08.025986 run osmo-stp_10.42.42.5(pid=1053): Launched 18:11:08.138004 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:08.669600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1055): Launched 18:11:08.964451 run osmo-msc_10.42.42.6(pid=1056): Launched 18:11:09.129262 run osmo-stp_10.42.42.5(pid=1053): ERR: Terminated: ERROR {rc=1} [trial-2377↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1053)] 18:11:09.254566 run osmo-stp_10.42.42.5(pid=1053): stdout: | (launched: 2022-12-10_18:11:07.970949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:09.379463 run osmo-stp_10.42.42.5(pid=1053): stderr: | 20221210181108143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181108143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181108144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181108144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181108144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181108145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181108145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:09.501682 run osmo-stp_10.42.42.5(pid=1053): stdout: | (launched: 2022-12-10_18:11:07.970949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:09.617917 run osmo-stp_10.42.42.5(pid=1053): stderr: | 20221210181108143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181108143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181108144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181108144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181108144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181108145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181108145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:09.757911 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=1053): Process ended prematurely: osmo-stp_10.42.42.5(pid=1053) [trial-2377↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1053)] [trial-2377↪ussd:nanobts+band-1900↪assert_extension.py:17] 18:11:09.766144 tst assert_extension.py:17: Test FAILED (5.7 sec) 18:11:09.792019 run osmo-hlr_10.42.42.2(pid=1050): ERR: Terminated: ERROR {rc=237} [trial-2377↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1050)] 18:11:09.839409 run osmo-hlr_10.42.42.2(pid=1050): stdout: | (launched: 2022-12-10_18:11:07.053457) 18:11:09.888763 run osmo-hlr_10.42.42.2(pid=1050): stderr: | 20221210181107230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181107230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181107230 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181107230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181107230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181107230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181107242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181107251 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181107251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181107251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:09.957442 run osmo-msc_10.42.42.6(pid=1056): ERR: Terminated: ERROR {rc=2} [trial-2377↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1056)] 18:11:10.005412 run osmo-msc_10.42.42.6(pid=1056): stdout: | (launched: 2022-12-10_18:11:08.908810) 18:11:10.054409 run osmo-msc_10.42.42.6(pid=1056): stderr: | 20221210181109182 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210181109182 DLGLOBAL DEBUG validating counter group 0x7fbf51359c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210181109182 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210181109182 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210181109183 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210181109183 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210181109185 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210181109185 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210181109185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210181109185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:10.104023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1049): Terminating (SIGTERM) 18:11:10.143393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1052): Terminating (SIGTERM) 18:11:10.182491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1055): Terminating (SIGTERM) 18:11:10.222019 --- ParallelTerminationStrategy: PID 1049 died... 18:11:10.241161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1049): Terminated: ok {rc=0} 18:11:10.284879 --- ParallelTerminationStrategy: PID 1052 died... 18:11:10.303887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1052): Terminated: ok {rc=0} 18:11:10.347823 --- ParallelTerminationStrategy: PID 1055 died... 18:11:10.366305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1055): Terminated: ok {rc=0} 18:11:10.449618 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:11:11.651708 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:11.659994 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:11:11.687346 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:11:11.713917 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:11:11.765237 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:11:11.788992 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:11:11.814947 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:11:12.367091 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:11:12.415857 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:12.427152 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:11:12.486372 tst mo_mt_call.py: using LAC 29715 18:11:12.604168 tst mo_mt_call.py: using RAC 135 18:11:12.722558 tst mo_mt_call.py: using CellId 29715 18:11:12.841456 tst mo_mt_call.py: using BVCI 29716 18:11:12.949057 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:12.960232 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:12.971171 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:12.982181 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:12.993323 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:13.004331 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:11:13.119204 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:11:13.238782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:13.733555 run create_hlr_db(pid=1061): Launched 18:11:13.856153 bus /sierra_2: Setting Powered False 18:11:14.919633 run create_hlr_db(pid=1061): Terminated: ok {rc=0} 18:11:15.346635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1063): Launched 18:11:15.645420 run osmo-hlr_10.42.42.2(pid=1064): Launched 18:11:15.759414 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:16.473069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1067): Launched 18:11:16.855309 run osmo-stp_10.42.42.5(pid=1068): Launched 18:11:17.046596 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:17.822667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1070): Launched 18:11:18.143677 run osmo-msc_10.42.42.6(pid=1071): Launched 18:11:18.322641 run osmo-stp_10.42.42.5(pid=1068): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1068)] 18:11:18.457820 run osmo-stp_10.42.42.5(pid=1068): stdout: | (launched: 2022-12-10_18:11:16.795718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:18.593518 run osmo-stp_10.42.42.5(pid=1068): stderr: | 20221210181117152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181117152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181117153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181117155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181117156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181117156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181117156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:18.727837 run osmo-stp_10.42.42.5(pid=1068): stdout: | (launched: 2022-12-10_18:11:16.795718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:18.855164 run osmo-stp_10.42.42.5(pid=1068): stderr: | 20221210181117152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181117152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181117153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181117155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181117156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181117156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181117156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:19.007777 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1068): Process ended prematurely: osmo-stp_10.42.42.5(pid=1068) [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1068)] [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:11:19.017421 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 18:11:19.045910 run osmo-hlr_10.42.42.2(pid=1064): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1064)] 18:11:19.096392 run osmo-hlr_10.42.42.2(pid=1064): stdout: | (launched: 2022-12-10_18:11:15.590161) 18:11:19.148310 run osmo-hlr_10.42.42.2(pid=1064): stderr: | 20221210181115768 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181115768 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181115768 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181115768 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181115768 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181115768 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181115780 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181115790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181115791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181115791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:19.220926 run osmo-msc_10.42.42.6(pid=1071): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1071)] 18:11:19.271536 run osmo-msc_10.42.42.6(pid=1071): stdout: | (launched: 2022-12-10_18:11:18.084168) 18:11:19.323360 run osmo-msc_10.42.42.6(pid=1071): stderr: | 20221210181118408 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210181118408 DLGLOBAL DEBUG validating counter group 0x7f5ae4990c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210181118408 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210181118408 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210181118408 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210181118409 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210181118410 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210181118411 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210181118411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210181118411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:19.375591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1063): Terminating (SIGTERM) 18:11:19.417244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1067): Terminating (SIGTERM) 18:11:19.459514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1070): Terminating (SIGTERM) 18:11:19.501890 --- ParallelTerminationStrategy: PID 1063 died... 18:11:19.522268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1063): Terminated: ok {rc=0} 18:11:19.568709 --- ParallelTerminationStrategy: PID 1067 died... 18:11:19.588085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1067): Terminated: ok {rc=0} 18:11:19.634181 --- ParallelTerminationStrategy: PID 1070 died... 18:11:19.653580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1070): Terminated: ok {rc=0} 18:11:19.741838 bus /sierra_3: Setting Powered False 18:11:20.839129 bus /sierra_3: Setting Powered False 18:11:21.954316 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:11:23.103194 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:23.115503 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:11:23.177391 tst mo_mt_call_osmux.py: using LAC 29716 18:11:23.302355 tst mo_mt_call_osmux.py: using RAC 136 18:11:23.425580 tst mo_mt_call_osmux.py: using CellId 29716 18:11:23.542585 tst mo_mt_call_osmux.py: using BVCI 29717 18:11:23.650458 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:23.661780 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:23.673008 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:23.684134 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:23.695344 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:23.706392 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:11:23.824748 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:11:23.940697 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:24.403762 run create_hlr_db(pid=1073): Launched 18:11:24.527102 bus /sierra_2: Setting Powered False 18:11:25.586667 run create_hlr_db(pid=1073): Terminated: ok {rc=0} 18:11:26.023290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1075): Launched 18:11:26.345364 run osmo-hlr_10.42.42.2(pid=1076): Launched 18:11:26.469074 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:27.019924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1078): Launched 18:11:27.341320 run osmo-stp_10.42.42.5(pid=1079): Launched 18:11:27.463616 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:28.045239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1081): Launched 18:11:28.367658 run osmo-msc_10.42.42.6(pid=1082): Launched 18:11:28.546934 run osmo-stp_10.42.42.5(pid=1079): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1079)] 18:11:28.681882 run osmo-stp_10.42.42.5(pid=1079): stdout: | (launched: 2022-12-10_18:11:27.281862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:28.817122 run osmo-stp_10.42.42.5(pid=1079): stderr: | 20221210181127477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181127477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181127478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181127478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181127479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181127479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181127479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:28.951704 run osmo-stp_10.42.42.5(pid=1079): stdout: | (launched: 2022-12-10_18:11:27.281862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:29.079051 run osmo-stp_10.42.42.5(pid=1079): stderr: | 20221210181127477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181127477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181127478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181127478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181127479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181127479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181127479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:29.231165 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1079): Process ended prematurely: osmo-stp_10.42.42.5(pid=1079) [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1079)] [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:11:29.241145 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:11:29.269534 run osmo-hlr_10.42.42.2(pid=1076): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1076)] 18:11:29.319850 run osmo-hlr_10.42.42.2(pid=1076): stdout: | (launched: 2022-12-10_18:11:26.286527) 18:11:29.371709 run osmo-hlr_10.42.42.2(pid=1076): stderr: | 20221210181126485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181126485 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181126485 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181126485 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181126485 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181126486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181126497 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181126506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181126506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181126506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:29.443817 run osmo-msc_10.42.42.6(pid=1082): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1082)] 18:11:29.493853 run osmo-msc_10.42.42.6(pid=1082): stdout: | (launched: 2022-12-10_18:11:28.307843) 18:11:29.545556 run osmo-msc_10.42.42.6(pid=1082): stderr: | 20221210181128632 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210181128633 DLGLOBAL DEBUG validating counter group 0x7f51f006ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210181128633 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210181128633 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210181128633 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210181128633 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210181128635 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210181128635 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210181128635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210181128636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:29.597632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1075): Terminating (SIGTERM) 18:11:29.639230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1078): Terminating (SIGTERM) 18:11:29.680836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1081): Terminating (SIGTERM) 18:11:29.723148 --- ParallelTerminationStrategy: PID 1075 died... 18:11:29.742956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1075): Terminated: ok {rc=0} 18:11:29.789304 --- ParallelTerminationStrategy: PID 1078 died... 18:11:29.808729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1078): Terminated: ok {rc=0} 18:11:29.854820 --- ParallelTerminationStrategy: PID 1081 died... 18:11:29.874358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1081): Terminated: ok {rc=0} 18:11:29.962741 bus /sierra_3: Setting Powered False 18:11:31.059395 bus /sierra_3: Setting Powered False 18:11:32.184081 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:11:33.433716 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:33.441931 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:11:33.466572 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:11:33.494217 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:11:33.546424 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:11:33.570786 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:11:33.597761 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:11:34.151371 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:11:34.202956 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:34.214559 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:11:34.275648 tst mo_mt_call.py: using LAC 29717 18:11:34.401224 tst mo_mt_call.py: using RAC 137 18:11:34.526563 tst mo_mt_call.py: using CellId 29717 18:11:34.653049 tst mo_mt_call.py: using BVCI 29718 18:11:34.770168 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:34.781787 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:34.793203 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:34.804828 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:34.816643 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:34.828192 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:11:34.946205 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:11:35.061356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:35.527379 run create_hlr_db(pid=1087): Launched 18:11:35.650925 bus /sierra_2: Setting Powered False 18:11:36.710824 run create_hlr_db(pid=1087): Terminated: ok {rc=0} 18:11:37.147915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1089): Launched 18:11:37.469019 run osmo-hlr_10.42.42.2(pid=1090): Launched 18:11:37.591142 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:38.145430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1092): Launched 18:11:38.467080 run osmo-stp_10.42.42.5(pid=1093): Launched 18:11:38.588411 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:39.167405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1095): Launched 18:11:39.489061 run osmo-msc_10.42.42.6(pid=1096): Launched 18:11:39.669860 run osmo-stp_10.42.42.5(pid=1093): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1093)] 18:11:39.804775 run osmo-stp_10.42.42.5(pid=1093): stdout: | (launched: 2022-12-10_18:11:38.407013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:39.942192 run osmo-stp_10.42.42.5(pid=1093): stderr: | 20221210181138599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181138600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181138600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181138600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181138601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181138601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181138601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:40.077899 run osmo-stp_10.42.42.5(pid=1093): stdout: | (launched: 2022-12-10_18:11:38.407013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:40.205137 run osmo-stp_10.42.42.5(pid=1093): stderr: | 20221210181138599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181138600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181138600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181138600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181138601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181138601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181138601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:40.357628 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1093): Process ended prematurely: osmo-stp_10.42.42.5(pid=1093) [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1093)] [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:11:40.367488 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:11:40.395896 run osmo-hlr_10.42.42.2(pid=1090): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1090)] 18:11:40.446348 run osmo-hlr_10.42.42.2(pid=1090): stdout: | (launched: 2022-12-10_18:11:37.409247) 18:11:40.498184 run osmo-hlr_10.42.42.2(pid=1090): stderr: | 20221210181137610 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181137610 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181137610 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181137610 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181137610 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181137610 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181137622 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181137630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181137631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181137631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:40.570700 run osmo-msc_10.42.42.6(pid=1096): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1096)] 18:11:40.620841 run osmo-msc_10.42.42.6(pid=1096): stdout: | (launched: 2022-12-10_18:11:39.430113) 18:11:40.672803 run osmo-msc_10.42.42.6(pid=1096): stderr: | 20221210181139751 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210181139751 DLGLOBAL DEBUG validating counter group 0x7f543fb67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210181139751 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210181139751 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210181139751 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210181139752 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210181139753 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210181139754 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210181139754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210181139754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:40.724655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1089): Terminating (SIGTERM) 18:11:40.766472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1092): Terminating (SIGTERM) 18:11:40.808288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1095): Terminating (SIGTERM) 18:11:40.850937 --- ParallelTerminationStrategy: PID 1089 died... 18:11:40.870823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1089): Terminated: ok {rc=0} 18:11:40.917461 --- ParallelTerminationStrategy: PID 1092 died... 18:11:40.936841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1092): Terminated: ok {rc=0} 18:11:40.983442 --- ParallelTerminationStrategy: PID 1095 died... 18:11:41.003016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1095): Terminated: ok {rc=0} 18:11:41.090085 bus /sierra_3: Setting Powered False 18:11:42.189422 bus /sierra_3: Setting Powered False 18:11:43.308737 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:11:44.456840 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:44.469356 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:11:44.530377 tst mo_mt_call_osmux.py: using LAC 29718 18:11:44.653219 tst mo_mt_call_osmux.py: using RAC 138 18:11:44.775735 tst mo_mt_call_osmux.py: using CellId 29718 18:11:44.900039 tst mo_mt_call_osmux.py: using BVCI 29719 18:11:45.015496 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:45.027128 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:45.038597 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:45.050796 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:45.062627 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:45.074334 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:11:45.190296 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:11:45.308352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:45.803992 run create_hlr_db(pid=1098): Launched 18:11:45.955815 bus /sierra_2: Setting Powered False 18:11:47.014184 run create_hlr_db(pid=1098): Terminated: ok {rc=0} 18:11:47.456079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1100): Launched 18:11:47.759588 run osmo-hlr_10.42.42.2(pid=1101): Launched 18:11:47.873586 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:48.387438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1103): Launched 18:11:48.688005 run osmo-stp_10.42.42.5(pid=1104): Launched 18:11:48.803050 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:49.346396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1106): Launched 18:11:49.646780 run osmo-msc_10.42.42.6(pid=1107): Launched 18:11:49.814997 run osmo-stp_10.42.42.5(pid=1104): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1104)] 18:11:49.941976 run osmo-stp_10.42.42.5(pid=1104): stdout: | (launched: 2022-12-10_18:11:48.632861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:50.069316 run osmo-stp_10.42.42.5(pid=1104): stderr: | 20221210181148802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181148803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181148803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181148803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181148804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181148804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181148804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:50.194253 run osmo-stp_10.42.42.5(pid=1104): stdout: | (launched: 2022-12-10_18:11:48.632861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:50.313662 run osmo-stp_10.42.42.5(pid=1104): stderr: | 20221210181148802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181148803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181148803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181148803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181148804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181148804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181148804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:50.456145 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1104): Process ended prematurely: osmo-stp_10.42.42.5(pid=1104) [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1104)] [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:11:50.464995 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 18:11:50.491479 run osmo-hlr_10.42.42.2(pid=1101): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1101)] 18:11:50.538728 run osmo-hlr_10.42.42.2(pid=1101): stdout: | (launched: 2022-12-10_18:11:47.704141) 18:11:50.588461 run osmo-hlr_10.42.42.2(pid=1101): stderr: | 20221210181147881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181147881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181147881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181147881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181147881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181147881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181147893 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181147903 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181147903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181147903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:50.657335 run osmo-msc_10.42.42.6(pid=1107): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1107)] 18:11:50.705240 run osmo-msc_10.42.42.6(pid=1107): stdout: | (launched: 2022-12-10_18:11:49.590495) 18:11:50.754381 run osmo-msc_10.42.42.6(pid=1107): stderr: | 20221210181149867 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210181149867 DLGLOBAL DEBUG validating counter group 0x7fbfa8e98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210181149867 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210181149867 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210181149867 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210181149867 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210181149869 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210181149870 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210181149870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210181149870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:50.803730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1100): Terminating (SIGTERM) 18:11:50.842938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1103): Terminating (SIGTERM) 18:11:50.881866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1106): Terminating (SIGTERM) 18:11:50.920929 --- ParallelTerminationStrategy: PID 1100 died... 18:11:50.939812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1100): Terminated: ok {rc=0} 18:11:50.983385 --- ParallelTerminationStrategy: PID 1103 died... 18:11:51.001734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1103): Terminated: ok {rc=0} 18:11:51.045247 --- ParallelTerminationStrategy: PID 1106 died... 18:11:51.063668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1106): Terminated: ok {rc=0} 18:11:51.149359 bus /sierra_3: Setting Powered False 18:11:52.248631 bus /sierra_3: Setting Powered False 18:11:53.363545 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:11:54.602413 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:54.609524 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:11:54.633335 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:11:54.660033 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:11:54.711676 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:11:54.735618 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:11:54.762041 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:11:55.313719 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:11:55.368149 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:11:55.379983 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:11:55.441582 tst mo_mt_call.py: using LAC 29719 18:11:55.568570 tst mo_mt_call.py: using RAC 139 18:11:55.687497 tst mo_mt_call.py: using CellId 29719 18:11:55.807511 tst mo_mt_call.py: using BVCI 29720 18:11:55.917721 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:11:55.928884 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:11:55.939928 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:11:55.950906 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:11:55.962037 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:11:55.972872 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:11:56.090084 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:11:56.205624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:56.671111 run create_hlr_db(pid=1112): Launched 18:11:56.794206 bus /sierra_2: Setting Powered False 18:11:57.853743 run create_hlr_db(pid=1112): Terminated: ok {rc=0} 18:11:58.289890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1115): Launched 18:11:58.611111 run osmo-hlr_10.42.42.2(pid=1116): Launched 18:11:58.734875 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:59.288572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1118): Launched 18:11:59.608545 run osmo-stp_10.42.42.5(pid=1120): Launched 18:11:59.730569 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:00.312776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1122): Launched 18:12:00.632612 run osmo-msc_10.42.42.6(pid=1123): Launched 18:12:00.811471 run osmo-stp_10.42.42.5(pid=1120): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1120)] 18:12:01.046010 run osmo-stp_10.42.42.5(pid=1120): stdout: | (launched: 2022-12-10_18:11:59.549250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:01.201430 run osmo-stp_10.42.42.5(pid=1120): stderr: | 20221210181159743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181159743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181159743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181159744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181159744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181159744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181159744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:01.330174 run osmo-stp_10.42.42.5(pid=1120): stdout: | (launched: 2022-12-10_18:11:59.549250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:01.452910 run osmo-stp_10.42.42.5(pid=1120): stderr: | 20221210181159743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181159743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181159743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181159744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181159744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181159744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181159744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:01.601233 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1120): Process ended prematurely: osmo-stp_10.42.42.5(pid=1120) [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1120)] [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:12:01.610565 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:12:01.637805 run osmo-hlr_10.42.42.2(pid=1116): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1116)] 18:12:01.688535 run osmo-hlr_10.42.42.2(pid=1116): stdout: | (launched: 2022-12-10_18:11:58.552277) 18:12:01.739143 run osmo-hlr_10.42.42.2(pid=1116): stderr: | 20221210181158749 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181158750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181158750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181158750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181158750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181158750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181158762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181158772 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181158773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181158773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:01.809940 run osmo-msc_10.42.42.6(pid=1123): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1123)] 18:12:01.859395 run osmo-msc_10.42.42.6(pid=1123): stdout: | (launched: 2022-12-10_18:12:00.573722) 18:12:01.911543 run osmo-msc_10.42.42.6(pid=1123): stderr: | 20221210181200943 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210181200943 DLGLOBAL DEBUG validating counter group 0x7f3f77a78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210181200943 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210181200943 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210181200943 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210181200943 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210181200949 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210181200950 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210181200950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210181200950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:01.963241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1115): Terminating (SIGTERM) 18:12:02.004308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1118): Terminating (SIGTERM) 18:12:02.047324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1122): Terminating (SIGTERM) 18:12:02.091543 --- ParallelTerminationStrategy: PID 1115 died... 18:12:02.111095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1115): Terminated: ok {rc=0} 18:12:02.157365 --- ParallelTerminationStrategy: PID 1118 died... 18:12:02.176455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1118): Terminated: ok {rc=0} 18:12:02.221331 --- ParallelTerminationStrategy: PID 1122 died... 18:12:02.240343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1122): Terminated: ok {rc=0} 18:12:02.326435 bus /sierra_3: Setting Powered False 18:12:03.424170 bus /sierra_3: Setting Powered False 18:12:04.539353 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:12:05.687314 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:05.699704 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:12:05.762421 tst mo_mt_call_osmux.py: using LAC 29720 18:12:05.887753 tst mo_mt_call_osmux.py: using RAC 140 18:12:06.014234 tst mo_mt_call_osmux.py: using CellId 29720 18:12:06.141380 tst mo_mt_call_osmux.py: using BVCI 29721 18:12:06.259312 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:06.271426 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:06.283120 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:06.294942 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:06.306915 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:06.318759 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:12:06.436038 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:12:06.555804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:07.051752 run create_hlr_db(pid=1129): Launched 18:12:07.175405 bus /sierra_2: Setting Powered False 18:12:08.239463 run create_hlr_db(pid=1129): Terminated: ok {rc=0} 18:12:08.684083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1131): Launched 18:12:09.005708 run osmo-hlr_10.42.42.2(pid=1132): Launched 18:12:09.128231 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:09.679334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1139): Launched 18:12:10.000136 run osmo-stp_10.42.42.5(pid=1140): Launched 18:12:10.124266 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:10.710225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1142): Launched 18:12:11.033382 run osmo-msc_10.42.42.6(pid=1144): Launched 18:12:11.214081 run osmo-stp_10.42.42.5(pid=1140): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1140)] 18:12:11.349947 run osmo-stp_10.42.42.5(pid=1140): stdout: | (launched: 2022-12-10_18:12:09.941201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:11.485504 run osmo-stp_10.42.42.5(pid=1140): stderr: | 20221210181210132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181210132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181210132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181210133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181210133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181210133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181210133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:11.620440 run osmo-stp_10.42.42.5(pid=1140): stdout: | (launched: 2022-12-10_18:12:09.941201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:11.747683 run osmo-stp_10.42.42.5(pid=1140): stderr: | 20221210181210132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181210132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181210132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181210133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181210133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181210133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181210133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:11.900320 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1140): Process ended prematurely: osmo-stp_10.42.42.5(pid=1140) [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1140)] [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:12:11.910000 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:12:11.938486 run osmo-hlr_10.42.42.2(pid=1132): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1132)] 18:12:11.988619 run osmo-hlr_10.42.42.2(pid=1132): stdout: | (launched: 2022-12-10_18:12:08.946962) 18:12:12.040332 run osmo-hlr_10.42.42.2(pid=1132): stderr: | 20221210181209146 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181209146 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181209146 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181209147 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181209147 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181209147 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181209158 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181209167 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181209167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181209167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:12.112787 run osmo-msc_10.42.42.6(pid=1144): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1144)] 18:12:12.162831 run osmo-msc_10.42.42.6(pid=1144): stdout: | (launched: 2022-12-10_18:12:10.974423) 18:12:12.214925 run osmo-msc_10.42.42.6(pid=1144): stderr: | 20221210181211296 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210181211296 DLGLOBAL DEBUG validating counter group 0x7fc3f1fdfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210181211296 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210181211296 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210181211296 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210181211297 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210181211298 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210181211299 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210181211299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210181211299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:12.267741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1131): Terminating (SIGTERM) 18:12:12.309641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1139): Terminating (SIGTERM) 18:12:12.351387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1142): Terminating (SIGTERM) 18:12:12.393581 --- ParallelTerminationStrategy: PID 1131 died... 18:12:12.413484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1131): Terminated: ok {rc=0} 18:12:12.460030 --- ParallelTerminationStrategy: PID 1139 died... 18:12:12.479520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1139): Terminated: ok {rc=0} 18:12:12.525806 --- ParallelTerminationStrategy: PID 1142 died... 18:12:12.545235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1142): Terminated: ok {rc=0} 18:12:12.632831 bus /sierra_3: Setting Powered False 18:12:13.729963 bus /sierra_3: Setting Powered False 18:12:14.844729 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:12:16.103727 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:12:16.116047 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:12:16.152796 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:12:16.187645 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:12:16.258065 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:12:16.297865 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:12:16.332142 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:12:16.855800 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:12:16.907418 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:16.919866 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:12:16.980040 tst mo_mt_call.py: using LAC 29721 18:12:17.120852 tst mo_mt_call.py: using RAC 141 18:12:17.245941 tst mo_mt_call.py: using CellId 29721 18:12:17.372197 tst mo_mt_call.py: using BVCI 29722 18:12:17.488446 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:17.500140 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:17.511604 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:17.523821 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:17.535986 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:17.547980 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:12:17.665395 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:12:17.780220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:18.243825 run create_hlr_db(pid=1149): Launched 18:12:18.367506 bus /sierra_2: Setting Powered False 18:12:19.426577 run create_hlr_db(pid=1149): Terminated: ok {rc=0} 18:12:19.862240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1151): Launched 18:12:20.183188 run osmo-hlr_10.42.42.2(pid=1152): Launched 18:12:20.304506 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:20.856592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1154): Launched 18:12:21.178313 run osmo-stp_10.42.42.5(pid=1155): Launched 18:12:21.301782 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:21.878398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1157): Launched 18:12:22.200122 run osmo-msc_10.42.42.6(pid=1158): Launched 18:12:22.378935 run osmo-stp_10.42.42.5(pid=1155): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1155)] 18:12:22.513548 run osmo-stp_10.42.42.5(pid=1155): stdout: | (launched: 2022-12-10_18:12:21.119562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:22.648397 run osmo-stp_10.42.42.5(pid=1155): stderr: | 20221210181221312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181221312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181221313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181221313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181221313 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181221313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181221314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:22.783480 run osmo-stp_10.42.42.5(pid=1155): stdout: | (launched: 2022-12-10_18:12:21.119562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:22.910783 run osmo-stp_10.42.42.5(pid=1155): stderr: | 20221210181221312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181221312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181221313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181221313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181221313 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181221313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181221314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:23.063553 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1155): Process ended prematurely: osmo-stp_10.42.42.5(pid=1155) [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1155)] [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:12:23.073175 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:12:23.102173 run osmo-hlr_10.42.42.2(pid=1152): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1152)] 18:12:23.153107 run osmo-hlr_10.42.42.2(pid=1152): stdout: | (launched: 2022-12-10_18:12:20.124306) 18:12:23.205574 run osmo-hlr_10.42.42.2(pid=1152): stderr: | 20221210181220323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181220323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181220323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181220323 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181220323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181220323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181220335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181220344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181220344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181220344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:23.278837 run osmo-msc_10.42.42.6(pid=1158): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1158)] 18:12:23.329524 run osmo-msc_10.42.42.6(pid=1158): stdout: | (launched: 2022-12-10_18:12:22.140782) 18:12:23.381496 run osmo-msc_10.42.42.6(pid=1158): stderr: | 20221210181222460 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210181222460 DLGLOBAL DEBUG validating counter group 0x7f2e3ddedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210181222460 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210181222461 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210181222461 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210181222461 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210181222463 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210181222463 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210181222463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210181222463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:23.433928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1151): Terminating (SIGTERM) 18:12:23.475928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1154): Terminating (SIGTERM) 18:12:23.517808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1157): Terminating (SIGTERM) 18:12:23.560262 --- ParallelTerminationStrategy: PID 1151 died... 18:12:23.580230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1151): Terminated: ok {rc=0} 18:12:23.627196 --- ParallelTerminationStrategy: PID 1154 died... 18:12:23.646757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1154): Terminated: ok {rc=0} 18:12:23.693338 --- ParallelTerminationStrategy: PID 1157 died... 18:12:23.712864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1157): Terminated: ok {rc=0} 18:12:23.800889 bus /sierra_3: Setting Powered False 18:12:24.899464 bus /sierra_3: Setting Powered False 18:12:26.014847 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:12:27.156738 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:27.168542 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:12:27.228747 tst mo_mt_call_osmux.py: using LAC 29722 18:12:27.346666 tst mo_mt_call_osmux.py: using RAC 142 18:12:27.464020 tst mo_mt_call_osmux.py: using CellId 29722 18:12:27.592094 tst mo_mt_call_osmux.py: using BVCI 29723 18:12:27.700764 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:27.711994 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:27.723042 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:27.734043 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:27.745082 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:27.756088 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:12:27.869972 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:12:27.985048 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:28.451731 run create_hlr_db(pid=1160): Launched 18:12:28.575229 bus /sierra_2: Setting Powered False 18:12:29.635240 run create_hlr_db(pid=1160): Terminated: ok {rc=0} 18:12:30.071703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1162): Launched 18:12:30.393411 run osmo-hlr_10.42.42.2(pid=1163): Launched 18:12:30.517342 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:31.104446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1165): Launched 18:12:31.460673 run osmo-stp_10.42.42.5(pid=1166): Launched 18:12:31.601136 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:32.455373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1168): Launched 18:12:32.778196 run osmo-msc_10.42.42.6(pid=1169): Launched 18:12:32.956680 run osmo-stp_10.42.42.5(pid=1166): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1166)] 18:12:33.091662 run osmo-stp_10.42.42.5(pid=1166): stdout: | (launched: 2022-12-10_18:12:31.400465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:33.226986 run osmo-stp_10.42.42.5(pid=1166): stderr: | 20221210181231751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181231752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181231752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181231754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181231758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181231760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181231760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:33.361926 run osmo-stp_10.42.42.5(pid=1166): stdout: | (launched: 2022-12-10_18:12:31.400465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:33.490045 run osmo-stp_10.42.42.5(pid=1166): stderr: | 20221210181231751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181231752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181231752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181231754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181231758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181231760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181231760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:33.642944 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1166): Process ended prematurely: osmo-stp_10.42.42.5(pid=1166) [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1166)] [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:12:33.652724 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 18:12:33.682026 run osmo-hlr_10.42.42.2(pid=1163): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1163)] 18:12:33.732896 run osmo-hlr_10.42.42.2(pid=1163): stdout: | (launched: 2022-12-10_18:12:30.334250) 18:12:33.785510 run osmo-hlr_10.42.42.2(pid=1163): stderr: | 20221210181230532 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181230532 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181230532 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181230532 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181230532 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181230532 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181230544 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181230553 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181230553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181230553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:33.858776 run osmo-msc_10.42.42.6(pid=1169): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1169)] 18:12:33.909878 run osmo-msc_10.42.42.6(pid=1169): stdout: | (launched: 2022-12-10_18:12:32.718246) 18:12:33.962171 run osmo-msc_10.42.42.6(pid=1169): stderr: | 20221210181233042 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210181233042 DLGLOBAL DEBUG validating counter group 0x7fc358b93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210181233042 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210181233042 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210181233042 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210181233043 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210181233044 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210181233045 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210181233045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210181233045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:34.015112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1162): Terminating (SIGTERM) 18:12:34.057529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1165): Terminating (SIGTERM) 18:12:34.099843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1168): Terminating (SIGTERM) 18:12:34.142412 --- ParallelTerminationStrategy: PID 1162 died... 18:12:34.162556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1162): Terminated: ok {rc=0} 18:12:34.209962 --- ParallelTerminationStrategy: PID 1165 died... 18:12:34.229739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1165): Terminated: ok {rc=0} 18:12:34.277058 --- ParallelTerminationStrategy: PID 1168 died... 18:12:34.296761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1168): Terminated: ok {rc=0} 18:12:34.385484 bus /sierra_3: Setting Powered False 18:12:35.484008 bus /sierra_3: Setting Powered False 18:12:36.599115 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:12:37.838270 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:12:37.845902 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:12:37.869791 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:12:37.896845 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:12:37.949288 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:12:37.973844 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:12:38.000237 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:12:38.550843 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:12:38.598558 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:38.609937 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:12:38.669608 tst mo_mt_call.py: using LAC 29723 18:12:38.786061 tst mo_mt_call.py: using RAC 143 18:12:38.904724 tst mo_mt_call.py: using CellId 29723 18:12:39.021292 tst mo_mt_call.py: using BVCI 29724 18:12:39.129540 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:39.140664 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:39.151891 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:39.163006 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:39.174236 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:39.185391 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:12:39.302848 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:12:39.418321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:39.913274 run create_hlr_db(pid=1177): Launched 18:12:40.035340 bus /sierra_2: Setting Powered False 18:12:41.098848 run create_hlr_db(pid=1177): Terminated: ok {rc=0} 18:12:41.526057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1179): Launched 18:12:41.825403 run osmo-hlr_10.42.42.2(pid=1180): Launched 18:12:41.939458 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:42.469347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1182): Launched 18:12:42.768244 run osmo-stp_10.42.42.5(pid=1183): Launched 18:12:42.882645 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:43.426915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1185): Launched 18:12:43.728203 run osmo-msc_10.42.42.6(pid=1186): Launched 18:12:43.895370 run osmo-stp_10.42.42.5(pid=1183): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1183)] 18:12:44.021947 run osmo-stp_10.42.42.5(pid=1183): stdout: | (launched: 2022-12-10_18:12:42.712517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:44.148463 run osmo-stp_10.42.42.5(pid=1183): stderr: | 20221210181242885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181242886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181242886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181242886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181242887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181242887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181242887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:44.272920 run osmo-stp_10.42.42.5(pid=1183): stdout: | (launched: 2022-12-10_18:12:42.712517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:44.391722 run osmo-stp_10.42.42.5(pid=1183): stderr: | 20221210181242885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181242886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181242886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181242886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181242887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181242887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181242887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:44.534100 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1183): Process ended prematurely: osmo-stp_10.42.42.5(pid=1183) [trial-2377↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1183)] [trial-2377↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:12:44.543064 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 18:12:44.569417 run osmo-hlr_10.42.42.2(pid=1180): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1180)] 18:12:44.617437 run osmo-hlr_10.42.42.2(pid=1180): stdout: | (launched: 2022-12-10_18:12:41.769841) 18:12:44.666401 run osmo-hlr_10.42.42.2(pid=1180): stderr: | 20221210181241947 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181241947 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181241947 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181241947 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181241947 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181241947 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181241960 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181241969 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181241969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181241969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:44.735124 run osmo-msc_10.42.42.6(pid=1186): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1186)] 18:12:44.782561 run osmo-msc_10.42.42.6(pid=1186): stdout: | (launched: 2022-12-10_18:12:43.672175) 18:12:44.831432 run osmo-msc_10.42.42.6(pid=1186): stderr: | 20221210181243945 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210181243945 DLGLOBAL DEBUG validating counter group 0x7fbd07a14c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210181243945 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210181243945 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210181243946 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210181243947 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210181243949 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210181243949 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210181243949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210181243949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:44.880806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1179): Terminating (SIGTERM) 18:12:44.919981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1182): Terminating (SIGTERM) 18:12:44.959085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1185): Terminating (SIGTERM) 18:12:44.998492 --- ParallelTerminationStrategy: PID 1179 died... 18:12:45.017175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1179): Terminated: ok {rc=0} 18:12:45.060888 --- ParallelTerminationStrategy: PID 1182 died... 18:12:45.079344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1182): Terminated: ok {rc=0} 18:12:45.122985 --- ParallelTerminationStrategy: PID 1185 died... 18:12:45.141602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1185): Terminated: ok {rc=0} 18:12:45.224698 bus /sierra_3: Setting Powered False 18:12:46.318620 bus /sierra_3: Setting Powered False 18:12:47.432607 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:12:48.578030 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:48.589970 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:12:48.650351 tst mo_mt_call_osmux.py: using LAC 29724 18:12:48.767735 tst mo_mt_call_osmux.py: using RAC 144 18:12:48.886665 tst mo_mt_call_osmux.py: using CellId 29724 18:12:49.005394 tst mo_mt_call_osmux.py: using BVCI 29725 18:12:49.113332 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:49.124455 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:49.135603 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:49.146678 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:49.157833 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:49.169337 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:12:49.283908 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:12:49.399891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:49.864018 run create_hlr_db(pid=1188): Launched 18:12:49.985977 bus /sierra_2: Setting Powered False 18:12:51.045286 run create_hlr_db(pid=1188): Terminated: ok {rc=0} 18:12:51.463038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1190): Launched 18:12:51.762729 run osmo-hlr_10.42.42.2(pid=1191): Launched 18:12:51.876591 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:52.421397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1193): Launched 18:12:52.722246 run osmo-stp_10.42.42.5(pid=1194): Launched 18:12:52.838602 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:53.398970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1196): Launched 18:12:53.699158 run osmo-msc_10.42.42.6(pid=1197): Launched 18:12:53.866925 run osmo-stp_10.42.42.5(pid=1194): ERR: Terminated: ERROR {rc=1} [trial-2377↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1194)] 18:12:53.993378 run osmo-stp_10.42.42.5(pid=1194): stdout: | (launched: 2022-12-10_18:12:52.665990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:54.120055 run osmo-stp_10.42.42.5(pid=1194): stderr: | 20221210181252838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181252838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181252838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181252839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181252839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181252839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181252839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:54.244651 run osmo-stp_10.42.42.5(pid=1194): stdout: | (launched: 2022-12-10_18:12:52.665990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:54.363203 run osmo-stp_10.42.42.5(pid=1194): stderr: | 20221210181252838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181252838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181252838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181252839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181252839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181252839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181252839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:54.505754 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1194): Process ended prematurely: osmo-stp_10.42.42.5(pid=1194) [trial-2377↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1194)] [trial-2377↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:12:54.514382 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 18:12:54.540536 run osmo-hlr_10.42.42.2(pid=1191): ERR: Terminated: ERROR {rc=237} [trial-2377↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1191)] 18:12:54.587710 run osmo-hlr_10.42.42.2(pid=1191): stdout: | (launched: 2022-12-10_18:12:51.707152) 18:12:54.636632 run osmo-hlr_10.42.42.2(pid=1191): stderr: | 20221210181251886 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181251886 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181251886 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181251886 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181251886 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181251886 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181251908 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181251926 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181251926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181251926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:54.705365 run osmo-msc_10.42.42.6(pid=1197): ERR: Terminated: ERROR {rc=2} [trial-2377↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1197)] 18:12:54.752160 run osmo-msc_10.42.42.6(pid=1197): stdout: | (launched: 2022-12-10_18:12:53.643246) 18:12:54.800448 run osmo-msc_10.42.42.6(pid=1197): stderr: | 20221210181253919 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210181253919 DLGLOBAL DEBUG validating counter group 0x7f6c17636c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210181253920 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210181253920 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210181253920 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210181253920 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210181253922 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210181253922 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210181253922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210181253922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:54.849448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1190): Terminating (SIGTERM) 18:12:54.888519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1193): Terminating (SIGTERM) 18:12:54.927371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1196): Terminating (SIGTERM) 18:12:54.966517 --- ParallelTerminationStrategy: PID 1190 died... 18:12:54.985119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1190): Terminated: ok {rc=0} 18:12:55.028458 --- ParallelTerminationStrategy: PID 1193 died... 18:12:55.046880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1193): Terminated: ok {rc=0} 18:12:55.090050 --- ParallelTerminationStrategy: PID 1196 died... 18:12:55.108573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1196): Terminated: ok {rc=0} 18:12:55.190779 bus /sierra_3: Setting Powered False 18:12:56.289187 bus /sierra_3: Setting Powered False 18:12:57.404286 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 emergency:nanobts+band-1900 --------------------------------------------------------------------- 18:12:58.636295 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:12:58.641692 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:12:58.665376 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 18:12:58.691780 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 18:12:58.775815 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:12:58.799286 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 18:12:58.825648 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 18:12:59.414851 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2377 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 18:12:59.420494 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:12:59.431917 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:12:59.473255 tst emergency_mo_mt_call.py: using LAC 29725 18:12:59.588788 tst emergency_mo_mt_call.py: using RAC 145 18:12:59.703226 tst emergency_mo_mt_call.py: using CellId 29725 18:12:59.817498 tst emergency_mo_mt_call.py: using BVCI 29726 18:12:59.934179 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:12:59.945670 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:12:59.957062 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:12:59.969201 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:12:59.981169 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:12:59.993161 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:00.112893 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:00.227185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:00.683166 run create_hlr_db(pid=1202): Launched 18:13:00.803818 bus /sierra_2: Setting Powered False 18:13:01.862455 run create_hlr_db(pid=1202): Terminated: ok {rc=0} 18:13:02.304046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1204): Launched 18:13:02.608817 run osmo-hlr_10.42.42.2(pid=1205): Launched 18:13:02.720052 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:03.224283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1207): Launched 18:13:03.520193 run osmo-stp_10.42.42.5(pid=1208): Launched 18:13:03.644705 tst emergency_mo_mt_call.py: using MSISDN 7831 18:13:03.794515 run osmo-msc_10.42.42.6: Starting osmo-msc 18:13:04.323643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1210): Launched 18:13:04.618567 run osmo-msc_10.42.42.6(pid=1211): Launched 18:13:04.783812 run osmo-stp_10.42.42.5(pid=1208): ERR: Terminated: ERROR {rc=1} [trial-2377↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1208)] 18:13:04.908115 run osmo-stp_10.42.42.5(pid=1208): stdout: | (launched: 2022-12-10_18:13:03.464533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:05.033584 run osmo-stp_10.42.42.5(pid=1208): stderr: | 20221210181303635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181303635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181303636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181303636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181303637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181303637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181303637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:05.156118 run osmo-stp_10.42.42.5(pid=1208): stdout: | (launched: 2022-12-10_18:13:03.464533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:05.272778 run osmo-stp_10.42.42.5(pid=1208): stderr: | 20221210181303635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181303635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181303636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181303636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181303637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181303637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181303637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:05.413324 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1208): Process ended prematurely: osmo-stp_10.42.42.5(pid=1208) [trial-2377↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1208)] [trial-2377↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 18:13:05.421556 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 18:13:05.447544 run osmo-hlr_10.42.42.2(pid=1205): ERR: Terminated: ERROR {rc=237} [trial-2377↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1205)] 18:13:05.494761 run osmo-hlr_10.42.42.2(pid=1205): stdout: | (launched: 2022-12-10_18:13:02.554119) 18:13:05.543771 run osmo-hlr_10.42.42.2(pid=1205): stderr: | 20221210181302732 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181302732 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181302732 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181302732 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181302732 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181302732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181302744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181302752 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181302753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181302753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:05.612368 run osmo-msc_10.42.42.6(pid=1211): ERR: Terminated: ERROR {rc=2} [trial-2377↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1211)] 18:13:05.659727 run osmo-msc_10.42.42.6(pid=1211): stdout: | (launched: 2022-12-10_18:13:04.563551) 18:13:05.709210 run osmo-msc_10.42.42.6(pid=1211): stderr: | 20221210181304838 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210181304838 DLGLOBAL DEBUG validating counter group 0x7f84560a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210181304838 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210181304838 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210181304839 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210181304839 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210181304841 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210181304841 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210181304841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210181304841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:13:05.758373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1204): Terminating (SIGTERM) 18:13:05.797646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1207): Terminating (SIGTERM) 18:13:05.836922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1210): Terminating (SIGTERM) 18:13:05.876401 --- ParallelTerminationStrategy: PID 1204 died... 18:13:05.895359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1204): Terminated: ok {rc=0} 18:13:05.939059 --- ParallelTerminationStrategy: PID 1207 died... 18:13:05.957433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1207): Terminated: ok {rc=0} 18:13:06.001156 --- ParallelTerminationStrategy: PID 1210 died... 18:13:06.019571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1210): Terminated: ok {rc=0} 18:13:06.104646 bus /sierra_3: Setting Powered False 18:13:07.204763 bus /sierra_3: Setting Powered False 18:13:08.320617 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2377 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 18:13:09.408934 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:09.420479 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:13:09.461406 tst emergency_preemptive_call.py: using LAC 29726 18:13:09.575950 tst emergency_preemptive_call.py: using RAC 146 18:13:09.692689 tst emergency_preemptive_call.py: using CellId 29726 18:13:09.807296 tst emergency_preemptive_call.py: using BVCI 29727 18:13:09.912493 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:09.923467 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:09.934229 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:09.944825 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:09.955473 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:09.966159 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:10.079479 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:10.197139 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:10.310039 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:10.422751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:10.879023 run create_hlr_db(pid=1213): Launched 18:13:11.001520 bus /sierra_2: Setting Powered False 18:13:12.061024 run create_hlr_db(pid=1213): Terminated: ok {rc=0} 18:13:12.471952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1215): Launched 18:13:12.766466 run osmo-hlr_10.42.42.2(pid=1216): Launched 18:13:12.878104 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:13.388479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1218): Launched 18:13:13.682715 run osmo-stp_10.42.42.5(pid=1219): Launched 18:13:13.803976 tst emergency_preemptive_call.py: using MSISDN 7832 18:13:13.953152 run osmo-msc_10.42.42.6: Starting osmo-msc 18:13:14.482268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1221): Launched 18:13:14.779184 run osmo-msc_10.42.42.6(pid=1222): Launched 18:13:14.944279 run osmo-stp_10.42.42.5(pid=1219): ERR: Terminated: ERROR {rc=1} [trial-2377↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1219)] 18:13:15.070176 run osmo-stp_10.42.42.5(pid=1219): stdout: | (launched: 2022-12-10_18:13:13.627860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:15.195301 run osmo-stp_10.42.42.5(pid=1219): stderr: | 20221210181313796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181313796 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181313796 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181313797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181313797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181313797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181313797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:15.318623 run osmo-stp_10.42.42.5(pid=1219): stdout: | (launched: 2022-12-10_18:13:13.627860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:15.436641 run osmo-stp_10.42.42.5(pid=1219): stderr: | 20221210181313796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181313796 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181313796 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181313797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181313797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181313797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181313797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:15.577082 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1219): Process ended prematurely: osmo-stp_10.42.42.5(pid=1219) [trial-2377↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1219)] [trial-2377↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 18:13:15.585387 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 18:13:15.611735 run osmo-hlr_10.42.42.2(pid=1216): ERR: Terminated: ERROR {rc=237} [trial-2377↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1216)] 18:13:15.659335 run osmo-hlr_10.42.42.2(pid=1216): stdout: | (launched: 2022-12-10_18:13:12.711635) 18:13:15.709052 run osmo-hlr_10.42.42.2(pid=1216): stderr: | 20221210181312887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181312887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181312887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181312887 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181312887 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181312887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181312900 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181312908 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181312908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181312908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:15.778196 run osmo-msc_10.42.42.6(pid=1222): ERR: Terminated: ERROR {rc=2} [trial-2377↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1222)] 18:13:15.825827 run osmo-msc_10.42.42.6(pid=1222): stdout: | (launched: 2022-12-10_18:13:14.724152) 18:13:15.877480 run osmo-msc_10.42.42.6(pid=1222): stderr: | 20221210181314995 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210181314997 DLGLOBAL DEBUG validating counter group 0x7fae8ea9dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210181314997 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210181314997 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210181314997 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210181314997 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210181315001 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210181315001 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210181315002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210181315002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:13:15.927816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1215): Terminating (SIGTERM) 18:13:15.968577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1218): Terminating (SIGTERM) 18:13:16.009706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1221): Terminating (SIGTERM) 18:13:16.052305 --- ParallelTerminationStrategy: PID 1215 died... 18:13:16.071730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1215): Terminated: ok {rc=0} 18:13:16.116437 --- ParallelTerminationStrategy: PID 1218 died... 18:13:16.135744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1218): Terminated: ok {rc=0} 18:13:16.180309 --- ParallelTerminationStrategy: PID 1221 died... 18:13:16.199539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1221): Terminated: ok {rc=0} 18:13:16.284600 bus /sierra_9: Setting Powered False 18:13:17.379079 bus /sierra_9: Setting Powered False 18:13:18.491593 bus /sierra_8: Setting Powered False 18:13:19.589814 bus /sierra_8: Setting Powered False 18:13:20.706154 bus /sierra_3: Setting Powered False 18:13:21.804517 bus /sierra_3: Setting Powered False 18:13:22.921080 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2377 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2377 gprs:nanobts+band-1900 --------------------------------------------------------------------- 18:13:24.193538 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:13:24.198498 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:13:24.222691 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 18:13:24.264220 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 18:13:24.351991 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:13:24.375775 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 18:13:24.414590 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 18:13:25.005909 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2377 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 18:13:25.055598 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:25.066446 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:13:25.104642 tst cs_paging_gprs_active.py: using LAC 29727 18:13:25.221952 tst cs_paging_gprs_active.py: using RAC 147 18:13:25.336846 tst cs_paging_gprs_active.py: using CellId 29727 18:13:25.452752 tst cs_paging_gprs_active.py: using BVCI 29728 18:13:25.560912 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:25.571620 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:25.582167 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:25.592572 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:25.603005 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:25.613429 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:25.623960 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:25.634315 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:25.644923 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:25.759140 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:25.874783 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:13:26.075152 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:13:26.376434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1227): Launched 18:13:26.639021 run iperf3-srv_10.42.42.10(pid=1228): Launched 18:13:26.753803 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:13:26.953968 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:13:27.255298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1229): Launched 18:13:27.518458 run iperf3-srv_10.42.42.10(pid=1230): Launched 18:13:27.633374 tst cs_paging_gprs_active.py:38: start network... 18:13:27.833339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:28.299688 run create_hlr_db(pid=1232): Launched 18:13:28.423027 bus /sierra_2: Setting Powered False 18:13:29.483033 run create_hlr_db(pid=1232): Terminated: ok {rc=0} 18:13:29.921250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1234): Launched 18:13:30.242957 run osmo-hlr_10.42.42.2(pid=1235): Launched 18:13:30.367043 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:30.931551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1237): Launched 18:13:31.277152 run osmo-stp_10.42.42.5(pid=1238): Launched 18:13:31.476575 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:13:32.102176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1240): Launched 18:13:32.231277 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:13:32.490637 run patchelf(pid=1241): Launched 18:13:32.659636 run osmo-stp_10.42.42.5(pid=1238): ERR: Terminated: ERROR {rc=1} [trial-2377↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1238)] 18:13:32.786576 run osmo-stp_10.42.42.5(pid=1238): stdout: | (launched: 2022-12-10_18:13:31.214144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:32.915055 run osmo-stp_10.42.42.5(pid=1238): stderr: | 20221210181331499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181331499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181331500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181331501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181331501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181331501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181331502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:33.043665 run osmo-stp_10.42.42.5(pid=1238): stdout: | (launched: 2022-12-10_18:13:31.214144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:33.167018 run osmo-stp_10.42.42.5(pid=1238): stderr: | 20221210181331499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210181331499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210181331500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210181331501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210181331501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210181331501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210181331502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:33.313319 run patchelf(pid=1241): Terminating (SIGINT) 18:13:33.481633 run patchelf(pid=1241): Terminated: ok {rc=0} 18:13:33.603808 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1238): Process ended prematurely: osmo-stp_10.42.42.5(pid=1238) [trial-2377↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1238)] [trial-2377↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 18:13:33.613218 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 18:13:33.640299 run osmo-hlr_10.42.42.2(pid=1235): ERR: Terminated: ERROR {rc=237} [trial-2377↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1235)] 18:13:33.687342 run osmo-hlr_10.42.42.2(pid=1235): stdout: | (launched: 2022-12-10_18:13:30.182984) 18:13:33.736712 run osmo-hlr_10.42.42.2(pid=1235): stderr: | 20221210181330381 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210181330381 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210181330381 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210181330381 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210181330381 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210181330381 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210181330402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2377/run.2022-12-10_17-10-07/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210181330412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210181330412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210181330412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:33.786184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1227): Terminating (SIGTERM) 18:13:33.825658 run iperf3-srv_10.42.42.10(pid=1228): Terminating (SIGTERM) 18:13:33.865505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1229): Terminating (SIGTERM) 18:13:33.904779 run iperf3-srv_10.42.42.10(pid=1230): Terminating (SIGTERM) 18:13:33.944052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1234): Terminating (SIGTERM) 18:13:33.983563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1237): Terminating (SIGTERM) 18:13:34.022785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1240): Terminating (SIGTERM) 18:13:34.062582 --- ParallelTerminationStrategy: PID 1227 died... 18:13:34.081598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1227): Terminated: ok {rc=0} 18:13:34.125511 --- ParallelTerminationStrategy: PID 1228 died... 18:13:34.143711 run iperf3-srv_10.42.42.10(pid=1228): Terminated {rc=256} 18:13:34.187358 --- ParallelTerminationStrategy: PID 1229 died... 18:13:34.205788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1229): Terminated: ok {rc=0} 18:13:34.249179 --- ParallelTerminationStrategy: PID 1230 died... 18:13:34.267535 run iperf3-srv_10.42.42.10(pid=1230): Terminated {rc=256} 18:13:34.311076 --- ParallelTerminationStrategy: PID 1234 died... 18:13:34.329645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1234): Terminated: ok {rc=0} 18:13:34.373225 --- ParallelTerminationStrategy: PID 1237 died... 18:13:34.391562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1237): Terminated: ok {rc=0} 18:13:34.435769 --- ParallelTerminationStrategy: PID 1240 died... 18:13:34.454509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1240): Terminated: ok {rc=0} 18:13:34.539501 bus /gobi_0: Setting Powered False FATAL: command execution failed java.io.EOFException at java.base/java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2905) at java.base/java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3400) at java.base/java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:936) at java.base/java.io.ObjectInputStream.<init>(ObjectInputStream.java:379) at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:49) at hudson.remoting.Command.readFrom(Command.java:142) at hudson.remoting.Command.readFrom(Command.java:128) at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61) Caused: java.io.IOException: Unexpected termination of the channel at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:75) Caused: java.io.IOException: Backing channel 'osmo-gsm-tester-prod' is disconnected. at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285) at com.sun.proxy.$Proxy77.isAlive(Unknown Source) at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215) at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207) at hudson.tasks.CommandInterpreter.join(CommandInterpreter.java:195) at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:145) at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:92) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814) at hudson.model.Build$BuildExecution.build(Build.java:199) at hudson.model.Build$BuildExecution.doRun(Build.java:164) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522) at hudson.model.Run.execute(Run.java:1896) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:442) FATAL: Unable to delete script file /tmp/jenkins3144632021898651002.sh java.io.EOFException at java.base/java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2905) at java.base/java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3400) at java.base/java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:936) at java.base/java.io.ObjectInputStream.<init>(ObjectInputStream.java:379) at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:49) at hudson.remoting.Command.readFrom(Command.java:142) at hudson.remoting.Command.readFrom(Command.java:128) at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61) Caused: java.io.IOException: Unexpected termination of the channel at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:75) Caused: hudson.remoting.ChannelClosedException: Channel "hudson.remoting.Channel@4e983fe6:osmo-gsm-tester-prod": Remote call on osmo-gsm-tester-prod failed. The channel is closing down or has closed down at hudson.remoting.Channel.call(Channel.java:993) at hudson.FilePath.act(FilePath.java:1194) at hudson.FilePath.act(FilePath.java:1183) at hudson.FilePath.delete(FilePath.java:1730) at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:163) at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:92) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814) at hudson.model.Build$BuildExecution.build(Build.java:199) at hudson.model.Build$BuildExecution.doRun(Build.java:164) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522) at hudson.model.Run.execute(Run.java:1896) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:442) Build step 'Execute shell' marked build as failure ERROR: Step ‘Archive the artifacts’ failed: no workspace for osmo-gsm-tester_run-prod #2377 ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for osmo-gsm-tester_run-prod #2377 Sending e-mails to: pespin@sysmocom.de Finished: FAILURE